Turning TS2Vec into a Foundation Model for Time Series Classification
[Uczenie maszynowe] Autorzy: Vasilii Feofanov, Zhenghan Tai, Andrei Ermakov i 1 więcej
TS2Vec is one of the strongest self-supervised methods for time series classification, introduced in 2022. It is designed to be trained anew on every dataset: self-supervised pre-training followed by linear probing. Since then, the field has shifted towards foundation models that reuse one encoder across datasets. Yet TS2Vec offers a compact convolutional architecture that operates directly on temporal samples and accepts variable-length inputs without resampling. We ask whether these properties can be retained when the encoder is pre-trained only once, and show that they can: TS2Vec can essentially be turned into a foundation model. Three changes suffice: pre-train on a synthetic corpus, feed the encoder a raw amplitude view and an instance-normalized shape view of the input through two small stems, and distill one specialist encoder per view into a single encoder. The result, TS2Vec-F…
- Kategoria arxiv
- cs.LG
- Kategoria
- Uczenie maszynowe