CaSS: A Channel-aware Self-supervised Representation Learning Framework for Multivariate Time Series Classification
원문 초록
Self-supervised representation learning of Multivariate Time Series (MTS) is a challenging task and attracts increasing research interests in recent years. Many previous works focus on the pretext task of self-supervised learning and usually neglect the complex problem of MTS encoding, leading to unpromising results. In this paper, we tackle this challenge from two aspects: encoder and pretext task, and propose a unified channel-aware self-supervised learning framework CaSS. Specifically, we first design a new Transformer-based encoder Channel-aware Transformer (CaT) to capture the complex relationships between different time channels of MTS. Second, we combine two novel pretext tasks Next Trend Prediction (NTP) and Contextual Similarity (CS) for the self-supervised representation learning with our proposed encoder. Extensive experiments are conducted on several commonly used benchmark datasets. The experimental results show that our framework achieves new state-of-the-art comparing with previous self-supervised MTS representation learning methods (up to +7.70\% improvement on LSST dataset) and can be well applied to the downstream MTS classification.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
A Joint-Entropy Approach To Time-series Classification
Semi-supervised Time Series Classification by Temporal Relation Prediction
Source Model Selection for Deep Learning in the Time Series Domain
Unsupervised Anomaly Detection in Energy Time Series Data Using Variational Recurrent Autoencoders with Attention
Support Vector Machines with Time Series Distance Kernels for Action Classification
TimeMaster: Training Time-Series Multimodal LLMs to Reason via Reinforcement Learning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.