Understanding Different Design Choices in Training Large Time Series Models
원문 초록
Inspired by Large Language Models (LLMs), Time Series Forecasting (TSF), a long-standing task in time series analysis, is undergoing a transition towards Large Time Series Models (LTSMs), aiming to train universal transformer-based models for TSF. However, training LTSMs on heterogeneous time series data poses unique challenges, including diverse frequencies, dimensions, and patterns across datasets. Recent endeavors have studied and evaluated various design choices aimed at enhancing LTSM training and generalization capabilities, spanning pre-processing techniques, model configurations, and dataset configurations. In this work, we comprehensively analyze these design choices and aim to identify the best practices for training LTSM. Moreover, we propose \emph{time series prompt}, a novel statistical prompting strategy tailored to time series data. Furthermore, based on the observations in our analysis, we introduce \texttt{LTSM-bundle}, which bundles the best design choices we have identified. Empirical results demonstrate that \texttt{LTSM-bundle} achieves superior zero-shot and few-shot performances compared to state-of-the-art LSTMs and traditional TSF methods on benchmark datasets.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Trojan Horse Hunt in Time Series Forecasting for Space Operations
Byte Pair Encoding for Efficient Time Series Forecasting
Temporal Convolutional Attention Neural Networks for Time Series Forecasting
Interpretable Multivariate Time Series Forecasting with Temporal Attention Convolutional Neural Networks
DATE: Dual Attentive Tree-aware Embedding for Customs Fraud Detection
Robust Online Time Series Prediction with Recurrent Neural Networks
토론
이 논문과 연결된 포럼 글이 아직 없습니다.