TY - JOUR
T1 - Retrieval-Augmented Framework with Adaptive Gating for Time Series Forecasting
AU - Wang, Yiqiao
AU - Wang, Pengfei
AU - Gu, Xiaotian
AU - Wang, Xiaoling
N1 - Publisher Copyright:
© Shanghai Jiao Tong University 2025.
PY - 2025
Y1 - 2025
N2 - Although Transformer-based models have achieved good performance in time series forecasting, existing methods still have limitations in modeling long-term dependencies. To this end, we propose a retrieval-augmented framework for time series forecasting, which models the long-range dependency explicitly. First, we consider both time-domain and frequency-domain similarities to retrieve top-K similar historical sequences for each input sequence. Subsequently, to fully exploit the retrieved information while suppressing potential noise, a dual-branch architecture is designed: the original sequence branch primarily models the internal dependencies of the current input, while the retrieval-augmented branch models the relationship between the current input and the retrieved historical sequences through a cross-attention mechanism. Furthermore, to adaptively balance the contributions of the two branches, a gating fusion mechanism is introduced to dynamically adjust the proportion of information integration from the two branches. Experiments on several public datasets show that our proposed method achieves superior and stable performance compared to existing methods, especially in long-term forecasting settings.
AB - Although Transformer-based models have achieved good performance in time series forecasting, existing methods still have limitations in modeling long-term dependencies. To this end, we propose a retrieval-augmented framework for time series forecasting, which models the long-range dependency explicitly. First, we consider both time-domain and frequency-domain similarities to retrieve top-K similar historical sequences for each input sequence. Subsequently, to fully exploit the retrieved information while suppressing potential noise, a dual-branch architecture is designed: the original sequence branch primarily models the internal dependencies of the current input, while the retrieval-augmented branch models the relationship between the current input and the retrieved historical sequences through a cross-attention mechanism. Furthermore, to adaptively balance the contributions of the two branches, a gating fusion mechanism is introduced to dynamically adjust the proportion of information integration from the two branches. Experiments on several public datasets show that our proposed method achieves superior and stable performance compared to existing methods, especially in long-term forecasting settings.
KW - A
KW - TP391
KW - gating mechanism
KW - retrieval-augmented framework
KW - time series forecasting
UR - https://www.scopus.com/pages/publications/105015326103
U2 - 10.1007/s12204-025-2847-z
DO - 10.1007/s12204-025-2847-z
M3 - 文章
AN - SCOPUS:105015326103
SN - 1007-1172
JO - Journal of Shanghai Jiaotong University (Science)
JF - Journal of Shanghai Jiaotong University (Science)
ER -