Gated Recurrent Neural Networks with Weighted Time-Delay Feedback
원문 초록
In this paper, we present a novel approach to modeling long-term dependencies in sequential data by introducing a gated recurrent unit (GRU) with a weighted time-delay feedback mechanism. Our proposed model, named $\tau$-GRU, is a discretized version of a continuous-time formulation of a recurrent unit, where the dynamics are governed by delay differential equations (DDEs). We prove the existence and uniqueness of solutions for the continuous-time model and show that the proposed feedback mechanism can significantly improve the modeling of long-term dependencies. Our empirical results indicate that $\tau$-GRU outperforms state-of-the-art recurrent units and gated recurrent architectures on a range of tasks, achieving faster convergence and better generalization.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Enhanced Spatio- Temporal Image Encoding for Online Human Activity Recognition
SEZ-HARN: Self-Explainable Zero-shot Human Activity Recognition Network
A Review of the Long Horizon Forecasting Problem in Time Series Analysis
The interplay of robustness and generalization in quantum machine learning
Through-the-Wall Radar Human Activity Recognition WITHOUT Using Neural Networks
A Better Alternative to Piecewise Linear Time Series Segmentation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.