Action Anticipation with RBF Kernelized Feature Mapping RNN
원문 초록
We introduce a novel Recurrent Neural Network-based algorithm for future video feature generation and action anticipation called feature mapping RNN. Our novel RNN architecture builds upon three effective principles of machine learning, namely parameter sharing, Radial Basis Function kernels and adversarial training. Using only some of the earliest frames of a video, the feature mapping RNN is able to generate future features with a fraction of the parameters needed in traditional RNN. By feeding these future features into a simple multi-layer perceptron facilitated with an RBF kernel layer, we are able to accurately predict the action in the video. In our experiments, we obtain 18% improvement on JHMDB-21 dataset, 6% on UCF101-24 and 13% improvement on UT-Interaction datasets over prior state-of-the-art for action anticipation.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning
Hierarchical and Multimodal Data for Daily Activity Understanding
Multimodal Large Models Are Effective Action Anticipators
Mamba Fusion: Learning Actions Through Questioning
From Recognition to Prediction: Leveraging Sequence Reasoning for Action Anticipation
QuIIL at T3 challenge: Towards Automation in Life-Saving Intervention Procedures from First-Person View
토론
이 논문과 연결된 포럼 글이 아직 없습니다.