Learning recurrent representations for hierarchical behavior modeling
원문 초록
We propose a framework for detecting action patterns from motion sequences and modeling the sensory-motor relationship of animals, using a generative recurrent neural network. The network has a discriminative part (classifying actions) and a generative part (predicting motion), whose recurrent cells are laterally connected, allowing higher levels of the network to represent high level phenomena. We test our framework on two types of data, fruit fly behavior and online handwriting. Our results show that 1) taking advantage of unlabeled sequences, by predicting future motion, significantly improves action detection performance when training labels are scarce, 2) the network learns to represent high level phenomena such as writer identity and fly gender, without supervision, and 3) simulated motion trajectories, generated by treating motion prediction as input to the network, look realistic and may be used to qualitatively evaluate whether the model has learnt generative control rules.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Temporal Continual Learning with Prior Compensation for Human Motion Prediction
Stochastic Human Motion Prediction with Memory of Action Transition and Action Characteristic
Autoregression-free video prediction using diffusion model for mitigating error propagation
APEX: Empowering LLMs with Physics-Based Task Planning for Real-time Insight
Multi-Resolution Haar Network: Enhancing human motion prediction via Haar transform
AGI-Elo: How Far Are We From Mastering A Task?
토론
이 논문과 연결된 포럼 글이 아직 없습니다.