Learning Collective Dynamics of Multi-Agent Systems using Event-based Vision
원문 초록
This paper proposes a novel problem: vision-based perception to learn and predict the collective dynamics of multi-agent systems, specifically focusing on interaction strength and convergence time. Multi-agent systems are defined as collections of more than ten interacting agents that exhibit complex group behaviors. Unlike prior studies that assume knowledge of agent positions, we focus on deep learning models to directly predict collective dynamics from visual data, captured as frames or events. Due to the lack of relevant datasets, we create a simulated dataset using a state-of-the-art flocking simulator, coupled with a vision-to-event conversion framework. We empirically demonstrate the effectiveness of event-based representation over traditional frame-based methods in predicting these collective behaviors. Based on our analysis, we present event-based vision for Multi-Agent dynamic Prediction (evMAP), a deep learning architecture designed for real-time, accurate understanding of interaction strength and collective behavior emergence in multi-agent systems.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Egocentric Event-Based Vision for Ping Pong Ball Trajectory Prediction
V2V: Scaling Event-Based Vision through Efficient Video-to-Voxel Simulation
Dynamic Graph Induced Contour-aware Heat Conduction Network for Event-based Object Detection
MTevent: A Multi-Task Event Camera Dataset for 6D Pose Estimation and Moving Object Detection
RGB-Event Fusion with Self-Attention for Collision Prediction
NTIRE 2025 Challenge on Event-Based Image Deblurring: Methods and Results
토론
이 논문과 연결된 포럼 글이 아직 없습니다.