Hidden Footprints: Learning Contextual Walkability from 3D Human Trails
원문 초록
Predicting where people can walk in a scene is important for many tasks, including autonomous driving systems and human behavior analysis. Yet learning a computational model for this purpose is challenging due to semantic ambiguity and a lack of labeled data: current datasets only tell you where people are, not where they could be. We tackle this problem by leveraging information from existing datasets, without additional labeling. We first augment the set of valid, labeled walkable regions by propagating person observations between images, utilizing 3D information to create what we call hidden footprints. However, this augmented data is still sparse. We devise a training strategy designed for such sparse labels, combining a class-balanced classification loss with a contextual adversarial loss. Using this strategy, we demonstrate a model that learns to predict a walkability map from a single image. We evaluate our model on the Waymo and Cityscapes datasets, demonstrating superior performance compared to baselines and state-of-the-art models.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
LifelongPR: Lifelong knowledge fusion for point cloud place recognition based on replay and prompt learning
$I^{2}$-World: Intra-Inter Tokenization for Efficient Dynamic 4D Scene Forecasting
MCAM: Multimodal Causal Analysis Model for Ego-Vehicle-Level Driving Video Understanding
Beyond One Shot, Beyond One Perspective: Cross-View and Long-Horizon Distillation for Better LiDAR Representations
Following the Clues: Experiments on Person Re-ID using Cross-Modal Intelligence
A Survey on Vision-Language-Action Models for Autonomous Driving
토론
이 논문과 연결된 포럼 글이 아직 없습니다.