Rank2Tell: A Multimodal Driving Dataset for Joint Importance Ranking and Reasoning
원문 초록
The widespread adoption of commercial autonomous vehicles (AVs) and advanced driver assistance systems (ADAS) may largely depend on their acceptance by society, for which their perceived trustworthiness and interpretability to riders are crucial. In general, this task is challenging because modern autonomous systems software relies heavily on black-box artificial intelligence models. Towards this goal, this paper introduces a novel dataset, Rank2Tell, a multi-modal ego-centric dataset for Ranking the importance level and Telling the reason for the importance. Using various close and open-ended visual question answering, the dataset provides dense annotations of various semantic, spatial, temporal, and relational attributes of various important objects in complex traffic scenarios. The dense annotations and unique attributes of the dataset make it a valuable resource for researchers working on visual scene understanding and related fields. Furthermore, we introduce a joint model for joint importance level ranking and natural language captions generation to benchmark our dataset and demonstrate performance with quantitative evaluations.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Scene-R1: Video-Grounded Large Language Models for 3D Scene Reasoning without 3D Annotations
PhyBlock: A Progressive Benchmark for Physical Understanding and Planning via 3D Block Assembly
Learning Sparsity for Effective and Efficient Music Performance Question Answering
Describe Anything Model for Visual Question Answering on Text-rich Images
Revisiting CroPA: A Reproducibility Study and Enhancements for Cross-Prompt Adversarial Transferability in Vision-Language Models
DrishtiKon: Multi-Granular Visual Grounding for Text-Rich Document Images
토론
이 논문과 연결된 포럼 글이 아직 없습니다.