On the Evaluation of Vision-and-Language Navigation Instructions
원문 초록
Vision-and-Language Navigation wayfinding agents can be enhanced by exploiting automatically generated navigation instructions. However, existing instruction generators have not been comprehensively evaluated, and the automatic evaluation metrics used to develop them have not been validated. Using human wayfinders, we show that these generators perform on par with or only slightly better than a template-based generator and far worse than human instructors. Furthermore, we discover that BLEU, ROUGE, METEOR and CIDEr are ineffective for evaluating grounded navigation instructions. To improve instruction evaluation, we propose an instruction-trajectory compatibility model that operates without reference instructions. Our model shows the highest correlation with human wayfinding outcomes when scoring individual instructions. For ranking instruction generation systems, if reference instructions are available we recommend using SPICE.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environments
A Navigation Framework Utilizing Vision-Language Models
Cross from Left to Right Brain: Adaptive Text Dreamer for Vision-and-Language Navigation
FlightGPT: Towards Generalizable and Interpretable UAV Vision-and-Language Navigation with Vision-Language Models
Dynam3D: Dynamic Layered 3D Tokens Empower VLM for Vision-and-Language Navigation
CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memory
토론
이 논문과 연결된 포럼 글이 아직 없습니다.