arXiv:2012.05292
Topological Planning with Transformers for Vision-and-Language Navigation
원문 초록
Conventional approaches to vision-and-language navigation (VLN) are trained end-to-end but struggle to perform well in freely traversable environments. Inspired by the robotics community, we propose a modular approach to VLN using topological maps. Given a natural language instruction and topological map, our approach leverages attention mechanisms to predict a navigation plan in the map. The plan is then executed with low-level actions (e.g. forward, rotate) using a robust controller. Experiments show that our method outperforms previous end-to-end approaches, generates interpretable navigation plans, and exhibits intelligent behaviors such as backtracking.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environments
A Navigation Framework Utilizing Vision-Language Models
Cross from Left to Right Brain: Adaptive Text Dreamer for Vision-and-Language Navigation
FlightGPT: Towards Generalizable and Interpretable UAV Vision-and-Language Navigation with Vision-Language Models
Dynam3D: Dynamic Layered 3D Tokens Empower VLM for Vision-and-Language Navigation
CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memory
토론
이 논문과 연결된 포럼 글이 아직 없습니다.