Building Intelligent Autonomous Navigation Agents
원문 초록
Breakthroughs in machine learning in the last decade have led to `digital intelligence', i.e. machine learning models capable of learning from vast amounts of labeled data to perform several digital tasks such as speech recognition, face recognition, machine translation and so on. The goal of this thesis is to make progress towards designing algorithms capable of `physical intelligence', i.e. building intelligent autonomous navigation agents capable of learning to perform complex navigation tasks in the physical world involving visual perception, natural language understanding, reasoning, planning, and sequential decision making. Despite several advances in classical navigation methods in the last few decades, current navigation agents struggle at long-term semantic navigation tasks. In the first part of the thesis, we discuss our work on short-term navigation using end-to-end reinforcement learning to tackle challenges such as obstacle avoidance, semantic perception, language grounding, and reasoning. In the second part, we present a new class of navigation methods based on modular learning and structured explicit map representations, which leverage the strengths of both classical and end-to-end learning methods, to tackle long-term navigation tasks. We show that these methods are able to effectively tackle challenges such as localization, mapping, long-term planning, exploration and learning semantic priors. These modular learning methods are capable of long-term spatial and semantic understanding and achieve state-of-the-art results on various navigation tasks.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
State and Memory is All You Need for Robust and Reliable AI Agents
Semantic similarity estimation for domain specific data using BERT and other techniques
Graph-Structured Data Analysis of Component Failure in Autonomous Cargo Ships Based on Feature Fusion
GeoDistill: Geometry-Guided Self-Distillation for Weakly Supervised Cross-View Localization
Guiding LLM Decision-Making with Fairness Reward Models
Attributes Shape the Embedding Space of Face Recognition Models
토론
이 논문과 연결된 포럼 글이 아직 없습니다.