REGENT: A Retrieval-Augmented Generalist Agent That Can Act In-Context in New Environments
원문 초록
Building generalist agents that can rapidly adapt to new environments is a key challenge for deploying AI in the digital and real worlds. Is scaling current agent architectures the most effective way to build generalist agents? We propose a novel approach to pre-train relatively small policies on relatively small datasets and adapt them to unseen environments via in-context learning, without any finetuning. Our key idea is that retrieval offers a powerful bias for fast adaptation. Indeed, we demonstrate that even a simple retrieval-based 1-nearest neighbor agent offers a surprisingly strong baseline for today's state-of-the-art generalist agents. From this starting point, we construct a semi-parametric agent, REGENT, that trains a transformer-based policy on sequences of queries and retrieved neighbors. REGENT can generalize to unseen robotics and game-playing environments via retrieval augmentation and in-context learning, achieving this with up to 3x fewer parameters and up to an order-of-magnitude fewer pre-training datapoints, significantly outperforming today's state-of-the-art generalist agents. Website: https://kaustubhsridhar.github.io/regent-research
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
On Finetuning Tabular Foundation Models
How to Retrieve Examples in In-context Learning to Improve Conversational Emotion Recognition using Large Language Models?
Case-based Reasoning Augmented Large Language Model Framework for Decision Making in Realistic Safety-Critical Driving Scenarios
Vela: Scalable Embeddings with Voice Large Language Models for Multimodal Retrieval
On Automating Security Policies with Contemporary LLMs
Retrieval-Augmented Generation as Noisy In-Context Learning: A Unified Theory and Risk Bounds
토론
이 논문과 연결된 포럼 글이 아직 없습니다.