Learning to Generate Unambiguous Spatial Referring Expressions for Real-World Environments
원문 초록
Referring to objects in a natural and unambiguous manner is crucial for effective human-robot interaction. Previous research on learning-based referring expressions has focused primarily on comprehension tasks, while generating referring expressions is still mostly limited to rule-based methods. In this work, we propose a two-stage approach that relies on deep learning for estimating spatial relations to describe an object naturally and unambiguously with a referring expression. We compare our method to the state of the art algorithm in ambiguous environments (e.g., environments that include very similar objects with similar relationships). We show that our method generates referring expressions that people find to be more accurate ($\sim$30% better) and would prefer to use ($\sim$32% more often).
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
What is the Right Embedding Space for Contrastive Learning in REC?
Detecting Referring Expressions in Visually Grounded Dialogue with Autoregressive Language Models
TextRegion: Text-Aligned Region Tokens from Frozen Image-Text Models
RemoteSAM: Towards Segment Anything for Earth Observation
Vision-Language Models Are Not Pragmatically Competent in Referring Expression Generation
4th PVUW MeViS 3rd Place Report: Sa2VA
토론
이 논문과 연결된 포럼 글이 아직 없습니다.