Shortcut Learning in In-Context Learning: A Survey
원문 초록
Shortcut learning refers to the phenomenon where models employ simple, non-robust decision rules in practical tasks, which hinders their generalization and robustness. With the rapid development of large language models (LLMs) in recent years, an increasing number of studies have shown the impact of shortcut learning on LLMs. This paper provides a novel perspective to review relevant research on shortcut learning in In-Context Learning (ICL). It conducts a detailed exploration of the types of shortcuts in ICL tasks, their causes, available benchmarks, and strategies for mitigating shortcuts. Based on corresponding observations, it summarizes the unresolved issues in existing research and attempts to outline the future research landscape of shortcut learning.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Scientific Hypothesis Generation and Validation: Methods, Datasets, and Future Directions
Assay2Mol: large language model-based drug design using BioAssay context
A Survey on Prompt Tuning
A Survey on Latent Reasoning
A Survey on Vision-Language-Action Models for Autonomous Driving
Universal pre-training by iterated random computation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.