Is Fast Adaptation All You Need?
원문 초록
Gradient-based meta-learning has proven to be highly effective at learning model initializations, representations, and update rules that allow fast adaptation from a few samples. The core idea behind these approaches is to use fast adaptation and generalization -- two second-order metrics -- as training signals on a meta-training dataset. However, little attention has been given to other possible second-order metrics. In this paper, we investigate a different training signal -- robustness to catastrophic interference -- and demonstrate that representations learned by directing minimizing interference are more conducive to incremental learning than those learned by just maximizing fast adaptation.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
The Bayesian Approach to Continual Learning: An Overview
Hyperbolic Dual Feature Augmentation for Open-Environment
Boosting Domain Incremental Learning: Selecting the Optimal Parameters is All You Need
Geo-ORBIT: A Federated Digital Twin Framework for Scene-Adaptive Lane Geometry Detection
Addressing Imbalanced Domain-Incremental Learning through Dual-Balance Collaborative Experts
Is Diversity All You Need for Scalable Robotic Manipulation?
토론
이 논문과 연결된 포럼 글이 아직 없습니다.