Model-Agnostic Meta-Learning using Runge-Kutta Methods
원문 초록
Meta-learning has emerged as an important framework for learning new tasks from just a few examples. The success of any meta-learning model depends on (i) its fast adaptation to new tasks, as well as (ii) having a shared representation across similar tasks. Here we extend the model-agnostic meta-learning (MAML) framework introduced by Finn et al. (2017) to achieve improved performance by analyzing the temporal dynamics of the optimization procedure via the Runge-Kutta method. This method enables us to gain fine-grained control over the optimization and helps us achieve both the adaptation and representation goals across tasks. By leveraging this refined control, we demonstrate that there are multiple principled ways to update MAML and show that the classic MAML optimization is simply a special case of second-order Runge-Kutta method that mainly focuses on fast-adaptation. Experiments on benchmark classification, regression and reinforcement learning tasks show that this refined control helps attain improved results.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
MOBODY: Model Based Off-Dynamics Offline Reinforcement Learning
Socratic RL: A Novel Framework for Efficient Knowledge Acquisition through Iterative Reflection and Viewpoint Distillation
Improving choice model specification using reinforcement learning
Customizing Speech Recognition Model with Large Language Model Feedback
Data-assimilated model-informed reinforcement learning
Meta Reinforcement Learning for Multi-Task Offloading in Vehicular Edge Computing
토론
이 논문과 연결된 포럼 글이 아직 없습니다.