arXiv:2410.17128

Understanding Transfer Learning via Mean-field Analysis

Gholamali Aminian, Łukasz Szpruch, Samuel N. Cohen

제출 2024-10-22

원문 초록

We propose a novel framework for exploring generalization errors of transfer learning through the lens of differential calculus on the space of probability measures. In particular, we consider two main transfer learning scenarios, $\alpha$-ERM and fine-tuning with the KL-regularized empirical risk minimization and establish generic conditions under which the generalization error and the population risk convergence rates for these scenarios are studied. Based on our theoretical results, we show the benefits of transfer learning with a one-hidden-layer neural network in the mean-field regime under some suitable integrability and regularity assumptions on the loss and activation functions.

함께 살펴볼 논문

공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.

arXiv:2507.06085공통 태그 Transfer Learning공식 코드 · Papers with Code

A Survey on Prompt Tuning

토론

이 논문과 연결된 포럼 글이 아직 없습니다.