Differentially Private Meta-Learning
원문 초록
Parameter-transfer is a well-known and versatile approach for meta-learning, with applications including few-shot learning, federated learning, and reinforcement learning. However, parameter-transfer algorithms often require sharing models that have been trained on the samples from specific tasks, thus leaving the task-owners susceptible to breaches of privacy. We conduct the first formal study of privacy in this setting and formalize the notion of task-global differential privacy as a practical relaxation of more commonly studied threat models. We then propose a new differentially private algorithm for gradient-based parameter transfer that not only satisfies this privacy requirement but also retains provable transfer learning guarantees in convex settings. Empirically, we apply our analysis to the problems of federated learning with personalization and few-shot classification, showing that allowing the relaxation to task-global privacy from the more commonly studied notion of local privacy leads to dramatically increased performance in recurrent neural language modeling and image classification.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Federated Learning for Commercial Image Sources
FedGSCA: Medical Federated Learning with Global Sample Selector and Client Adaptive Adjuster under Label Noise
FewVS: A Vision-Semantics Integration Framework for Few-Shot Image Classification
Multistage Relation Network With Dual-Metric for Few-Shot Hyperspectral Image Classification
Few-shot Learning with Class-Covariance Metric for Hyperspectral Image Classification
Federated Model Search via Reinforcement Learning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.