Personalized Federated Learning via Backbone Self-Distillation
원문 초록
In practical scenarios, federated learning frequently necessitates training personalized models for each client using heterogeneous data. This paper proposes a backbone self-distillation approach to facilitate personalized federated learning. In this approach, each client trains its local model and only sends the backbone weights to the server. These weights are then aggregated to create a global backbone, which is returned to each client for updating. However, the client's local backbone lacks personalization because of the common representation. To solve this problem, each client further performs backbone self-distillation by using the global backbone as a teacher and transferring knowledge to update the local backbone. This process involves learning two components: the shared backbone for common representation and the private head for local personalization, which enables effective global knowledge transfer. Extensive experiments and comparisons with 12 state-of-the-art approaches demonstrate the effectiveness of our approach.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
pFedMMA: Personalized Federated Fine-Tuning with Multi-Modal Adapter for Vision-Language Models
FedRef: Communication-Efficient Bayesian Fine Tuning with Reference Model
Personalized Federated Learning via Dual-Prompt Optimization and Cross Fusion
Convergence-Privacy-Fairness Trade-Off in Personalized Federated Learning
Dual‑detector Re‑optimization for Federated Weakly Supervised Video Anomaly Detection Via Adaptive Dynamic Recursive Mapping
pFedSOP : Accelerating Training Of Personalized Federated Learning Using Second-Order Optimization
토론
이 논문과 연결된 포럼 글이 아직 없습니다.