MGE: A Training-Free and Efficient Model Generation and Enhancement Scheme
원문 초록
To provide a foundation for the research of deep learning models, the construction of model pool is an essential step. This paper proposes a Training-Free and Efficient Model Generation and Enhancement Scheme (MGE). This scheme primarily considers two aspects during the model generation process: the distribution of model parameters and model performance. Experiments result shows that generated models are comparable to models obtained through normal training, and even superior in some cases. Moreover, the time consumed in generating models accounts for only 1\% of the time required for normal model training. More importantly, with the enhancement of Evolution-MGE, generated models exhibits competitive generalization ability in few-shot tasks. And the behavioral dissimilarity of generated models has the potential of adversarial defense.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Bridging Robustness and Generalization Against Word Substitution Attacks in NLP via the Growth Bound Matrix Approach
Towards Effective and Efficient Adversarial Defense with Diffusion Models for Robust Visual Tracking
Accidental Misalignment: Fine-Tuning Language Models Induces Unexpected Vulnerability
A Few Large Shifts: Layer-Inconsistency Based Minimal Overhead Adversarial Example Detection
GenoArmory: A Unified Evaluation Framework for Adversarial Attacks on Genomic Foundation Models
Lightweight Defense Against Adversarial Attacks in Time Series Classification
토론
이 논문과 연결된 포럼 글이 아직 없습니다.