A Survey of Supernet Optimization and its Applications: Spatial and Temporal Optimization for Neural Architecture Search
원문 초록
This survey focuses on categorizing and evaluating the methods of supernet optimization in the field of Neural Architecture Search (NAS). Supernet optimization involves training a single, over-parameterized network that encompasses the search space of all possible network architectures. The survey analyses supernet optimization methods based on their approaches to spatial and temporal optimization. Spatial optimization relates to optimizing the architecture and parameters of the supernet and its subnets, while temporal optimization deals with improving the efficiency of selecting architectures from the supernet. The benefits, limitations, and potential applications of these methods in various tasks and settings, including transferability, domain generalization, and Transformer models, are also discussed.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
A Robust Feature Downsampling Module for Remote Sensing Visual Tasks
Tomato Multi-Angle Multi-Pose Dataset for Fine-Grained Phenotyping
Transferring Styles for Reduced Texture Bias and Improved Robustness in Semantic Segmentation Networks
Admissibility of Stein Shrinkage for Batch Normalization in the Presence of Adversarial Attacks
DecoupleNet: A Lightweight Backbone Network With Efficient Feature Decoupling for Remote Sensing Visual Tasks
Domain Generalized Object Detection for Remote Sensing Images
토론
이 논문과 연결된 포럼 글이 아직 없습니다.