Differential Evolution for Neural Architecture Search
원문 초록
Neural architecture search (NAS) methods rely on a search strategy for deciding which architectures to evaluate next and a performance estimation strategy for assessing their performance (e.g., using full evaluations, multi-fidelity evaluations, or the one-shot model). In this paper, we focus on the search strategy. We introduce the simple yet powerful evolutionary algorithm of differential evolution to the NAS community. Using the simplest performance evaluation strategy of full evaluations, we comprehensively compare this search strategy to regularized evolution and Bayesian optimization and demonstrate that it yields improved and more robust results for 13 tabular NAS benchmarks based on NAS-Bench-101, NAS-Bench-1Shot1, NAS-Bench-201 and NAS-HPO bench.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Global optimization of graph acquisition functions for neural architecture search
LLINBO: Trustworthy LLM-in-the-Loop Bayesian Optimization
Reinforcement Learning Increases Wind Farm Power Production by Enabling Closed-Loop Collaborative Control
AnalogNAS-Bench: A NAS Benchmark for Analog In-Memory Computing
From Tiny Machine Learning to Tiny Deep Learning: A Survey
Fast Bayesian Optimization of Function Networks with Partial Evaluations
토론
이 논문과 연결된 포럼 글이 아직 없습니다.