Toward Optimal Run Racing: Application to Deep Learning Calibration
원문 초록
This paper aims at one-shot learning of deep neural nets, where a highly parallel setting is considered to address the algorithm calibration problem - selecting the best neural architecture and learning hyper-parameter values depending on the dataset at hand. The notoriously expensive calibration problem is optimally reduced by detecting and early stopping non-optimal runs. The theoretical contribution regards the optimality guarantees within the multiple hypothesis testing framework. Experimentations on the Cifar10, PTB and Wiki benchmarks demonstrate the relevance of the approach with a principled and consistent improvement on the state of the art with no extra hyper-parameter.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
PsyDT: Using LLMs to Construct the Digital Twin of Psychological Counselor with Personalized Counseling Style for Psychological Counseling
Fusion Matters: Learning Fusion in Deep Click-through Rate Prediction Models
Minimax Optimal Two-Sample Testing under Local Differential Privacy
Model Equality Testing: Which Model Is This API Serving?
General Frameworks for Conditional Two-Sample Testing
Supervised Learning without Backpropagation using Spike-Timing-Dependent Plasticity for Image Recognition
토론
이 논문과 연결된 포럼 글이 아직 없습니다.