Adaptive Sequential Optimization with Applications to Machine Learning
원문 초록
A framework is introduced for solving a sequence of slowly changing optimization problems, including those arising in regression and classification applications, using optimization algorithms such as stochastic gradient descent (SGD). The optimization problems change slowly in the sense that the minimizers change at either a fixed or bounded rate. A method based on estimates of the change in the minimizers and properties of the optimization algorithm is introduced for adaptively selecting the number of samples needed from the distributions underlying each problem in order to ensure that the excess risk, i.e., the expected gap between the loss achieved by the approximate minimizer produced by the optimization algorithm and the exact minimizer, does not exceed a target level. Experiments with synthetic and real data are used to confirm that this approach performs well.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Performing Image Classification for 10 Different Monkey Species using CNN
Statistical characterization and classification of colon microarray gene expression data using multiple machine learning paradigms
Enhanced network anomaly detection based on deep neural networks
ExploreKit: Automatic Feature Generation and Selection
Thumbs up? Sentiment Classification using Machine Learning Techniques
Using Instruction-Tuned Large Language Models to Identify Indicators of Vulnerability in Police Incident Narratives
토론
이 논문과 연결된 포럼 글이 아직 없습니다.