Control of Overfitting with Physics
원문 초록
While there are many works on the applications of machine learning, not so many of them are trying to understand the theoretical justifications to explain their efficiency. In this work, overfitting control (or generalization property) in machine learning is explained using analogies from physics and biology. For stochastic gradient Langevin dynamics, we show that the Eyring formula of kinetic theory allows to control overfitting in the algorithmic stability approach - when wide minima of the risk function with low free energy correspond to low overfitting. For the generative adversarial network (GAN) model, we establish an analogy between GAN and the predator-prey model in biology. An application of this analogy allows us to explain the selection of wide likelihood maxima and overfitting reduction for GANs.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Generative Latent Kernel Modeling for Blind Motion Deblurring
ReflectGAN: Modeling Vegetation Effects for Soil Carbon Estimation from Satellite Imagery
ROIsGAN: A Region Guided Generative Adversarial Framework for Murine Hippocampal Subregion Segmentation
Unsupervised Raindrop Removal from a Single Image using Conditional Diffusion Models
DeeCLIP: A Robust and Generalizable Transformer-Based Framework for Detecting AI-Generated Images
Performance of Machine Learning Classifiers for Anomaly Detection in Cyber Security Applications
토론
이 논문과 연결된 포럼 글이 아직 없습니다.