Quasi-Monte Carlo sampling for machine-learning partial differential equations
원문 초록
Solving partial differential equations in high dimensions by deep neural network has brought significant attentions in recent years. In many scenarios, the loss function is defined as an integral over a high-dimensional domain. Monte-Carlo method, together with the deep neural network, is used to overcome the curse of dimensionality, while classical methods fail. Often, a deep neural network outperforms classical numerical methods in terms of both accuracy and efficiency. In this paper, we propose to use quasi-Monte Carlo sampling, instead of Monte-Carlo method to approximate the loss function. To demonstrate the idea, we conduct numerical experiments in the framework of deep Ritz method proposed by Weinan E and Bing Yu. For the same accuracy requirement, it is observed that quasi-Monte Carlo sampling reduces the size of training data set by more than two orders of magnitude compared to that of MC method. Under some assumptions, we prove that quasi-Monte Carlo sampling together with the deep neural network generates a convergent series with rate proportional to the approximation accuracy of quasi-Monte Carlo method for numerical integration. Numerically the fitted convergence rate is a bit smaller, but the proposed approach always outperforms Monte Carlo method. It is worth mentioning that the convergence analysis is generic whenever a loss function is approximated by the quasi-Monte Carlo method, although observations here are based on deep Ritz method.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
How Far Are We from Optimal Reasoning Efficiency?
A Dictionary of Closed-Form Kernel Mean Embeddings
Force-Free Molecular Dynamics Through Autoregressive Equivariant Networks
Underdamped Diffusion Bridges with Applications to Sampling
Provable Quantum Algorithm Advantage for Gaussian Process Quadrature
FNIN: A Fourier Neural Operator-based Numerical Integration Network for Surface-form-gradients
토론
이 논문과 연결된 포럼 글이 아직 없습니다.