Targeting Bayes factors with direct-path non-equilibrium thermodynamic integration
원문 초록
Thermodynamic integration (TI) for computing marginal likelihoods is based on an inverse annealing path from the prior to the posterior distribution. In many cases, the resulting estimator suffers from high variability, which particularly stems from the prior regime. When comparing complex models with differences in a comparatively small number of parameters, intrinsic errors from sampling fluctuations may outweigh the differences in the log marginal likelihood estimates. In the present article, we propose a thermodynamic integration scheme that directly targets the log Bayes factor. The method is based on a modified annealing path between the posterior distributions of the two models compared, which systematically avoids the high variance prior regime. We combine this scheme with the concept of non-equilibrium TI to minimise discretisation errors from numerical integration. Results obtained on Bayesian regression models applied to standard benchmark data, and a complex hierarchical model applied to biopathway inference, demonstrate a significant reduction in estimator variance over state-of-the-art TI methods.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
How Far Are We from Optimal Reasoning Efficiency?
A Dictionary of Closed-Form Kernel Mean Embeddings
Force-Free Molecular Dynamics Through Autoregressive Equivariant Networks
Underdamped Diffusion Bridges with Applications to Sampling
Provable Quantum Algorithm Advantage for Gaussian Process Quadrature
FNIN: A Fourier Neural Operator-based Numerical Integration Network for Surface-form-gradients
토론
이 논문과 연결된 포럼 글이 아직 없습니다.