Manifold Optimization for Gaussian Mixture Models
원문 초록
We take a new look at parameter estimation for Gaussian Mixture Models (GMMs). In particular, we propose using \emph{Riemannian manifold optimization} as a powerful counterpart to Expectation Maximization (EM). An out-of-the-box invocation of manifold optimization, however, fails spectacularly: it converges to the same solution but vastly slower. Driven by intuition from manifold convexity, we then propose a reparamerization that has remarkable empirical consequences. It makes manifold optimization not only match EM---a highly encouraging result in itself given the poor record nonlinear programming methods have had against EM so far---but also outperform EM in many practical settings, while displaying much less variability in running times. We further highlight the strengths of manifold optimization by developing a somewhat tuned manifold LBFGS method that proves even more competitive and reliable than existing manifold optimization tools. We hope that our results encourage a wider consideration of manifold optimization for parameter estimation problems.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
TabPFN: One Model to Rule Them All?
Transfer learning for multifidelity simulation-based inference in cosmology
Data-driven multi-agent modelling of calcium interactions in cell culture: PINN vs Regularized Least-squares
DDPM Score Matching and Distribution Learning
Squared families: Searching beyond regular probability models
A New Stochastic Approximation Method for Gradient-based Simulated Parameter Estimation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.