The Exact Asymptotic Form of Bayesian Generalization Error in Latent Dirichlet Allocation
원문 초록
Latent Dirichlet allocation (LDA) obtains essential information from data by using Bayesian inference. It is applied to knowledge discovery via dimension reducing and clustering in many fields. However, its generalization error had not been yet clarified since it is a singular statistical model where there is no one-to-one mapping from parameters to probability distributions. In this paper, we give the exact asymptotic form of its generalization error and marginal likelihood, by theoretical analysis of its learning coefficient using algebraic geometry. The theoretical result shows that the Bayesian generalization error in LDA is expressed in terms of that in matrix factorization and a penalty from the simplex restriction of LDA's parameter region. A numerical experiment is consistent to the theoretical result.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Statistical Machine Learning for Astronomy -- A Textbook
Tri-Learn Graph Fusion Network for Attributed Graph Clustering
A Simple Approximate Bayesian Inference Neural Surrogate for Stochastic Petri Net Models
Car Object Counting and Position Estimation via Extension of the CLIP-EBC Framework
Scalable Bayesian Low-Rank Adaptation of Large Language Models via Stochastic Variational Subspace Inference
HERCULES: Hierarchical Embedding-based Recursive Clustering Using LLMs for Efficient Summarization
토론
이 논문과 연결된 포럼 글이 아직 없습니다.