Unsupervised Learning with Truncated Gaussian Graphical Models
원문 초록
Gaussian graphical models (GGMs) are widely used for statistical modeling, because of ease of inference and the ubiquitous use of the normal distribution in practical approximations. However, they are also known for their limited modeling abilities, due to the Gaussian assumption. In this paper, we introduce a novel variant of GGMs, which relaxes the Gaussian restriction and yet admits efficient inference. Specifically, we impose a bipartite structure on the GGM and govern the hidden variables by truncated normal distributions. The nonlinearity of the model is revealed by its connection to rectified linear unit (ReLU) neural networks. Meanwhile, thanks to the bipartite structure and appealing properties of truncated normals, we are able to train the models efficiently using contrastive divergence. We consider three output constructs, accounting for real-valued, binary and count data. We further extend the model to deep constructions and show that deep models can be used for unsupervised pre-training of rectifier neural networks. Extensive experimental results are provided to validate the proposed models and demonstrate their superiority over competing models.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Models
SPACE: Your Genomic Profile Predictor is a Powerful DNA Foundation Model
ZS-VCOS: Zero-Shot Outperforms Supervised Video Camouflaged Object Segmentation
CrystalFormer-RL: Reinforcement Fine-Tuning for Materials Design
How much do LLMs learn from negative examples?
FSFM: A Generalizable Face Security Foundation Model via Self-Supervised Facial Representation Learning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.