Regularized Estimation and Feature Selection in Mixtures of Gaussian-Gated Experts Models
원문 초록
Mixtures-of-Experts models and their maximum likelihood estimation (MLE) via the EM algorithm have been thoroughly studied in the statistics and machine learning literature. They are subject of a growing investigation in the context of modeling with high-dimensional predictors with regularized MLE. We examine MoE with Gaussian gating network, for clustering and regression, and propose an $\ell_1$-regularized MLE to encourage sparse models and deal with the high-dimensional setting. We develop an EM-Lasso algorithm to perform parameter estimation and utilize a BIC-like criterion to select the model parameters, including the sparsity tuning hyperparameters. Experiments conducted on simulated data show the good performance of the proposed regularized MLE compared to the standard MLE with the EM algorithm.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Deep sparse multi-task learning for feature selection in Alzheimer’s disease diagnosis
An Interpretable Adaptive Multiscale Attention Deep Neural Network for Tabular Data
Prediction of Chronic Kidney Disease - A Machine Learning Perspective
Single-Document Summarization Using Sentence Embeddings and K-Means Clustering
Fast Adaptive K-Means Subspace Clustering for High-Dimensional Data
Face alignment by explicit shape regression
토론
이 논문과 연결된 포럼 글이 아직 없습니다.