PubMed · 15461082
Learning mixture models with the regularized latent maximum entropy principle.
Abstract
This paper presents a new approach to estimating mixture models based on a recent inference principle we have proposed: the latent maximum entropy principle (LME). LME is different from Jaynes' maximum entropy principle, standard maximum likelihood, and maximum aposteriori probability estimation. We demonstrate the LME principle by deriving new algorithms for mixture model estimation, and show how robust new variants of the expectation maximization (EM) algorithm can be developed. We show that a regularized version of LME (RLME), is effective at estimating mixture models. It generally yields better results than plain LME, which in turn is often better than maximum likelihood and maximum a posterior estimation, particularly when inferring latent variable models from small amounts of data.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Shaojun Wang, Dale Schuurmans, Fuchun Peng, Yunxin Zhao. 2004. Learning mixture models with the regularized latent maximum entropy principle.. https://doi.org/10.1109/tnn.2004.828755. https://pubmed.health/record/pubmed%3A15461082/learning-mixture-models-with-the-regularized-latent-maximum-entropy-principle
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite PubMed Health by Indiciae: BibTeX · RIS.