PubMed · 9804672
Information maximization and independent component analysis; is there a difference?
Abstract
This article provides a detailed and rigorous analysis of the two commonly used methods for redundancy reduction: linear independent component analysis (ICA) posed as a direct minimization of a suitably chosen redundancy measure and information maximization (InfoMax) of a continuous stochastic signal transmitted through an appropriate nonlinear network. The article shows analytically that ICA based on the Kullback-Leibler information as a redundancy measure and InfoMax lead to the same solution if the parameterization of the output nonlinear functions in the latter method is sufficiently rich. Furthermore, this work discusses the alternative redundancy measures not based on the Kullback-Leibler information distance. The practical issues of applying ICA and InfoMax are also discussed and illustrated on the problem of extracting statistically independent factors from a linear, pixel-by-pixel mixture of images.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
D Obradovic, G Deco. 1998-11-15. Information maximization and independent component analysis; is there a difference?. https://doi.org/10.1162/089976698300016972. https://pubmed.health/record/pubmed%3A9804672/information-maximization-and-independent-component-analysis-is-there-a-difference
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite PubMed Health by Indiciae: BibTeX · RIS.