PubMed · 12125890
Optimal design of regularization term and regularization parameter by subspace information criterion.
Abstract
The problem of designing the regularization term and regularization parameter for linear regression models is discussed. Previously, we derived an approximation to the generalization error called the subspace information criterion (SIC), which is an unbiased estimator of the generalization error with finite samples under certain conditions. In this paper, we apply SIC to regularization learning and use it for: (a) choosing the optimal regularization term and regularization parameter from the given candidates; (b) obtaining the closed form of the optimal regularization parameter for a fixed regularization term. The effectiveness of SIC is demonstrated through computer simulations with artificial and real data.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Masashi Sugiyama, Hidemitsu Ogawa. 2002. Optimal design of regularization term and regularization parameter by subspace information criterion.. https://doi.org/10.1016/s0893-6080(02)00022-9. https://pubmed.health/record/pubmed%3A12125890/optimal-design-of-regularization-term-and-regularization-parameter-by-subspace-information-criterion
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite PubMed Health by Indiciae: BibTeX · RIS.