Elastic-Net Regularization in Learning Theory

Simple item page
dc.creatorDe Mol, C.
dc.creatorDe Vito, E.
dc.creatorRosasco, L.
dc.date2008-07-22
dc.date.accessioned2026-07-07T09:52:04Z
dc.date.available2026-07-07T09:52:04Z
dc.descriptionWithin the framework of statistical learning theory we analyze in detail the so-called elastic-net regularization scheme proposed by Zou and Hastie for the selection of groups of correlated variables. To investigate on the statistical properties of this scheme and in particular on its consistency properties, we set up a suitable mathematical framework. Our setting is random-design regression where we allow the response variable to be vector-valued and we consider prediction functions which are linear combination of elements ({\em features}) in an infinite-dimensional dictionary. Under the assumption that the regression function admits a sparse representation on the dictionary, we prove that there exists a particular ``{\em elastic-net representation}'' of the regression function such that, if the number of data increases, the elastic-net estimator is consistent not only for prediction but also for variable/feature selection. Our results include finite-sample bounds and an adaptive scheme to select the regularization parameter. Moreover, using convex analysis tools, we derive an iterative thresholding algorithm for computing the elastic-net solution which is different from the optimization procedure originally proposed by Zou and Hastie
dc.description32 pages, 3 figures
dc.identifierhttps://arxiv.org/abs/0807.3423
dc.identifierhttp://arxiv.org/abs/0807.3423
dc.identifier.urihttp://salesiana.dossiersoluciones.com/handle/123456789/165462
dc.subjectMachine Learning
dc.subjectStatistics Theory
dc.subject62G08 (Primary) 62C20, 62G05, 62G20 (Secondary)
dc.titleElastic-Net Regularization in Learning Theory
dc.typetext

Files

Collections

arXiv