Consistent estimation of the architecture of multilayer perceptrons

dc.creatorRynkiewicz, Joseph
dc.date2008-02-22
dc.date.accessioned2026-07-07T09:22:47Z
dc.date.available2026-07-07T09:22:47Z
dc.descriptionWe consider regression models involving multilayer perceptrons (MLP) with one hidden layer and a Gaussian noise. The estimation of the parameters of the MLP can be done by maximizing the likelihood of the model. In this framework, it is difficult to determine the true number of hidden units using an information criterion, like the Bayesian information criteria (BIC), because the information matrix of Fisher is not invertible if the number of hidden units is overestimated. Indeed, the classical theoretical justification of information criteria relies entirely on the invertibility of this matrix. However, using recent methodology introduced to deal with models with a loss of identifiability, we prove that suitable information criterion leads to consistent estimation of the true number of hidden units.
dc.identifierhttps://arxiv.org/abs/0802.3327
dc.identifierhttp://arxiv.org/abs/0802.3327
dc.identifierDans ESANN 2006 - ESANN 2006, Bruges : Belgique (2006)
dc.identifier.urihttp://salesiana.dossiersoluciones.com/handle/123456789/155498
dc.subjectStatistics Theory
dc.titleConsistent estimation of the architecture of multilayer perceptrons
dc.typetext

Files

Collections