Show simple item record

Neural Computation

dc.contributor.authorVijayakumar, Sethuen
dc.contributor.authorD'Souza, Aaronen
dc.contributor.authorSchaal, Stefanen
dc.date.accessioned2010-08-31T14:10:28Z
dc.date.available2010-08-31T14:10:28Z
dc.date.issued2005-06
dc.identifier.other0284
dc.identifier.urihttp://hdl.handle.net/1842/3705
dc.description.abstractLocally weighted projection regression (LWPR) is a new algorithm for incremental nonlinear func- tion approximation in high dimensional spaces with redundant and irrelevant input dimensions. At its core, it employs nonparametric regression with locally linear models. In order to stay computa- tionally efficient and numerically robust, each local model performs the regression analysis with a small number of univariate regressions in selected directions in input space in the spirit of partial least squares regression. We discuss when and how local learning techniques can successfully work in high dimensional spaces and compare various techniques for local dimensionality reduction before finally deriving the LWPR algorithm. The properties of LWPR are that it i) learns rapidly with second order learning methods based on incremental training, ii) uses statistically sound stochastic leave-one-out cross validation for learning without the need to memorize training data, iii) adjusts its weighting kernels based only on local information in order to minimize the danger of negative interference of incremental learning, iv) has a computational complexity that is linear in the num- ber of inputs, and v) can deal with a large number of - possibly redundant - inputs, as shown in various empirical evaluations with up to 50 dimensional data sets. For a probabilistic interpreta- tion, predictive variance and confidence intervals are derived. To our knowledge, LWPR is the first truly incremental spatially localized learning method that can successfully and efficiently operate in very high dimensional spaces.en
dc.relation.ispartofseriesInformatics Report Series
dc.relation.ispartofseriesEDI-INF-RR-0284
dc.subjectIncremental learningen
dc.titleLWPR: A Scalable Method for Incremental Online Learning in High Dimensionsen
dc.typeArticleen
rps.titleNeural Computationen
dc.date.updated2010-08-31T14:10:28Z


Files in this item

This item appears in the following Collection(s)

Show simple item record