liu.seSearch for publications in DiVA
Change search
ReferencesLink to record
Permanent link

Direct link
Projection Techniques for Classification and Identification
Linköping University, Department of Electrical Engineering, Automatic Control. Linköping University, The Institute of Technology.
2005 (English)Doctoral thesis, monograph (Other academic)
Abstract [en]

It is very well understood how to evaluate and find, in different senses, optimal linear projections of measurements on linear systems. The solution to the linear least squares problem, the principal component analysis and partial least squares are all examples of well known techniques that work very well as long as the dependencies in data are fairly linear. When the measurements are due to nonlinear systems or due to measurements on a finite number of objects (classification), it is much more difficult not only to find an optimal projection, but also to asses a general quality measure to a particular projection. The dimension of the measurement is often high, so the search for projections is motivated by the desire to visualize in 2-dimensional diagrams, the need to reduce data with minimal loss (data compression) and to efficiently parameterize nonlinear models.

For classication of measurements on a finite number of objects, the projection quality is naturally connected to how accurate the classification can be conducted despite the data reduction due to the projection. In this work, methods to estimate this accuracy as well as numerical methods to find the optimal projection with respect to this estimated accuracy are investigated. It is found that the nonlinear conjugate gradient method on the Grassmann manifold is one of the most time efficient numerical optimization methods to use with this type of problems.

For nonlinear dynamical systems modeled by nonlinear ARX model structures, the challenge is to find projections of the regression vector that isolate a nonlinear curve or surface. It is not obvious that such low-dimensional projections that well fit the system always exist. When they do exist, for instance when the nonlinearities enter the system additively, we show that the projection can rather efficiently be estimated by using multi-index models fitted by least squares criteria.

There is also an interesting hybrid case where a continuous system is analyzed by measurements on a nite number of calibration classes. We show how the resulting measurement classes can be used by techniques borrowed from discriminant analysis in order to find good projections where a continuous regression can be performed.

Place, publisher, year, edition, pages
Linköping: Linköping University , 2005. , 189 p.
Linköping Studies in Science and Technology. Dissertations, ISSN 0345-7524 ; 915
National Category
Control Engineering
URN: urn:nbn:se:liu:diva-98176ISBN: 91-85297-06-2OAI: diva2:652388
Public defence
2005-01-21, Visionen, Hus B, Campus Valla, Linköpings universitet, Linköping, 10:15 (English)
Swedish Research CouncilSwedish Foundation for Strategic Research
Available from: 2013-10-09 Created: 2013-09-30 Last updated: 2013-10-09Bibliographically approved

Open Access in DiVA

No full text

Search in DiVA

By author/editor
Lindgren, David
By organisation
Automatic ControlThe Institute of Technology
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 79 hits
ReferencesLink to record
Permanent link

Direct link