liu.seSearch for publications in DiVA
Change search
ReferencesLink to record
Permanent link

Direct link
Regressor and Structure Selection: Uses of ANOVA in System Identification
Linköping University, Department of Electrical Engineering, Automatic Control. Linköping University, The Institute of Technology.
2006 (English)Doctoral thesis, monograph (Other academic)
Abstract [en]

Identification of nonlinear dynamical models of a black box nature involves both structure decisions (i.e., which regressors to use and the selection of a regressor function), and the estimation of the parameters involved. The typical approach in system identification is often a mix of all these steps, which for example means that the selection of regressors is based on the fits that is achieved for different choices. Alternatively one could then interpret the regressor selection as based on hypothesis tests (F-tests) at a certain confidence level that depends on the data. It would in many cases be desirable to decide which regressors to use, independently of the other steps. A survey of regressor selection methods used for linear regression and nonlinear identification problems is given.

In this thesis we investigate what the well known method of analysis of variance (ANOVA) can offer for this problem. System identification applications violate many of the ideal conditions for which ANOVA was designed and we study how the method performs under such non-ideal conditions. It turns out that ANOVA gives better and more homogeneous results compared to several other regressor selection methods. Some practical aspects are discussed, especially how to categorise the data set for the use of ANOVA, and whether to balance the data set used for structure identification or not.

An ANOVA-based method, Test of Interactions using Layout for Intermixed ANOVA (TILIA), for regressor selection in typical system identification problems with many candidate regressors is developed and tested with good performance on a variety of simulated and measured data sets.

Typical system identification applications of ANOVA, such as guiding the choice of linear terms in the regression vector and the choice of regime variables in local linear models, are investigated.

It is also shown that the ANOVA problem can be recast as an optimisation problem. Two modified, convex versions of the ANOVA optimisation problem are then proposed, and it turns out that they are closely related to the nn-garrote and wavelet shrinkage methods, respectively. In the case of balanced data, it is also shown that the methods have a nice orthogonality property in the sense that different groups of parameters can be computed independently.

Place, publisher, year, edition, pages
Institutionen för systemteknik , 2006. , 185 p.
Linköping Studies in Science and Technology. Dissertations, ISSN 0345-7524 ; 1012
Keyword [en]
System identification, Regressor selection, Analysis of variance, Nonlinear systems, Structure selection
National Category
Control Engineering
URN: urn:nbn:se:liu:diva-7000ISBN: 91-85523-98-4OAI: diva2:22085
Public defence
2006-05-12, Visionen, Hus B, Campus Valla, Linköpings universitet, Linköping, 10:15 (English)
Available from: 2006-06-26 Created: 2006-06-26 Last updated: 2009-03-05

Open Access in DiVA

fulltext(2281 kB)1289 downloads
File information
File name FULLTEXT01.pdfFile size 2281 kBChecksum SHA-1
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Lind, Ingela
By organisation
Automatic ControlThe Institute of Technology
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 1289 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 1959 hits
ReferencesLink to record
Permanent link

Direct link