liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Overtraining, Regularization and Searching for Minimum in Neural Networks
Linköping University, Department of Electrical Engineering, Automatic Control. Linköping University, The Institute of Technology.
Linköping University, Department of Electrical Engineering, Automatic Control. Linköping University, The Institute of Technology.
1992 (English)In: 4th IFAC Symposium on Adaptive Systems in Control and Signal Processing, 1992, 669-674 p.Conference paper, Published paper (Refereed)
Abstract [en]

Neural network models for dynamical systems have been subject of considerable interest lately. They are often characterized by the fact that they use a fairly large amount of parameters. Here we address the problem why this can be done without the usual penalty in terms of a large variance error. We show that reguralization is a key explanation, and that terminating a gradient search ("backpropagation") before the true criterion minimum is found is a way of achieving regularization. This, among other things, also explains the concept of "overtraining" in neural nets.

Place, publisher, year, edition, pages
1992. 669-674 p.
Keyword [en]
Neural network models, Dynamical systems, Parameters, Variance error, Regularization
National Category
Control Engineering
Identifiers
URN: urn:nbn:se:liu:diva-91677ISBN: 978-0080425962 (print)OAI: oai:DiVA.org:liu-91677DiVA: diva2:618458
Conference
4th IFAC Symposium on Adaptive Systems in Control and Signal Proccesing, Grenoble, France, July, 1992
Available from: 2013-04-28 Created: 2013-04-28 Last updated: 2013-07-29

Open Access in DiVA

No full text

Other links

Related report

Authority records BETA

Ljung, Lennart

Search in DiVA

By author/editor
Ljung, Lennart
By organisation
Automatic ControlThe Institute of Technology
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 31 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf