liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Recursive Least Squares and Accelerated Convergence in Stochastic Approximation Schemes
Linköping University, Department of Electrical Engineering, Automatic Control. Linköping University, The Institute of Technology.
2000 (English)Report (Other academic)
Abstract [en]

The so-called accelerated convergence is an ingenuous idea to improve the asymptotic accuracy in stochastic approximation (gradient based) algorithms. The estimates obtained from the basic algorithm are subjected to a second round of averaging, which leads to optimal accuracy for estimates of time-invariant parameters. In this contribution, some simple calculations are used to get some intuitive insight into these mechanisms. Of particular interest is to investigate the properties of accelerated convergence schemes in tracking situations. It is shown that a second round of averaging leads to the recursive least-squares algorithm with a forgetting factor. This also means that in case the true parameters are changing as a random walk, accelerated convergence does not, typically, give optimal tracking properties.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2000. , 11 p.
Series
LiTH-ISY-R, ISSN 1400-3902 ; 2291
Keyword [en]
Stochastic approximation, Recursive estimation, Recursive least squares
National Category
Control Engineering
Identifiers
URN: urn:nbn:se:liu:diva-55752ISRN: LiTH-ISY-R-2291OAI: oai:DiVA.org:liu-55752DiVA: diva2:316581
Available from: 2010-04-30 Created: 2010-04-30 Last updated: 2014-09-05Bibliographically approved

Open Access in DiVA

fulltext(191 kB)95 downloads
File information
File name FULLTEXT01.pdfFile size 191 kBChecksum SHA-512
d97bcd855862af84808dcf8b4e9e54c32d878bcdae1d691731a727bb2bdef9b4abf7fb765543d0a5c04f4a861a43b584425ce0addb905cf8fe7a471dafecdbb3
Type fulltextMimetype application/pdf

Authority records BETA

Ljung, Lennart

Search in DiVA

By author/editor
Ljung, Lennart
By organisation
Automatic ControlThe Institute of Technology
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 95 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 70 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf