Aspects on Accelerated Convergence in Stochastic Approximation Schemes
1994 (English)Report (Other academic)
So called accelerated convergence is an ingenuous idea to improve the asymptotic accuracy in stochastic approximation (gradient based) algorithms. The estimates obtained from the basic algorithm are subjected to a second round of averaging, which leads to optimal accuracy for estimates of time-invariant parameters. In this contribution some simple and approximate calculations are used to get some intuitive insight into these mechanisms. Of particular interest is to investigate the properties of accelerated convergence schemes in tracking situations.
Place, publisher, year, edition, pages
Linköping: Linköping University , 1994. , 9 p.
LiTH-ISY-R, ISSN 1400-3902 ; 1663
IdentifiersURN: urn:nbn:se:liu:diva-55129ISRN: LITH-ISY-R-1663OAI: oai:DiVA.org:liu-55129DiVA: diva2:315720