liu.seSök publikationer i DiVA
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
On asymptotic properties of hyperparameter estimators for kernel-based regularization methods
Linköpings universitet, Institutionen för systemteknik, Reglerteknik. Linköpings universitet, Tekniska fakulteten.
Chinese Univ Hong Kong, Peoples R China.
Linköpings universitet, Institutionen för systemteknik, Reglerteknik. Linköpings universitet, Tekniska fakulteten.
2018 (Engelska)Ingår i: Automatica, ISSN 0005-1098, E-ISSN 1873-2836, Vol. 94, s. 381-395Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

The kernel-based regularization method has two core issues: kernel design and hyperparameter estimation. In this paper, we focus on the second issue and study the properties of several hyperparameter estimators including the empirical Bayes (EB) estimator, two Steins unbiased risk estimators (SURE) (one related to impulse response reconstruction and the other related to output prediction) and their corresponding Oracle counterparts, with an emphasis on the asymptotic properties of these hyperparameter estimators. To this goal, we first derive and then rewrite the first order optimality conditions of these hyperparameter estimators, leading to several insights on these hyperparameter estimators. Then we show that as the number of data goes to infinity, the two SUREs converge to the best hyperparameter minimizing the corresponding mean square error, respectively, while the more widely used EB estimator converges to another best hyperparameter minimizing the expectation of the EB estimation criterion. This indicates that the two SUREs are asymptotically optimal in the corresponding MSE senses but the EB estimator is not. Surprisingly, the convergence rate of two SUREs is slower than that of the EB estimator, and moreover, unlike the two SUREs, the EB estimator is independent of the convergence rate of Phi(T)Phi/N to its limit, where Phi is the regression matrix and N is the number of data. A Monte Carlo simulation is provided to demonstrate the theoretical results. (C) 2018 Elsevier Ltd. All rights reserved.

Ort, förlag, år, upplaga, sidor
PERGAMON-ELSEVIER SCIENCE LTD , 2018. Vol. 94, s. 381-395
Nyckelord [en]
Kernel-based regularization; Empirical Bayes; Steins unbiased risk estimator; Asymptotic analysis
Nationell ämneskategori
Reglerteknik
Identifikatorer
URN: urn:nbn:se:liu:diva-149840DOI: 10.1016/j.automatica.2018.04.035ISI: 000437076500041OAI: oai:DiVA.org:liu-149840DiVA, id: diva2:1236457
Anmärkning

Funding Agencies|National Natural Science Foundation of China [61773329, 61603379]; central government of China; Shenzhen Science and Technology Innovation Council [Ji-20170189, Ji-20160207]; Chinese University of Hong Kong, Shenzhen [PF. 01.000249, 2014.0003.23]; Swedish Research Council [2014-5894]; National Key Basic Research Program of China (973 Program) [2014CB845301]; Presidential Fund of the Academy of Mathematics and Systems Science, CAS [2015-hwyxqnrc-mbq]

Tillgänglig från: 2018-08-02 Skapad: 2018-08-02 Senast uppdaterad: 2018-08-22

Open Access i DiVA

fulltext(545 kB)0 nedladdningar
Filinformation
Filnamn FULLTEXT01.pdfFilstorlek 545 kBChecksumma SHA-512
1a0ef1668620c713658819221f40d8f399530a5279b34d8c189486282bf4732937aa5406b539428d0687eb7384cef247c07aa54b607024ecfe0fa71e12cd0335
Typ fulltextMimetyp application/pdf

Övriga länkar

Förlagets fulltext

Personposter BETA

Mu, BiqiangLjung, Lennart

Sök vidare i DiVA

Av författaren/redaktören
Mu, BiqiangLjung, Lennart
Av organisationen
ReglerteknikTekniska fakulteten
I samma tidskrift
Automatica
Reglerteknik

Sök vidare utanför DiVA

GoogleGoogle Scholar
Antalet nedladdningar är summan av nedladdningar för alla fulltexter. Det kan inkludera t.ex tidigare versioner som nu inte längre är tillgängliga.

doi
urn-nbn

Altmetricpoäng

doi
urn-nbn
Totalt: 100 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf