Parameter estimation and order selection for linear regressionproblems
2006 (English)In: Proc. of European Signal Processing Conference (EUSIPCO), Sept. 2006, 2006Conference paper (Refereed)
Parameter estimation and model order selection for linear regression models are two classical problems. In this article we derive the minimum mean-square error (MMSE) parameter estimate for a linear regressionmodel with unknown order. We call the so-obtained estimator the Bayesian Parameter estimation Method (BPM). We also derive the model order selection rule which maximizes the probability of selecting the correct model. The rule is denoted BOSS—Bayesian Order Selection Strategy. The estimators have several advantages: They satisfy certain optimality criteria, they are non-asymptotic and they have low computational complexity. We also derive “empirical Bayesian” versions of BPM and BOSS, which do not require any prior knowledge nor do they need the choice of any “user parameters”. We show that our estimators outperform several classical methods, including the AIC and BIC for orderselection.
Place, publisher, year, edition, pages
Engineering and Technology
IdentifiersURN: urn:nbn:se:liu:diva-77238OAI: oai:DiVA.org:liu-77238DiVA: diva2:525710
14th European Signal Processing Conference (EUSIPCO 2006), Florence, Italy, September 4-8, 2006