liu.seSök publikationer i DiVA
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Analytical Approximations for Bayesian Inference
Linköpings universitet, Institutionen för systemteknik, Reglerteknik. Linköpings universitet, Tekniska fakulteten. (Automatic Control)
2015 (Engelska)Doktorsavhandling, sammanläggning (Övrigt vetenskapligt)
Abstract [en]

Bayesian inference is a statistical inference technique in which Bayes’ theorem is used to update the probability distribution of a random variable using observations. Except for few simple cases, expression of such probability distributions using compact analytical expressions is infeasible. Approximation methods are required to express the a priori knowledge about a random variable in form of prior distributions. Further approximations are needed to compute posterior distributions of the random variables using the observations. When the computational complexity of representation of such posteriors increases over time as in mixture models, approximations are required to reduce the complexity of such representations.

This thesis further extends existing approximation methods for Bayesian inference, and generalizes the existing approximation methods in three aspects namely; prior selection, posterior evaluation given the observations and maintenance of computation complexity.

Particularly, the maximum entropy properties of the first-order stable spline kernel for identification of linear time-invariant stable and causal systems are shown. Analytical approximations are used to express the prior knowledge about the properties of the impulse response of a linear time-invariant stable and causal system.

Variational Bayes (VB) method is used to compute an approximate posterior in two inference problems. In the first problem, an approximate posterior for the state smoothing problem for linear statespace models with unknown and time-varying noise covariances is proposed. In the second problem, the VB method is used for approximate inference in state-space models with skewed measurement noise.

Moreover, a novel approximation method for Bayesian inference is proposed. The proposed Bayesian inference technique is based on Taylor series approximation of the logarithm of the likelihood function. The proposed approximation is devised for the case where the prior distribution belongs to the exponential family of distributions.

Finally, two contributions are dedicated to the mixture reduction (MR) problem. The first contribution, generalize the existing MR algorithms for Gaussian mixtures to the exponential family of distributions and compares them in an extended target tracking scenario. The second contribution, proposes a new Gaussian mixture reduction algorithm which minimizes the reverse Kullback-Leibler divergence and has specific peak preserving properties.

Ort, förlag, år, upplaga, sidor
Linköping: Linköping University Electronic Press, 2015. , s. 79
Serie
Linköping Studies in Science and Technology. Dissertations, ISSN 0345-7524 ; 1710
Nationell ämneskategori
Signalbehandling
Identifikatorer
URN: urn:nbn:se:liu:diva-121619DOI: 10.3384/diss.diva-121619ISBN: 978-91-7685-930-8 (tryckt)OAI: oai:DiVA.org:liu-121619DiVA, id: diva2:858322
Disputation
2015-11-06, Visionen, B-huset, Campus Valla, Linköping, 10:15 (Engelska)
Opponent
Handledare
Tillgänglig från: 2015-10-05 Skapad: 2015-09-28 Senast uppdaterad: 2019-11-15Bibliografiskt granskad
Delarbeten
1. Maximum entropy properties of discrete-time first-order stable spline kernel
Öppna denna publikation i ny flik eller fönster >>Maximum entropy properties of discrete-time first-order stable spline kernel
Visa övriga...
2016 (Engelska)Ingår i: Automatica, ISSN 0005-1098, E-ISSN 1873-2836, Vol. 66, s. 34-38Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

The first order stable spline (SS-1) kernel (also known as the tunedcorrelated kernel) is used extensively in regularized system identification, where the impulse response is modeled as a zero-mean Gaussian process whose covariance function is given by well designed and tuned kernels. In this paper, we discuss the maximum entropy properties of this kernel. In particular, we formulate the exact maximum entropy problem solved by the SS-1 kernel without Gaussian and uniform sampling assumptions. Under general sampling assumption, we also derive the special structure of the SS-1 kernel (e.g. its tridiagonal inverse and factorization have closed form expression), also giving to it a maximum entropy covariance completion interpretation.

Nyckelord
System identification;Regularization method;Kernel structure;Maximum entropy
Nationell ämneskategori
Signalbehandling
Identifikatorer
urn:nbn:se:liu:diva-121618 (URN)10.1016/j.automatica.2015.12.009 (DOI)
Tillgänglig från: 2015-09-28 Skapad: 2015-09-28 Senast uppdaterad: 2024-01-08Bibliografiskt granskad
2. Approximate Bayesian Smoothing with Unknown Process and Measurement Noise Covariances
Öppna denna publikation i ny flik eller fönster >>Approximate Bayesian Smoothing with Unknown Process and Measurement Noise Covariances
2015 (Engelska)Ingår i: IEEE Signal Processing Letters, ISSN 1070-9908, E-ISSN 1558-2361, Vol. 22, nr 12, s. 2450-2454Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

We present an adaptive smoother for linear state-space models with unknown process and measurement noise covariances. The proposed method utilizes the variational Bayes technique to perform approximate inference. The resulting smoother is computationally efficient, easy to implement, and can be applied to high dimensional linear systems. The performance of the algorithm is illustrated on a target tracking example.

Ort, förlag, år, upplaga, sidor
Institute of Electrical and Electronics Engineers (IEEE), 2015
Nyckelord
Adaptive smoothing, Kalman filtering, noise covariance, Rauch-Tung-Striebel smoother, sensor calibration, time-varying noiseco variances, variational Bayes
Nationell ämneskategori
Signalbehandling
Identifikatorer
urn:nbn:se:liu:diva-121617 (URN)10.1109/LSP.2015.2490543 (DOI)000364207300007 ()
Anmärkning

At the time for thesis presentation publication was in status: Manuscript

Tillgänglig från: 2015-09-28 Skapad: 2015-09-28 Senast uppdaterad: 2018-03-09Bibliografiskt granskad
3. Robust Inference for State-Space Models with Skewed Measurement Noise
Öppna denna publikation i ny flik eller fönster >>Robust Inference for State-Space Models with Skewed Measurement Noise
2015 (Engelska)Ingår i: IEEE Signal Processing Letters, ISSN 1070-9908, E-ISSN 1558-2361, Vol. 22, nr 11, s. 1898-1902Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

Filtering and smoothing algorithms for linear discrete-time state-space models with skewed and heavy-tailed measurement noise are presented. The algorithms use a variational Bayes approximation of the posterior distribution of models that have normal prior and skew-t-distributed measurement noise. The proposed filter and smoother are compared with conventional low-complexity alternatives in a simulated pseudorange positioning scenario. In the simulations the proposed methods achieve better accuracy than the alternative methods, the computational complexity of the filter being roughly 5 to 10 times that of the Kalman filter.

Ort, förlag, år, upplaga, sidor
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 2015
Nyckelord
Kalman filter; robust filtering; RTS smoother; skew t; skewness; t-distribution; variational Bayes
Nationell ämneskategori
Elektroteknik och elektronik
Identifikatorer
urn:nbn:se:liu:diva-120129 (URN)10.1109/LSP.2015.2437456 (DOI)000356458700003 ()
Anmärkning

Funding Agencies|Tampere University of Technology Graduate School; Finnish Doctoral Programme in Computational Sciences (FICS); Foundation of Nokia Corporation; Swedish research council (VR), project ETT [621-2010-4301]

Tillgänglig från: 2015-07-14 Skapad: 2015-07-13 Senast uppdaterad: 2017-12-04
4. Bayesian Inference via Approximation of Log-likelihood for Priors in Exponential Family
Öppna denna publikation i ny flik eller fönster >>Bayesian Inference via Approximation of Log-likelihood for Priors in Exponential Family
(Engelska)Manuskript (preprint) (Övrigt vetenskapligt)
Abstract [en]

In this paper, a Bayesian inference technique based on Taylor series approximation of the logarithm of the likelihood function is presented. The proposed approximation is devised for the case where the prior distribution belongs to the exponential family of distributions. The logarithm of the likelihood function is linearized with respect to the sufficient statistic of the prior distribution in exponential family such that the posterior obtains the same exponential family form as the prior. Similarities between the proposed method and the extended Kalman filter for nonlinear filtering are illustrated. Further, an extended target measurement update for target models where the target extent is represented by a random matrix having an inverse Wishart distribution is derived. The approximate update covers the important case where the spread of measurement is due to the target extent as well as the measurement noise in the sensor.

Nationell ämneskategori
Signalbehandling
Identifikatorer
urn:nbn:se:liu:diva-121616 (URN)
Tillgänglig från: 2015-09-28 Skapad: 2015-09-28 Senast uppdaterad: 2015-10-05Bibliografiskt granskad
5. Greedy Reduction Algorithms for Mixtures of Exponential Family
Öppna denna publikation i ny flik eller fönster >>Greedy Reduction Algorithms for Mixtures of Exponential Family
2015 (Engelska)Ingår i: IEEE Signal Processing Letters, ISSN 1070-9908, E-ISSN 1558-2361, Vol. 22, nr 6, s. 676-680Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

In this letter, we propose a general framework for greedy reduction of mixture densities of exponential family. The performances of the generalized algorithms are illustrated both on an artificial example where randomly generated mixture densities are reduced and on a target tracking scenario where the reduction is carried out in the recursion of a Gaussian inverse Wishart probability hypothesis density (PHD) filter.

Ort, förlag, år, upplaga, sidor
Institute of Electrical and Electronics Engineers (IEEE), 2015
Nyckelord
Exponential family; extended target; integral square error; Kullback-Leibler divergence; mixture density; mixture reduction; target tracking
Nationell ämneskategori
Elektroteknik och elektronik
Identifikatorer
urn:nbn:se:liu:diva-112990 (URN)10.1109/LSP.2014.2367154 (DOI)000345236400005 ()
Anmärkning

Funding Agencies|Swedish research council (VR) under ETT [621-2010-4301]; SSF, project CUAS

Tillgänglig från: 2015-01-12 Skapad: 2015-01-08 Senast uppdaterad: 2017-12-05
6. Gaussian Mixture Reduction Using Reverse Kullback-Leibler Divergence
Öppna denna publikation i ny flik eller fönster >>Gaussian Mixture Reduction Using Reverse Kullback-Leibler Divergence
(Engelska)Manuskript (preprint) (Övrigt vetenskapligt)
Nationell ämneskategori
Signalbehandling
Identifikatorer
urn:nbn:se:liu:diva-121615 (URN)
Tillgänglig från: 2015-09-28 Skapad: 2015-09-28 Senast uppdaterad: 2015-10-05

Open Access i DiVA

fulltext(1512 kB)2942 nedladdningar
Filinformation
Filnamn FULLTEXT02.pdfFilstorlek 1512 kBChecksumma SHA-512
54a0ea628714bdf8e10a377cf31ce51a436522e4d528ccc66979b5a5f7b19560f1524e86219f2ff2b35c0279b21312af0877da113be446df56bcbfd1d01740d8
Typ fulltextMimetyp application/pdf
omslag(21 kB)151 nedladdningar
Filinformation
Filnamn COVER01.pdfFilstorlek 21 kBChecksumma SHA-512
3b46b7f76dd8be8a1335d98bd8efe9de8061c54eeb5d1e6bf40b4cfebb9470c8e40b35f6cb9fac13a1689c21cefcb54b9406a788d43b0bbbe3bb1471eec0e62a
Typ coverMimetyp application/pdf
Beställ online >>

Övriga länkar

Förlagets fulltext

Person

Ardeshiri, Tohid

Sök vidare i DiVA

Av författaren/redaktören
Ardeshiri, Tohid
Av organisationen
ReglerteknikTekniska fakulteten
Signalbehandling

Sök vidare utanför DiVA

GoogleGoogle Scholar
Totalt: 2973 nedladdningar
Antalet nedladdningar är summan av nedladdningar för alla fulltexter. Det kan inkludera t.ex tidigare versioner som nu inte längre är tillgängliga.

doi
isbn
urn-nbn

Altmetricpoäng

doi
isbn
urn-nbn
Totalt: 5912 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf