liu.seSearch for publications in DiVA
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Analytical Approximations for Bayesian Inference
Linköpings universitet, Institutionen för systemteknik, Reglerteknik. Linköpings universitet, Tekniska fakulteten. (Automatic Control)
2015 (engelsk)Doktoravhandling, med artikler (Annet vitenskapelig)
Abstract [en]

Bayesian inference is a statistical inference technique in which Bayes’ theorem is used to update the probability distribution of a random variable using observations. Except for few simple cases, expression of such probability distributions using compact analytical expressions is infeasible. Approximation methods are required to express the a priori knowledge about a random variable in form of prior distributions. Further approximations are needed to compute posterior distributions of the random variables using the observations. When the computational complexity of representation of such posteriors increases over time as in mixture models, approximations are required to reduce the complexity of such representations.

This thesis further extends existing approximation methods for Bayesian inference, and generalizes the existing approximation methods in three aspects namely; prior selection, posterior evaluation given the observations and maintenance of computation complexity.

Particularly, the maximum entropy properties of the first-order stable spline kernel for identification of linear time-invariant stable and causal systems are shown. Analytical approximations are used to express the prior knowledge about the properties of the impulse response of a linear time-invariant stable and causal system.

Variational Bayes (VB) method is used to compute an approximate posterior in two inference problems. In the first problem, an approximate posterior for the state smoothing problem for linear statespace models with unknown and time-varying noise covariances is proposed. In the second problem, the VB method is used for approximate inference in state-space models with skewed measurement noise.

Moreover, a novel approximation method for Bayesian inference is proposed. The proposed Bayesian inference technique is based on Taylor series approximation of the logarithm of the likelihood function. The proposed approximation is devised for the case where the prior distribution belongs to the exponential family of distributions.

Finally, two contributions are dedicated to the mixture reduction (MR) problem. The first contribution, generalize the existing MR algorithms for Gaussian mixtures to the exponential family of distributions and compares them in an extended target tracking scenario. The second contribution, proposes a new Gaussian mixture reduction algorithm which minimizes the reverse Kullback-Leibler divergence and has specific peak preserving properties.

sted, utgiver, år, opplag, sider
Linköping: Linköping University Electronic Press, 2015. , s. 79
Serie
Linköping Studies in Science and Technology. Dissertations, ISSN 0345-7524 ; 1710
HSV kategori
Identifikatorer
URN: urn:nbn:se:liu:diva-121619DOI: 10.3384/diss.diva-121619ISBN: 978-91-7685-930-8 (tryckt)OAI: oai:DiVA.org:liu-121619DiVA, id: diva2:858322
Disputas
2015-11-06, Visionen, B-huset, Campus Valla, Linköping, 10:15 (engelsk)
Opponent
Veileder
Tilgjengelig fra: 2015-10-05 Laget: 2015-09-28 Sist oppdatert: 2019-11-15bibliografisk kontrollert
Delarbeid
1. Maximum entropy properties of discrete-time first-order stable spline kernel
Åpne denne publikasjonen i ny fane eller vindu >>Maximum entropy properties of discrete-time first-order stable spline kernel
Vise andre…
2016 (engelsk)Inngår i: Automatica, ISSN 0005-1098, E-ISSN 1873-2836, Vol. 66, s. 34-38Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

The first order stable spline (SS-1) kernel (also known as the tunedcorrelated kernel) is used extensively in regularized system identification, where the impulse response is modeled as a zero-mean Gaussian process whose covariance function is given by well designed and tuned kernels. In this paper, we discuss the maximum entropy properties of this kernel. In particular, we formulate the exact maximum entropy problem solved by the SS-1 kernel without Gaussian and uniform sampling assumptions. Under general sampling assumption, we also derive the special structure of the SS-1 kernel (e.g. its tridiagonal inverse and factorization have closed form expression), also giving to it a maximum entropy covariance completion interpretation.

Emneord
System identification;Regularization method;Kernel structure;Maximum entropy
HSV kategori
Identifikatorer
urn:nbn:se:liu:diva-121618 (URN)10.1016/j.automatica.2015.12.009 (DOI)
Tilgjengelig fra: 2015-09-28 Laget: 2015-09-28 Sist oppdatert: 2024-01-08bibliografisk kontrollert
2. Approximate Bayesian Smoothing with Unknown Process and Measurement Noise Covariances
Åpne denne publikasjonen i ny fane eller vindu >>Approximate Bayesian Smoothing with Unknown Process and Measurement Noise Covariances
2015 (engelsk)Inngår i: IEEE Signal Processing Letters, ISSN 1070-9908, E-ISSN 1558-2361, Vol. 22, nr 12, s. 2450-2454Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

We present an adaptive smoother for linear state-space models with unknown process and measurement noise covariances. The proposed method utilizes the variational Bayes technique to perform approximate inference. The resulting smoother is computationally efficient, easy to implement, and can be applied to high dimensional linear systems. The performance of the algorithm is illustrated on a target tracking example.

sted, utgiver, år, opplag, sider
Institute of Electrical and Electronics Engineers (IEEE), 2015
Emneord
Adaptive smoothing, Kalman filtering, noise covariance, Rauch-Tung-Striebel smoother, sensor calibration, time-varying noiseco variances, variational Bayes
HSV kategori
Identifikatorer
urn:nbn:se:liu:diva-121617 (URN)10.1109/LSP.2015.2490543 (DOI)000364207300007 ()
Merknad

At the time for thesis presentation publication was in status: Manuscript

Tilgjengelig fra: 2015-09-28 Laget: 2015-09-28 Sist oppdatert: 2018-03-09bibliografisk kontrollert
3. Robust Inference for State-Space Models with Skewed Measurement Noise
Åpne denne publikasjonen i ny fane eller vindu >>Robust Inference for State-Space Models with Skewed Measurement Noise
2015 (engelsk)Inngår i: IEEE Signal Processing Letters, ISSN 1070-9908, E-ISSN 1558-2361, Vol. 22, nr 11, s. 1898-1902Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Filtering and smoothing algorithms for linear discrete-time state-space models with skewed and heavy-tailed measurement noise are presented. The algorithms use a variational Bayes approximation of the posterior distribution of models that have normal prior and skew-t-distributed measurement noise. The proposed filter and smoother are compared with conventional low-complexity alternatives in a simulated pseudorange positioning scenario. In the simulations the proposed methods achieve better accuracy than the alternative methods, the computational complexity of the filter being roughly 5 to 10 times that of the Kalman filter.

sted, utgiver, år, opplag, sider
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 2015
Emneord
Kalman filter; robust filtering; RTS smoother; skew t; skewness; t-distribution; variational Bayes
HSV kategori
Identifikatorer
urn:nbn:se:liu:diva-120129 (URN)10.1109/LSP.2015.2437456 (DOI)000356458700003 ()
Merknad

Funding Agencies|Tampere University of Technology Graduate School; Finnish Doctoral Programme in Computational Sciences (FICS); Foundation of Nokia Corporation; Swedish research council (VR), project ETT [621-2010-4301]

Tilgjengelig fra: 2015-07-14 Laget: 2015-07-13 Sist oppdatert: 2017-12-04
4. Bayesian Inference via Approximation of Log-likelihood for Priors in Exponential Family
Åpne denne publikasjonen i ny fane eller vindu >>Bayesian Inference via Approximation of Log-likelihood for Priors in Exponential Family
(engelsk)Manuskript (preprint) (Annet vitenskapelig)
Abstract [en]

In this paper, a Bayesian inference technique based on Taylor series approximation of the logarithm of the likelihood function is presented. The proposed approximation is devised for the case where the prior distribution belongs to the exponential family of distributions. The logarithm of the likelihood function is linearized with respect to the sufficient statistic of the prior distribution in exponential family such that the posterior obtains the same exponential family form as the prior. Similarities between the proposed method and the extended Kalman filter for nonlinear filtering are illustrated. Further, an extended target measurement update for target models where the target extent is represented by a random matrix having an inverse Wishart distribution is derived. The approximate update covers the important case where the spread of measurement is due to the target extent as well as the measurement noise in the sensor.

HSV kategori
Identifikatorer
urn:nbn:se:liu:diva-121616 (URN)
Tilgjengelig fra: 2015-09-28 Laget: 2015-09-28 Sist oppdatert: 2015-10-05bibliografisk kontrollert
5. Greedy Reduction Algorithms for Mixtures of Exponential Family
Åpne denne publikasjonen i ny fane eller vindu >>Greedy Reduction Algorithms for Mixtures of Exponential Family
2015 (engelsk)Inngår i: IEEE Signal Processing Letters, ISSN 1070-9908, E-ISSN 1558-2361, Vol. 22, nr 6, s. 676-680Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

In this letter, we propose a general framework for greedy reduction of mixture densities of exponential family. The performances of the generalized algorithms are illustrated both on an artificial example where randomly generated mixture densities are reduced and on a target tracking scenario where the reduction is carried out in the recursion of a Gaussian inverse Wishart probability hypothesis density (PHD) filter.

sted, utgiver, år, opplag, sider
Institute of Electrical and Electronics Engineers (IEEE), 2015
Emneord
Exponential family; extended target; integral square error; Kullback-Leibler divergence; mixture density; mixture reduction; target tracking
HSV kategori
Identifikatorer
urn:nbn:se:liu:diva-112990 (URN)10.1109/LSP.2014.2367154 (DOI)000345236400005 ()
Merknad

Funding Agencies|Swedish research council (VR) under ETT [621-2010-4301]; SSF, project CUAS

Tilgjengelig fra: 2015-01-12 Laget: 2015-01-08 Sist oppdatert: 2017-12-05
6. Gaussian Mixture Reduction Using Reverse Kullback-Leibler Divergence
Åpne denne publikasjonen i ny fane eller vindu >>Gaussian Mixture Reduction Using Reverse Kullback-Leibler Divergence
(engelsk)Manuskript (preprint) (Annet vitenskapelig)
HSV kategori
Identifikatorer
urn:nbn:se:liu:diva-121615 (URN)
Tilgjengelig fra: 2015-09-28 Laget: 2015-09-28 Sist oppdatert: 2015-10-05

Open Access i DiVA

fulltext(1512 kB)2943 nedlastinger
Filinformasjon
Fil FULLTEXT02.pdfFilstørrelse 1512 kBChecksum SHA-512
54a0ea628714bdf8e10a377cf31ce51a436522e4d528ccc66979b5a5f7b19560f1524e86219f2ff2b35c0279b21312af0877da113be446df56bcbfd1d01740d8
Type fulltextMimetype application/pdf
omslag(21 kB)151 nedlastinger
Filinformasjon
Fil COVER01.pdfFilstørrelse 21 kBChecksum SHA-512
3b46b7f76dd8be8a1335d98bd8efe9de8061c54eeb5d1e6bf40b4cfebb9470c8e40b35f6cb9fac13a1689c21cefcb54b9406a788d43b0bbbe3bb1471eec0e62a
Type coverMimetype application/pdf
Bestill online >>

Andre lenker

Forlagets fulltekst

Person

Ardeshiri, Tohid

Søk i DiVA

Av forfatter/redaktør
Ardeshiri, Tohid
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar
Totalt: 2974 nedlastinger
Antall nedlastinger er summen av alle nedlastinger av alle fulltekster. Det kan for eksempel være tidligere versjoner som er ikke lenger tilgjengelige

doi
isbn
urn-nbn

Altmetric

doi
isbn
urn-nbn
Totalt: 5920 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf