liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Real-Time Certified MPC: Reliable Active-Set QP Solvers
Linköping University, Department of Electrical Engineering, Automatic Control. Linköping University, Faculty of Science & Engineering.
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

In Model Predictive Control (MPC), optimization problems are solved recurrently to produce control actions. When MPC is used in real time to control safety-critical systems, it is important to solve these optimization problems with guarantees on the worst-case execution time. In this thesis, we take aim at such worst-case guarantees through two complementary approaches:

(i) By developing methods that determine exact worst-case bounds on the computational complexity and execution time for deployed optimization solvers.

(ii) By developing efficient optimization solvers that are tailored for the given application and hardware at hand.

We focus on linear MPC, which means that the optimization problems in question are quadratic programs (QPs) that depend on parameters such as system states and reference signals. For solving such QPs, we consider active-set methods: a popular class of optimization algorithms used in real-time applications.

The first part of the thesis concerns complexity certification of well-established active-set methods. First, we propose a certification framework that determines the sequence of subproblems that a class of active-set algorithms needs to solve, for every possible QP instance that might arise from a given linear MPC problem (i.e., for every possible state and reference signal). By knowing these sequences, one can exactly bound the number of iterations and/or floating-point operations that are required to compute a solution. In a second contribution, we use this framework to determine the exact worst-case execution time (WCET) for linear MPC. This requires factors such as hardware and software implementation/compilation to be accounted for in the analysis. The framework is further extended in a third contribution by accounting for internal numerical errors in the solver that is certified. In a similar vein, a fourth contribution extends the framework to handle proximal-point iterations, which can be used to improve the numerical stability of QP solvers, furthering their reliability.

The second part of the thesis concerns efficient solvers for real-time MPC. We propose an efficient active-set solver that is contained in the above-mentioned complexity-certification framework. In addition to being real-time certifiable, we show that the solver is efficient, simple to implement, can easily be warm-started, and is numerically stable, all of which are important properties for a solver that is used in real-time MPC applications. As a final contribution, we use this solver to exemplify how the proposed complexity-certification framework developed in the first part can be used to tailor active-set solvers for a given linear MPC application. Specifically, we do this by constructing and certifying parameter-varying initializations of the solver. 

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2023. , p. 58
Series
Linköping Studies in Science and Technology. Dissertations, ISSN 0345-7524 ; 2324
National Category
Control Engineering
Identifiers
URN: urn:nbn:se:liu:diva-193564DOI: 10.3384/9789180752190ISBN: 9789180752183 (print)ISBN: 9789180752190 (electronic)OAI: oai:DiVA.org:liu-193564DiVA, id: diva2:1755033
Public defence
2023-06-09, KEY1, Key building, Campus Valla, Linköping, 10:15
Supervisors
Note

Funding: Swedish Research Council (VR)

Available from: 2023-05-05 Created: 2023-05-05 Last updated: 2023-05-05Bibliographically approved
List of papers
1. A Unifying Complexity Certification Framework for Active-Set Methods for Convex Quadratic Programming
Open this publication in new window or tab >>A Unifying Complexity Certification Framework for Active-Set Methods for Convex Quadratic Programming
2022 (English)In: IEEE Transactions on Automatic Control, ISSN 0018-9286, E-ISSN 1558-2523, Vol. 67, no 6, p. 2758-2770Article in journal (Refereed) Published
Abstract [en]

In model-predictive control (MPC), an optimization problem has to be solved at each time step, which in real-time applications makes it important to solve these efficiently and to have good upper bounds on worst-case solution time. Often for linear MPC problems, the optimization problem in question is a quadratic program (QP) that depends on parameters such as system states and reference signals. A popular class of methods for solving such QPs is active-set methods, where a sequence of linear systems of equations is solved. We propose an algorithm for computing which sequence of subproblems an active-set algorithm will solve, for every parameter of interest. These sequences can be used to set worst-case bounds on how many iterations, floating-point operations, and, ultimately, the maximum solution time the active-set algorithm requires to converge. The usefulness of the proposed method is illustrated on a set of QPs originating from MPC problems, by computing the exact worst-case number of iterations primal and dual active-set algorithms require to reach optimality.

Place, publisher, year, edition, pages
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 2022
Keywords
Complexity theory; Predictive control; Optimization; Linear systems; Real-time systems; Quadratic programming; Linear programming; Optimization algorithms; predictive control for linear systems; quadratic programming
National Category
Control Engineering
Identifiers
urn:nbn:se:liu:diva-185817 (URN)10.1109/TAC.2021.3090749 (DOI)000803343800009 ()
Note

Funding Agencies|Swedish Research Council [2017-04710]

Available from: 2022-06-14 Created: 2022-06-14 Last updated: 2023-05-05
2. Lift, Partition, and Project: Parametric Complexity Certification of Active-Set QP Methods in the Presence of Numerical Errors
Open this publication in new window or tab >>Lift, Partition, and Project: Parametric Complexity Certification of Active-Set QP Methods in the Presence of Numerical Errors
2022 (English)In: 2022 IEEE 61st Conference on Decision and Control (CDC), Institute of Electrical and Electronics Engineers (IEEE), 2022, Vol. December, p. 4381-4387Conference paper, Published paper (Refereed)
Abstract [en]

When Model Predictive Control (MPC) is used in real-time to control linear systems, quadratic programs (QPs) need to be solved within a limited time frame. Recently, several parametric methods have been proposed that certify the number of computations active-set QP solvers require to solve these QPs. These certification methods, hence, ascertain that the optimization problem can be solved within the limited time frame. A shortcoming in these methods is, however, that they do not account for numerical errors that might occur internally in the solvers, which ultimately might lead to optimistic complexity bounds if, for example, the solvers are implemented in single precision. In this paper we propose a general framework that can be incorporated in any of these certification methods to account for such numerical errors.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2022
Series
Proceedings of the IEEE Conference on Decision and Control, ISSN 0743-1546, E-ISSN 2576-2370 ; December
Keywords
Linear systems, Control systems, Real-time systems, Complexity theory, Reliability, Certification, Optimization
National Category
Control Engineering
Identifiers
urn:nbn:se:liu:diva-193563 (URN)10.1109/CDC51059.2022.9993234 (DOI)000948128103107 ()2-s2.0-85146990606 (Scopus ID)9781665467612 (ISBN)9781665467605 (ISBN)9781665467629 (ISBN)
Conference
2022 IEEE 61st Conference on Decision and Control (CDC) December 6-9, 2022. Cancún, Mexico
Note

Funding: This work was supported by the Swedish Research Council (VR) undercontract number 2017-04710.

Available from: 2023-05-05 Created: 2023-05-05 Last updated: 2024-09-14
3. Complexity Certification of Proximal-Point Methods for Numerically Stable Quadratic Programming
Open this publication in new window or tab >>Complexity Certification of Proximal-Point Methods for Numerically Stable Quadratic Programming
2021 (English)In: IEEE Control Systems Letters, E-ISSN 2475-1456, Vol. 5, no 4, p. 1381-1386Article in journal (Refereed) Published
Abstract [en]

When solving a quadratic program (QP), one can improve the numerical stability of any QP solver by performing proximal-point outer iterations, resulting in solving a sequence of better conditioned QPs. In this letter we present a method which, for a given multi-parametric quadratic program (mpQP) and any polyhedral set of parameters, determines which sequences of QPs will have to be solved when using outer proximal-point iterations. By knowing this sequence, bounds on the worst-case complexity of the method can be obtained, which is of importance in, for example, real-time model predictive control (MPC) applications. Moreover, we combine the proposed method with previous work on complexity certification for active-set methods to obtain a more detailed certification of the proximal-point methods complexity, namely the total number of inner iterations.

Place, publisher, year, edition, pages
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 2021
Keywords
Optimization algorithms; predictive control for linear systems
National Category
Computational Mathematics
Identifiers
urn:nbn:se:liu:diva-172190 (URN)10.1109/LCSYS.2020.3038035 (DOI)000597141300007 ()
Note

Funding Agencies|Swedish Research Council (VR)Swedish Research Council [2017-04710]

Available from: 2020-12-28 Created: 2020-12-28 Last updated: 2023-08-25
4. A Dual Active-Set Solver for Embedded Quadratic Programming Using Recursive LDLT Updates
Open this publication in new window or tab >>A Dual Active-Set Solver for Embedded Quadratic Programming Using Recursive LDLT Updates
2022 (English)In: IEEE Transactions on Automatic Control, ISSN 0018-9286, E-ISSN 1558-2523, Vol. 67, no 8, p. 4362-4369Article in journal (Refereed) Published
Abstract [en]

In this technical article, we present a dual active-set solver for quadratic programming that has properties suitable for use in embedded model predictive control applications. In particular, the solver is efficient, can easily be warm started, and is simple to code. Moreover, the exact worst-case computational complexity of the solver can be determined offline and, by using outer proximal-point iterations, ill-conditioned problems can be handled in a robust manner.

Place, publisher, year, edition, pages
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 2022
Keywords
Embedded optimization; model predictive control; (MPC); quadratic programming (QP)
National Category
Computational Mathematics
Identifiers
urn:nbn:se:liu:diva-187309 (URN)10.1109/TAC.2022.3176430 (DOI)000831140100059 ()
Note

Funding Agencies|Swedish Research Council (VR) [2017-04710]

Available from: 2022-08-18 Created: 2022-08-18 Last updated: 2023-05-05
5. Semi-Explicit Linear MPC Using a Warm-Started Active-Set QP Algorithm with Exact Complexity Guarantees
Open this publication in new window or tab >>Semi-Explicit Linear MPC Using a Warm-Started Active-Set QP Algorithm with Exact Complexity Guarantees
2021 (English)In: 2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), IEEE , 2021, p. 2557-2562Conference paper, Published paper (Refereed)
Abstract [en]

We propose a semi-explicit approach for linear MPC in which a dual active-set quadratic programming algorithm is initialized through a pre-computed warm start. By using a recently developed complexity certification method for active-set algorithms for quadratic programming, we show how the computational complexity of the dual active-set algorithm can be determined offline for a given warm start. We also show how these complexity certificates can be used as quality measures when constructing warm starts, enabling the online complexity to be reduced further by iteratively refining the warm start. In addition to showing how the computational complexity of any pre-computed warm start can be determined, we also propose a novel technique for generating warm starts with low overhead, both in terms of computations and memory.

Place, publisher, year, edition, pages
IEEE, 2021
Series
IEEE Conference on Decision and Control, ISSN 0743-1546
National Category
Control Engineering
Identifiers
urn:nbn:se:liu:diva-185427 (URN)10.1109/CDC45484.2021.9683274 (DOI)000781990302050 ()9781665436595 (ISBN)
Conference
60th IEEE Conference on Decision and Control (CDC), ELECTR NETWORK, dec 13-17, 2021
Note

Funding Agencies|Swedish Research Council (VR) [2017-04710]

Available from: 2022-06-03 Created: 2022-06-03 Last updated: 2023-05-05

Open Access in DiVA

fulltext(1260 kB)2539 downloads
File information
File name FULLTEXT01.pdfFile size 1260 kBChecksum SHA-512
472d9931f64aa4110285711caab51cdd34f87376b15ff670b4bd9b91f7888b992b70f985812b56956b561bfce379f35d26f383ed997acfd1cb1d4c42dbb76054
Type fulltextMimetype application/pdf
Order online >>

Other links

Publisher's full text

Authority records

Arnström, Daniel

Search in DiVA

By author/editor
Arnström, Daniel
By organisation
Automatic ControlFaculty of Science & Engineering
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 2541 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 3550 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf