liu.seSearch for publications in DiVA
Operational message
There are currently operational disruptions. Troubleshooting is in progress.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
On Complexity Certification of Active-Set QP Methods with Applications to Linear MPC
Linköping University, Department of Electrical Engineering, Automatic Control. Linköping University, Faculty of Science & Engineering.
2021 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

In model predictive control (MPC) an optimization problem has to be solved at each time step, which in real-time applications makes it important to solve these efficiently and to have good upper bounds on worst-case solution time. Often for linear MPC problems, the optimization problem in question is a quadratic program (QP) that depends on parameters such as system states and reference signals. A popular class of methods for solving such QPs is active-set methods, where a sequence of linear systems of equations is solved. 

The primary contribution of this thesis is a method which determines which sequence of subproblems a popular class of such active-set algorithms need to solve, for every possible QP instance that might arise from a given linear MPC problem (i.e, for every possible state and reference signal). By knowing these sequences, worst-case bounds on how many iterations, floating-point operations and, ultimately, the maximum solution time, these active-set algorithms require to compute a solution can be determined, which is of importance when, e.g, linear MPC is used in safety-critical applications. 

After establishing this complexity certification method, its applicability is extended by showing how it can be used indirectly to certify the complexity of another, efficient, type of active-set QP algorithm which reformulates the QP as a nonnegative least-squares method. 

Finally, the proposed complexity certification method is extended further to situations when enhancements to the active-set algorithms are used, namely, when they are terminated early (to save computations) and when outer proximal-point iterations are performed (to improve numerical stability). 

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2021. , p. 45
Series
Linköping Studies in Science and Technology. Licentiate Thesis, ISSN 0280-7971 ; 1901
National Category
Control Engineering
Identifiers
URN: urn:nbn:se:liu:diva-173716DOI: 10.3384/lic.diva-173716ISBN: 9789179296926 (print)OAI: oai:DiVA.org:liu-173716DiVA, id: diva2:1533096
Presentation
2021-03-26, Online via Zoom: https://liu-se.zoom.us/j/68041529531?pwd=b05sVVluNmI2RzZ2RkRqV1lib0RmZz09, 10:15 (Swedish)
Opponent
Supervisors
Available from: 2021-03-03 Created: 2021-03-03 Last updated: 2022-09-22Bibliographically approved
List of papers
1. A Unifying Complexity Certification Framework for Active-Set Methods for Convex Quadratic Programming
Open this publication in new window or tab >>A Unifying Complexity Certification Framework for Active-Set Methods for Convex Quadratic Programming
2022 (English)In: IEEE Transactions on Automatic Control, ISSN 0018-9286, E-ISSN 1558-2523, Vol. 67, no 6, p. 2758-2770Article in journal (Refereed) Published
Abstract [en]

In model-predictive control (MPC), an optimization problem has to be solved at each time step, which in real-time applications makes it important to solve these efficiently and to have good upper bounds on worst-case solution time. Often for linear MPC problems, the optimization problem in question is a quadratic program (QP) that depends on parameters such as system states and reference signals. A popular class of methods for solving such QPs is active-set methods, where a sequence of linear systems of equations is solved. We propose an algorithm for computing which sequence of subproblems an active-set algorithm will solve, for every parameter of interest. These sequences can be used to set worst-case bounds on how many iterations, floating-point operations, and, ultimately, the maximum solution time the active-set algorithm requires to converge. The usefulness of the proposed method is illustrated on a set of QPs originating from MPC problems, by computing the exact worst-case number of iterations primal and dual active-set algorithms require to reach optimality.

Place, publisher, year, edition, pages
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 2022
Keywords
Complexity theory; Predictive control; Optimization; Linear systems; Real-time systems; Quadratic programming; Linear programming; Optimization algorithms; predictive control for linear systems; quadratic programming
National Category
Control Engineering
Identifiers
urn:nbn:se:liu:diva-185817 (URN)10.1109/TAC.2021.3090749 (DOI)000803343800009 ()
Note

Funding Agencies|Swedish Research Council [2017-04710]

Available from: 2022-06-14 Created: 2022-06-14 Last updated: 2023-05-05
2. Exact Complexity Certification of an Early-Terminating Standard Primal Active-Set Method for Quadratic Programming
Open this publication in new window or tab >>Exact Complexity Certification of an Early-Terminating Standard Primal Active-Set Method for Quadratic Programming
2020 (English)In: IFAC PAPERSONLINE, ELSEVIER , 2020, Vol. 53, no 2, p. 6509-6515Conference paper, Published paper (Refereed)
Abstract [en]

In this paper we present a method to exactly certify the iteration complexity of a primal active-set algorithm for quadratic programs which is terminated early, given a specific multi-parametric quadratic program. The primal active-set algorithms real-time applicability is, hence, improved by early termination, increasing its computational efficiency, and by the proposed certification method, providing guarantees on worst-case behaviour. The certification method is illustrated on a multi-parametric quadratic program originating from model predictive control of an inverted pendulum, for which the relationship between allowed suboptimality and iterations needed by the primal active-set algorithm is presented. Copyright (C) 2020 The Authors.

Place, publisher, year, edition, pages
ELSEVIER, 2020
Series
IFAC-PapersOnLine, ISSN 2405-8971, E-ISSN 2405-8963
Keywords
Quadratic programming; Active-set methods; Linear model predictive control; Suboptimal control; Complexity certification
National Category
Computer Sciences
Identifiers
urn:nbn:se:liu:diva-176901 (URN)10.1016/j.ifacol.2020.12.1802 (DOI)000652593000339 ()2-s2.0-85105074360 (Scopus ID)
Conference
21st IFAC World Congress on Automatic Control - Meeting Societal Challenges, ELECTR NETWORK, jul 11-17, 2020
Note

Funding Agencies|Swedish Research Council (VR)Swedish Research Council [2017-04710]

Available from: 2021-06-24 Created: 2021-06-24 Last updated: 2025-08-28
3. Exact Complexity Certification of a Nonnegative Least-Squares Method for Quadratic Programming
Open this publication in new window or tab >>Exact Complexity Certification of a Nonnegative Least-Squares Method for Quadratic Programming
2020 (English)In: IEEE Control Systems Letters, E-ISSN 2475-1456, Vol. 4, no 4, p. 1036-1041Article in journal (Refereed) Published
Abstract [en]

In this letter we propose a method to exactly certify the complexity of an active-set method which is based on reformulating strictly convex quadratic programs to nonnegative least-squares problems. The exact complexity of the method is determined by proving the correspondence between the method and a standard primal active-set method for quadratic programming applied to the dual of the quadratic program to be solved. Once this correspondence has been established, a complexity certification method which has already been established for the primal active-set method is used to also certify the complexity of the nonnegative least-squares method. The usefulness of the proposed method is illustrated on a multi-parametric quadratic program originating from model predictive control of an inverted pendulum.

Place, publisher, year, edition, pages
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 2020
Keywords
Optimization algorithms; predictive control for linear systems
National Category
Control Engineering
Identifiers
urn:nbn:se:liu:diva-172888 (URN)10.1109/LCSYS.2020.2998953 (DOI)000543166700009 ()
Note

Funding Agencies|Swedish Research Council (VR)Swedish Research Council [2017-04710]

Available from: 2021-01-25 Created: 2021-01-25 Last updated: 2023-08-25
4. Complexity Certification of Proximal-Point Methods for Numerically Stable Quadratic Programming
Open this publication in new window or tab >>Complexity Certification of Proximal-Point Methods for Numerically Stable Quadratic Programming
2021 (English)In: IEEE Control Systems Letters, E-ISSN 2475-1456, Vol. 5, no 4, p. 1381-1386Article in journal (Refereed) Published
Abstract [en]

When solving a quadratic program (QP), one can improve the numerical stability of any QP solver by performing proximal-point outer iterations, resulting in solving a sequence of better conditioned QPs. In this letter we present a method which, for a given multi-parametric quadratic program (mpQP) and any polyhedral set of parameters, determines which sequences of QPs will have to be solved when using outer proximal-point iterations. By knowing this sequence, bounds on the worst-case complexity of the method can be obtained, which is of importance in, for example, real-time model predictive control (MPC) applications. Moreover, we combine the proposed method with previous work on complexity certification for active-set methods to obtain a more detailed certification of the proximal-point methods complexity, namely the total number of inner iterations.

Place, publisher, year, edition, pages
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 2021
Keywords
Optimization algorithms; predictive control for linear systems
National Category
Computational Mathematics
Identifiers
urn:nbn:se:liu:diva-172190 (URN)10.1109/LCSYS.2020.3038035 (DOI)000597141300007 ()
Note

Funding Agencies|Swedish Research Council (VR)Swedish Research Council [2017-04710]

Available from: 2020-12-28 Created: 2020-12-28 Last updated: 2023-08-25

Open Access in DiVA

fulltext(3530 kB)1949 downloads
File information
File name FULLTEXT01.pdfFile size 3530 kBChecksum SHA-512
3a03f9b4d107dad28aaeeefdf4034a10ad0f435f81ef25d3a636a78938dec8b63193d1a6b2f205dca91571215f0787bad8c8eb82bcf3251c3b02a8cf9e5f4ad6
Type fulltextMimetype application/pdf
Order online >>

Other links

Publisher's full text

Authority records

Arnström, Daniel

Search in DiVA

By author/editor
Arnström, Daniel
By organisation
Automatic ControlFaculty of Science & Engineering
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 1953 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 1804 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf