An O(n2) algorithm for isotonic regression
2006 (English)In: Large-Scale Nonlinear Optimization / [ed] Pillo, Gianni; Roma, Massimo, New York: Springer Science+Business Media B.V., 2006, p. 25-33Conference paper, Published paper (Other academic)
Abstract [en]
We consider the problem of minimizing the distance from a given n-dimensional vector to a set defined by constraints of the form xi ≤ xj. Such constraints induce a partial order of the components xi, which can be illustrated by an acyclic directed graph. This problem is also known as the isotonic regression (IR) problem. IR has important applications in statistics, operations research and signal processing, with most of them characterized by a very large value of n. For such large-scale problems, it is of great practical importance to develop algorithms whose complexity does not rise with n too rapidly. The existing optimization-based algorithms and statistical IR algorithms have either too high computational complexity or too low accuracy of the approximation to the optimal solution they generate. We introduce a new IR algorithm, which can be viewed as a generalization of the Pool-Adjacent-Violator (PAV) algorithm from completely to partially ordered data. Our algorithm combines both low computational complexity O(n2) and high accuracy. This allows us to obtain sufficiently accurate solutions to IR problems with thousands of observations.
Place, publisher, year, edition, pages
New York: Springer Science+Business Media B.V., 2006. p. 25-33
Series
Nonconvex Optimization and Its Applications, ISSN 1571-568X ; 83
Keywords [en]
quadratic programming - large scale optimization - least distance problem - isotonic regression - pool-adjacent-violators algorithm
National Category
Mathematics
Identifiers
URN: urn:nbn:se:liu:diva-36280DOI: 10.1007/0-387-30065-1_3Local ID: 30828ISBN: 0-387-30063-5 (print)OAI: oai:DiVA.org:liu-36280DiVA, id: diva2:257128
Conference
40th WORKSHOP LARGE SCALE NONLINEAR OPTIMIZATION, Erice, Italy, June 22 - July 1, 2004,
2009-10-102009-10-102015-06-02Bibliographically approved