liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Smoothing ADMM for Sparse-Penalized Quantile Regression With Non-Convex Penalties
Norwegian Univ Sci & Technol NTNU, Norway.
Linköping University, Department of Science and Technology, Physics, Electronics and Mathematics. Linköping University, Faculty of Science & Engineering.ORCID iD: 0000-0001-8145-7392
Univ Southern Denmark, Denmark.
Norwegian Univ Sci & Technol NTNU, Norway; Aalto Univ, Finland.
2024 (English)In: IEEE Open Journal of Signal Processing, E-ISSN 2644-1322, Vol. 5, p. 213-228Article in journal (Refereed) Published
Abstract [en]

This paper investigates quantile regression in the presence of non-convex and non-smooth sparse penalties, such as the minimax concave penalty (MCP) and smoothly clipped absolute deviation (SCAD). The non-smooth and non-convex nature of these problems often leads to convergence difficulties for many algorithms. While iterative techniques such as coordinate descent and local linear approximation can facilitate convergence, the process is often slow. This sluggish pace is primarily due to the need to run these approximation techniques until full convergence at each step, a requirement we term as a secondary convergence iteration. To accelerate the convergence speed, we employ the alternating direction method of multipliers (ADMM) and introduce a novel single-loop smoothing ADMM algorithm with an increasing penalty parameter, named SIAD, specifically tailored for sparse-penalized quantile regression. We first delve into the convergence properties of the proposed SIAD algorithm and establish the necessary conditions for convergence. Theoretically, we confirm a convergence rate of o(k(-1/4)) for the sub-gradient bound of the augmented Lagrangian, where k denotes the number of iterations. Subsequently, we provide numerical results to showcase the effectiveness of the SIAD algorithm. Our findings highlight that the SIAD method outperforms existing approaches, providing a faster and more stable solution for sparse-penalized quantile regression.

Place, publisher, year, edition, pages
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC , 2024. Vol. 5, p. 213-228
Keywords [en]
Convergence; Smoothing methods; Optimization; Signal processing algorithms; Convex functions; Signal processing; Prediction algorithms; Quantile regression; non-smooth and non-convex penalties; ADMM; sparse learning
National Category
Computational Mathematics
Identifiers
URN: urn:nbn:se:liu:diva-200383DOI: 10.1109/OJSP.2023.3344395ISI: 001136703300002OAI: oai:DiVA.org:liu-200383DiVA, id: diva2:1830875
Note

Funding Agencies|Research Council of Norway

Available from: 2024-01-24 Created: 2024-01-24 Last updated: 2024-11-25

Open Access in DiVA

fulltext(1082 kB)8 downloads
File information
File name FULLTEXT01.pdfFile size 1082 kBChecksum SHA-512
1c67fe7730f63d40547f78ae0b8c6cd703a204b70987f1c45ab2f479cd8a820cd679e151f928627f7c3cc2494a845a39b2b334c7a7563b6d7362f3191ec61372
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Search in DiVA

By author/editor
Kumar Dasanadoddi Venkategowda, Naveen
By organisation
Physics, Electronics and MathematicsFaculty of Science & Engineering
In the same journal
IEEE Open Journal of Signal Processing
Computational Mathematics

Search outside of DiVA

GoogleGoogle Scholar
Total: 8 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 78 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf