liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Stochastic Variance Reduction for Variational Inequality Methods
Univ Wisconsin, WI 53706 USA.
Linköping University.
2022 (English)In: CONFERENCE ON LEARNING THEORY, VOL 178, JMLR-JOURNAL MACHINE LEARNING RESEARCH , 2022, Vol. 178, p. 778-816Conference paper, Published paper (Refereed)
Abstract [en]

We propose stochastic variance reduced algorithms for solving convex-concave saddle point problems, monotone variational inequalities, and monotone inclusions. Our framework applies to extra-gradient, forward-backward-forward, and forward-reflected-backward methods both in Euclidean and Bregman setups. All proposed methods converge in the same setting as their deterministic counterparts and they either match or improve the best-known complexities for solving structured min-max problems. Our results reinforce the correspondence between variance reduction in variational inequalities and minimization. We also illustrate the improvements of our approach with numerical evaluations on matrix games.

Place, publisher, year, edition, pages
JMLR-JOURNAL MACHINE LEARNING RESEARCH , 2022. Vol. 178, p. 778-816
Series
Proceedings of Machine Learning Research, ISSN 2640-3498
Keywords [en]
Variational inequality; extragradient; stochastic methods; variance reduction; oracle complexity
National Category
Computational Mathematics
Identifiers
URN: urn:nbn:se:liu:diva-209521ISI: 001234590300026OAI: oai:DiVA.org:liu-209521DiVA, id: diva2:1914082
Conference
35th Conference on Learning Theory (COLT), Royal Inst London, London, ENGLAND, jul 02-05, 2022
Note

Funding Agencies|NSF [2023239]; DOE ASCR from Argonne National Laboratory [8F-30039]; European Research Council (ERC) under the European Union [725594]; Wallenberg Al, Autonomous Systems and Software Program (WASP) - Knut and Alice Wallenberg Foundation [305286]

Available from: 2024-11-18 Created: 2024-11-18 Last updated: 2024-11-18

Open Access in DiVA

No full text in DiVA

Search in DiVA

By author/editor
Malitsky, Yura
By organisation
Linköping University
Computational Mathematics

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 77 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf