OATAO - Open Archive Toulouse Archive Ouverte Open Access Week

A Nonmonotone Matrix-Free Algorithm for Nonlinear Equality-Constrained Least-Squares Problems

Bergou, El Houcine and Diouane, Youssef and Kungurtsev, Vyacheslav and Royer, Clément W. A Nonmonotone Matrix-Free Algorithm for Nonlinear Equality-Constrained Least-Squares Problems. (2021) SIAM Journal on Scientific Computing, 43 (5). S743-S766. ISSN 1064-8275

(Document in English)

PDF (Author's version) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader

Official URL: https://doi.org/10.1137/20M1349138


Least squares form one of the most prominent classes of optimization problems, with numerous applications in scientific computing and data fitting. When such formulations aim at modeling complex systems, the optimization process must account for nonlinear dynamics by incorporating constraints. In addition, these systems often incorporate a large number of variables, which increases the difficulty of the problem, and motivates the need for efficient algorithms amenable to large-scale implementations. In this paper, we propose and analyze a Levenberg-Marquardt algorithm for nonlinear least squares subject to nonlinear equality constraints. Our algorithm is based on inexact solves of linear least-squares problems, that only require Jacobian-vector products. Global convergence is guaranteed by the combination of a composite step approach and a nonmonotone step acceptance rule. We illustrate the performance of our method on several test cases from data assimilation and inverse problems: our algorithm is able to reach the vicinity of a solution from an arbitrary starting point, and can outperform the most natural alternatives for these classes of problems.

Item Type:Article
HAL Id:hal-03407841
Audience (journal):International peer-reviewed journal
Uncontrolled Keywords:
Institution:French research institutions > Centre National de la Recherche Scientifique - CNRS (FRANCE)
Other partners > Université Paris Sciences & Lettres - PSL (FRANCE)
Other partners > Czech Technical University in Prague - CTU (CZECH REPUBLIC)
Other partners > Université Mohammed VI Polytechnique (MOROCCO)
Laboratory name:
Deposited On:14 Sep 2021 07:26

Repository Staff Only: item control page