Difference-of-Convex Algorithm with Extrapolation for Nonconvex, Nonsmooth Optimization Problems - Université de Lorraine
Journal Articles Mathematics of Operations Research Year : 2023

Difference-of-Convex Algorithm with Extrapolation for Nonconvex, Nonsmooth Optimization Problems

Abstract

In this paper, we focus on the problem of minimizing the sum of a nonconvex differentiable function and a difference of convex (DC) function, where the differentiable function is not restricted to the global Lipschitz gradient continuity assumption. This problem covers a broad range of applications in machine learning and statistics, such as compressed sensing, signal recovery, sparse dictionary learning, matrix factorization, etc. We first take inspiration from the Nesterov acceleration technique and the DC algorithm to develop a novel algorithm for the considered problem. We then study the subsequential convergence of our algorithm to a critical point. Furthermore, we justify the global convergence of the whole sequence generated by our algorithm to a critical point and establish its convergence rate under the Kurdyka–Łojasiewicz condition. Numerical experiments on the nonnegative matrix completion problem are performed to demonstrate the efficiency of our algorithm and its superiority over well-known methods.
No file

Dates and versions

hal-04519909 , version 1 (25-03-2024)

Identifiers

Cite

Duy Nhat Phan, Hoai An Le Thi. Difference-of-Convex Algorithm with Extrapolation for Nonconvex, Nonsmooth Optimization Problems. Mathematics of Operations Research, 2023, 49 (3), pp.1973-1985. ⟨10.1287/moor.2020.0393⟩. ⟨hal-04519909⟩
33 View
0 Download

Altmetric

Share

More