Stochastic DCA for minimizing a large sum of DC functions with application to multi-class logistic regression - Université de Lorraine Accéder directement au contenu
Article Dans Une Revue Neural Networks Année : 2020

Stochastic DCA for minimizing a large sum of DC functions with application to multi-class logistic regression

Résumé

We consider the large sum of DC (Difference of Convex) functions minimization problem which appear in several different areas, especially in stochastic optimization and machine learning. Two DCA (DC Algorithm) based algorithms are proposed: stochastic DCA and inexact stochastic DCA. We prove that the convergence of both algorithms to a critical point is guaranteed with probability one. Furthermore, we develop our stochastic DCA for solving an important problem in multi-task learning, namely group variables selection in multi class logistic regression. The corresponding stochastic DCA is very inexpensive, all computations are explicit. Numerical experiments on several benchmark datasets and synthetic datasets illustrate the efficiency of our algorithms and their superiority over existing methods, with respect to classification accuracy, sparsity of solution as well as running time.
Fichier principal
Vignette du fichier
S0893608020303233.pdf (301.35 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03063833 , version 1 (14-09-2022)

Licence

Paternité - Pas d'utilisation commerciale

Identifiants

Citer

Hoai An Le Thi, Hoai Minh Le, Duy Nhat Phan, Bach Tran. Stochastic DCA for minimizing a large sum of DC functions with application to multi-class logistic regression. Neural Networks, 2020, 132, pp.220-231. ⟨10.1016/j.neunet.2020.08.024⟩. ⟨hal-03063833⟩
99 Consultations
43 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More