Learning to optimize nonconvex problems: provably and efficiently

From 01-01-2020 to 31-12-2023

Description

 Today's information society is centered on the collection of large amounts of data, from which machine learning (ML) aims at extracting information. The key step in any ML technique is "training", where an optimization problem is solved to tune the parameters of the ML model. Such optimization problems are becoming extremely challenging due to their large dimension and presence of highly nonconvex as well as nonsmooth terms. Optimization algorithms for solving learning problems addressing such problems usually involve a large number of hyperparameters that need to be hand-tuned after time-consuming experimentation and are prone to ill-conditioning and to getting stuck to local minima. As the size of datasets keeps growing rapidly and ML models become more complex, these issues are becoming more pronounced jeopardizing the applicability of ML techniques to an even wider area of applications. To address this challenge, in this project we aim at learning-based techniques for devising ad-hoc tuning-free optimization algorithms. A novel universal framework will be developed, which will serve as a solid theoretical ground for the development of new learning paradigms to train optimization methods subject to certificates of (speed of) convergence and quality of output solution.

Team

• Andreas Themelis, Co-promoter
• Panagiotis Patrinos, Promoter

Financing

Funding: FWO - Research Foundation - Flanders

Program/Grant Type: FWO Project - FWO Research Project