1: \begin{abstract}%

2:   We introduce a data-driven approach to analyze the performance of continuous optimization algorithms using generalization guarantees from statistical learning theory.

3:   We study classical and learned optimizers to solve families of parametric optimization problems.

4:   We build generalization guarantees for classical optimizers, using a sample convergence bound, and for learned optimizers, using the Probably Approximately Correct (PAC)-Bayes framework. 

5:   To train learned optimizers, we use a gradient-based algorithm to directly minimize the PAC-Bayes upper bound.  

6:   Numerical experiments in signal processing, control, and meta-learning showcase the ability of our framework to provide strong generalization guarantees for both classical and learned optimizers given a fixed budget of iterations.

7:   For classical optimizers, our bounds are much tighter than those that worst-case guarantees provide.

8:   For learned optimizers, our bounds  outperform the empirical outcomes observed in their non-learned counterparts.

9:   % For learned optimizers, our bounds outperform their non-learned variants.

10:   % For learned optimizers, our bounds ensure that they outperform their non-learned variants.

11: \end{abstract}

12: