1: \begin{abstract}

2: This paper investigates simple bilevel optimization problems where the upper-level objective minimizes a composite convex function over the optimal solutions of a composite convex lower-level problem. Existing methods for such problems either only guarantee asymptotic convergence, have slow sublinear rates, or require strong assumptions. To address these challenges, we develop a novel penalty-based approach that employs the accelerated proximal gradient (APG) method. Under an $\alpha$-H{\"{o}}lderian error bound condition on the lower-level objective, our algorithm attains an $(\epsilon,l_F^{-\beta}\epsilon^{\beta})$-optimal solution for any $\beta> 0$ within $\mathcal{O}\left( \sqrt{\frac{ L_{f_1}}{ \epsilon } }\right)+ \mathcal{O}\left(\sqrt{\frac {l_F^{\max\{ \alpha,\beta\} }L_{g_1}}{\epsilon^{\max\{\alpha,\beta\}}}}\right)$ iterations, where $l_F$, $L_{f_1}$ and $L_{g_1}$ denote the Lipschitz constants of the upper-level objective, the gradients of the smooth parts of the upper- and lower-level objectives, respectively. If the smooth part of the upper-level objective is strongly convex, the result improves further. We also establish the complexity results when both upper- and lower-level objectives are general convex nonsmooth functions. Numerical experiments demonstrate the effectiveness of our algorithms.

3: \end{abstract}

4: