1: \begin{abstract}

2: Multilevel optimization has recently gained renewed interest in machine learning due to its promise in applications such as hyperparameter tuning and continual learning. However, existing methods struggle with the inherent difficulty of handling the nested structure efficiently. This paper introduces a novel gradient-based approach for multilevel optimization designed to overcome these limitations by leveraging a hierarchically structured decomposition of the full gradient and employing advanced propagation techniques. With extension to $n$-level scenarios, our method significantly reduces computational complexity and improves solution accuracy and convergence speed. We demonstrate the efficacy of our approach through numerical experiments comparing with existing methods across several benchmarks, showcasing a significant improvement of solution accuracy. To the best of our knowledge, this is one of the first algorithms providing a general version of implicit differentiation with both theoretical guarantee and outperforming empirical superiority.

3: \end{abstract}

4: