1: \begin{abstract}

2: Stochastic variance reduced methods have shown strong performance in solving finite-sum problems.

3: %

4: However, these methods usually require the users to manually tune the step-size, which is time-consuming or even infeasible for some large-scale optimization tasks.

5: %

6: To overcome the problem, we propose and analyze several novel adaptive variants of the popular SAGA algorithm.

7: %

8: Eventually, we design a variant of Barzilai-Borwein step-size which is tailored for the incremental gradient method to ensure memory efficiency and fast convergence. 

9: %

10: We establish its convergence guarantees under general settings that allow non-Euclidean norms in the definition of smoothness and the composite objectives, which cover a broad range of applications in machine learning.

11: %

12: We improve the analysis of SAGA to support non-Euclidean norms, which fills the void of existing work.

13: %

14: Numerical experiments on standard datasets demonstrate a competitive performance of the proposed algorithm compared with existing variance-reduced methods and their adaptive variants.

15: \end{abstract}

16: