1: \begin{abstract}

2: % In this paper, we study the implicit bias of Adam when applied to linear classification tasks on linearly separable datasets using logistic regression.

3: %Implicit bias of optimizers, which 

4: % As a combination of momentum and adaptive techniques, 

5: % We prove that the normalized $\| \cdot\|_\infty$-margin of Adam iterates will converge to the maximum $\| \cdot\|_\infty$-margin under diminishing learning rate schedule.

6: Adam has become one of the most favored optimizers in deep learning problems. Despite its success in practice, numerous mysteries persist regarding its theoretical understanding. In this paper, we study the implicit bias of Adam in linear logistic regression. Specifically, we show that when the training data are linearly separable, Adam converges towards a linear classifier that achieves the maximum $\ell_\infty$-margin. Notably, for a general class of diminishing learning rates, this convergence occurs within polynomial time. Our result shed light on the difference between Adam and (stochastic) gradient descent from a theoretical perspective. 

7: 

8: % , and advances our understanding of Adam in machine learning tasks. %Numerical experiments are conducted to substantiate the theoretical findings.

9: % We conduct numerical experiments to substantiate our findings, and the results align with our theoretical conclusions.

10: % provides valuable insights into the updating direction of Adam, 

11: \end{abstract}

12: