1: \begin{abstract}

2: %\vspace{-1mm}

3: \input{abs.tex}

4: %In this paper, we focus on designing a variance reduced variant of the 

5: %stochastic Frank-Wolfe method that requires only one sample per iteration for 

6: %solving stochastic constrained optimization problems. We consider the general 

7: %non-oblivious stochastic optimization in which the probability distribution of 

8: %the random variable depends on the choice of optimization variable. We propose 

9: %the one sample stochastic Frank-Wolfe method  which requires only one sample 

10: %per iteration to approximate the gradient of the objective function required 

11: %for the Frank-Wolfe update. The proposed method is built on the momentum 

12: %stochastic Frank-Wolfe method proposed by \citep{mokhtari2018stochastic}, and 

13: %modifies it in a way that the resulted gradient approximation leads to an 

14: %unbiased estimator of the gradient. We characterize the convergence properties 

15: %of one sample stochastic Frank-Wolfe for several settings. In particular, for 

16: %stochastic convex minimization, we prove that one sample SFW finds an 

17: %$\epsilon$-suboptimal solution after at most $\mathcal{O}(1/\epsilon^2)$ 

18: %iterations.  In the nonconvex setting, one sample SFW finds an 

19: %$\epsilon$-first-order stationary point after at most 

20: %$\mathcal{O}(1/\epsilon^3)$ iterations. Finally, we show one sample SFW finds 

21: %a 

22: %$(1-1/e)-\epsilon$ approximate solution for a stochastic  monotone 

23: %DR-submodular maximization problem after at most $\mathcal{O}(1/\epsilon^2)$ 

24: %iterations. We further introduce the modified version of one sample SFW for 

25: %the 

26: %oblivious setting and characterize its convergence properties. To the best of 

27: %our knowledge one sample SFW is the first stochastic variant of FW that only 

28: %requires one sample per iteration and achieves near-optimal complexity bounds 

29: %for convex, nonconvex, and DR-submodular settings.

30: 

31: \end{abstract}

32: