1: \begin{abstract}

2: In this paper, we study the generalization properties of online learning based

3: stochastic methods for supervised learning problems where the loss function is

4: dependent on more than one training sample (e.g., metric learning, ranking). We

5: present a generic decoupling technique that enables us to provide Rademacher

6: complexity-based generalization error bounds. Our bounds are in general tighter

7: than those obtained by \citet{online-batch-pairwise} for the same problem. Using

8: our decoupling technique, we are further able to obtain fast convergence rates

9: for strongly convex pairwise loss functions. We are also able to analyze a class

10: of memory efficient online learning algorithms for pairwise learning problems that use

11: only a bounded subset of past training samples to update the hypothesis at each

12: step. Finally, in order to complement our generalization bounds, we propose a

13: novel memory efficient online learning algorithm for higher order learning

14: problems with bounded regret guarantees.

15: % for all-pair loss functions while utilizing only a subset of all training

16: %points at each step. 

17: % \begin{enumerate}

18: % 	\item Simplified proof with improved guarantees for infinite buffer

19: %model of [Khardon]

20: % 	\item Analysis of various finite buffer models

21: % 	\item Extensive experimental evaluation of different finite buffer

22: %models

23: % \end{enumerate}

24: \end{abstract}