a6c5834bd0c89e49.tex
1: \begin{abstract}In this paper, we propose a novel distributed online learning algorithm to handle massive data in Big Data era. Comparing to the typical centralized scenario, our proposed distributed online learning has multi-learners. Each learner optimizes its own learning parameter based on local data source and communicates timely with neighbors. We study the regret of the distributed online learning algorithm. However, communications among the learners may lead to privacy breaches. Thus, we use differential privacy to preserve the privacy of the learners, and study the influence of guaranteeing differential privacy on the regret of the algorithm. Furthermore, our online learning algorithm can be used to achieve fast convergence rates for offline learning algorithms in distributed scenarios. We demonstrate that the differentially private offline learning algorithm has high variance, but we can use mini-batch to improve the performance. The simulations show that our proposed theorems are correct and our differentially private distributed online learning algorithm is a general framework.
2: \end{abstract}
3: