1: \begin{abstract}

2: Asynchronous FTRL-proximal and $L2$ norm done at server are two widely used tricks in Parameters Server which is a kind of implement of delayed SGD. Their commonness is leaving parts of updating computation on server which reduces the burden of network via making transmitted data sparse. But these two tricks' convergences are not well-proved. In this paper, based on their commonness, we propose a more general algorithm named as asynchronous COMID and prove its convergence. We prove that asynchronous FTRL-proximal and $L2$ norm done at server are applications of asynchronous COMID, which demonstrates the convergences of these two tricks. Then, we conduct experiments to verify theoretical results. Experimental results show that compared with delayed SGD on Parameters Server, asynchronous COMID reduces the burden of the network  without any harm on the mathematical convergence speed and final output. 

3: 

4: \end{abstract}

5: