1: \begin{abstract}

2: Generalized linear model with $L_1$ and $L_2$ regularization is a widely used technique for solving classification, class probability estimation and regression problems.

3: With the numbers of both features and examples growing rapidly in the fields like text mining and clickstream data analysis parallelization and the use of cluster architectures becomes important.

4: We present a novel algorithm for fitting regularized generalized linear models in the distributed environment.

5: The algorithm splits data between nodes by features, uses coordinate descent on each node and line search to merge results globally.

6: Convergence proof is provided.

7: A modifications of the algorithm addresses slow node problem.

8: For an important particular case of logistic regression we empirically compare our program with several state-of-the art approaches that rely on different algorithmic and data spitting methods.

9: Experiments demonstrate that our approach is scalable and superior when training on large and sparse datasets.

10: \end{abstract}