1: \begin{abstract}

2: Sparse regularization such as $\ell_1$ regularization is

3: a quite powerful and widely used strategy for high dimensional learning problems.

4: The effectiveness of sparse regularization has been supported

5: practically and theoretically by several studies.

6: However, one of the biggest issues in sparse regularization is that

7: its performance is quite sensitive to correlations between features.

8: Ordinary $\ell_1$ regularization can select variables correlated with each other,

9: which results in deterioration of not only its generalization error but also interpretability.

10: In this paper, we propose a new regularization method, ``Independently Interpretable Lasso'' (IILasso).

11: Our proposed regularizer suppresses selecting correlated variables, and thus each active variable independently affects the objective variable in the model.

12: Hence, we can interpret regression coefficients intuitively

13: and also improve the performance by avoiding overfitting.

14: We analyze theoretical property of IILasso and show that the proposed method is much advantageous for its sign recovery and achieves almost minimax optimal convergence rate.

15: Synthetic and real data analyses also indicate the effectiveness of IILasso.

16: \end{abstract}

17: