1: \begin{abstract}

2: %We are studying a method based on a robust risk minimization to obtain better performance in stochastic optimization. Traditional methods are implemented as an uniform sampling which does not take into account the underlying characteristics of the data. The novel regularized estimation is focus on an alternative measure by minimizing the variance, achieving an optimal and computationally efficient solution. From this motivation, we try to show the improvements by the transformation of  this point estimation into another pre-processing step in the configuration of a neural network in order to select the samples of the mini-batch. Through this step, we prove the faster convergence and the increase of the accuracy.

3: Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the contribution from each sample for tightening the empirical risk bound. During the stochastic training, the selection of samples is done according to their accuracy in such a way that the worst performed samples are the ones that contribute the most in the optimization. We study different scenarios and show the ones where it can make the convergence faster or increase the accuracy.

4: \end{abstract}

5: