1: \begin{abstract}

2: %\boldmath

3: \textbf{I}terative algorithms are ubiquitous in the field of data mining. Widely known examples of such algorithms are the least mean square algorithm, backpropagation algorithm of neural networks etc. %Some of the recent examples also include the "kernelized" versions of the least mean square type algorithms (viz. kernel perceptron, kernel LMS, kernel least squares).

4:   Our contribution in this paper is an improvement upon these iterative algorithms in terms of their respective performance metrics and robustness.

5: This improvement is achieved by a new scaling factor (motivated from contraction principle in topology) which is multiplied to the error term.

6: Our analysis also shows that, in essence, we are minimizing the corresponding LASSO (least absolute shrinkage and selection operator) cost function, which is the reason of its increased robustness. We also give closed from expressions for the number of iterations required for convergence and the MSE floor of the original cost function for a given minimum targeted value of the $L1$ norm. As a concluding theme based on stochastic subgradient algorithm, we give a comparison between the well known Dantzig selector and our algorithm based on contraction principle.

7:  By these simulations we attempt to show the optimality of our approach for any  widely used parent iterative optimization problem.

8: \end{abstract}