1: \begin{abstract}%

2: Robust training of machine learning models in the presence of outliers has garnered attention across various domains. 

3: %

4: The use of robust losses is a popular approach and is known to mitigate the impact of outliers. 

5: %

6: %

7: %

8: We bring to light two literatures that have diverged in their ways of designing robust losses: one using M-estimation, which is popular in robotics and computer vision, and another using a risk-minimization framework, which is popular in deep learning. 

9: %

10: We {first} show that a simple modification of the Black-Rangarajan duality provides a unifying view.

11: %

12: The modified duality brings out a definition of a \emph{robust loss kernel} $\sigma$ that is satisfied by robust losses in both the literatures.

13: %

14: %

15: {Secondly,} using the modified duality, we propose an

16: \emph{\algoNameLongCaps} (\algoName) for training machine learning models with outliers. 

17: %

18: The algorithm iteratively trains the model by using a weighted version of the non-robust loss, while updating the weights at each iteration.

19: The algorithm 

20: %

21: %

22: is 

23: augmented with a novel 

24: %

25: %

26: %

27: %

28: %

29: %

30: parameter update rule by interpreting the weights as inlier probabilities, and obviates the need for complex parameter tuning. 

31: %

32: %

33: %

34: %

35: %

36: %

37: %

38: {Thirdly},

39: we investigate convergence 

40: of the 

41: %

42: \algoNameLong

43: to outlier-free optima.

44: %

45: %

46: Considering arbitrary outliers (\ie with no distributional assumption on the outliers), we show that the use of robust loss kernels $\sigma$ increases the region of convergence. 

47: %

48: We experimentally show the efficacy of our algorithm on regression, classification, and neural scene reconstruction problems.%

49: %

50: %

51: \footnote{We release our implementation code: \href{https://github.com/MIT-SPARK/ORT}{https://github.com/MIT-SPARK/ORT}.}

52: \end{abstract}

53: