1: \begin{abstract}
2: Deep supervised learning has achieved remarkable success across a wide range of tasks, yet it remains susceptible to overfitting when confronted with noisy labels.
3: To address this issue, noise-robust loss functions offer an effective solution for enhancing learning in the presence of label noise.
4: In this work, we systematically investigate the limitation of the recently proposed Active Passive Loss (APL), which employs Mean Absolute Error (MAE) as its passive loss function.
5: Despite the robustness brought by MAE, one of its key drawbacks is that it pays equal attention to clean and noisy samples;
6: this feature slows down convergence and potentially makes training difficult, particularly in large-scale datasets.
7: To overcome these challenges, we introduce a novel loss function class, termed \emph{Normalized Negative Loss Functions} (NNLFs), which serve as passive loss functions within the APL framework.
8: NNLFs effectively address the limitations of MAE by concentrating more on memorized clean samples.
9: By replacing MAE in APL with our proposed NNLFs, we enhance APL and present a new framework called \emph{Active Negative Loss} (ANL).
10: Moreover, in non-symmetric noise scenarios, we propose an entropy-based regularization technique to mitigate the vulnerability to the label imbalance.
11: Our extensive experiments across various types of label noise, including symmetric, asymmetric, instance-dependent, and real-world noise, demonstrate that the new loss functions adopted by our ANL framework can achieve better or comparative performance compared with the state-of-the-art methods.
12: In addition, we investigate the application of our ANL framework in image segmentation, further showcasing its superior performance.
13: The source code of our method is available at: \href{https://github.com/Virusdoll/Active-Negative-Loss}{https://github.com/Virusdoll/Active-Negative-Loss}.
14: \end{abstract}
15: