1: \begin{abstract}
2: Coarsely-labeled semantic segmentation annotations are easy to obtain, but therefore bear the risk of losing edge details and introducing background pixels.
3: Impeded by the inherent noise, existing coarse annotations are only taken as a bonus for model pre-training.
4: In this paper, we try to exploit their potentials with a confidence-based reweighting strategy.
5: To expand, loss-based reweighting strategies usually take the high loss value to identify two completely different types of pixels, namely, valuable pixels in noise-free annotations and mislabeled pixels in noisy annotations.
6: This makes it impossible to perform two tasks of mining valuable pixels and suppressing mislabeled pixels at the same time.
7: However, with the help of the prediction confidence, we successfully solve this dilemma and simultaneously perform two subtasks with a single reweighting strategy.
8: Furthermore, we generalize this strategy into an Adversarial Reweighting Module (ARM) and prove its convergence strictly.
9: Experiments on standard datasets shows our ARM can bring consistent improvements for both coarse annotations and fine annotations.
10: Specifically, built on top of DeepLabv3+, ARM improves the mIoU on the coarsely-labeled Cityscapes by a considerable margin and increases the mIoU on the ADE20K dataset to \textbf{47.50}.
11: \end{abstract}
12: