1: \begin{abstract}

2: A fundamental challenge for machine learning models is how to generalize learned models for out-of-distribution (OOD) data. Among various approaches, exploiting invariant features by Domain Adversarial Training (DAT) received widespread attention. Despite its success, we observe training instability from DAT, mostly due to over-confident domain discriminator and environment label noise. To address this issue, we proposed \textbf{E}nvironment \textbf{L}abel \textbf{S}moothing (\ls), which  

3: encourages the discriminator to output soft probability, which thus reduces the confidence of the discriminator and alleviates the impact of noisy environment labels. We demonstrate, both experimentally and theoretically, that \ls can improve training stability, local convergence, and robustness to noisy environment labels. By incorporating \ls with DAT methods, we are able to yield the state-of-art results on a wide range of domain generalization/adaptation tasks, particularly when the environment labels are highly noisy. The code is avaliable at https://github.com/yfzhang114/Environment-Label-Smoothing.

4: 

5: %As a side note, our analysis also provide justification for several commonly used AT tricks, \eg one-sided label smoothing for GANs, and alternating gradient descent in DAT. 

6: 

7: %Besides, 

8: %the resulting \textbf{D}omain \textbf{A}dversarial \textbf{N}etwork with environment label \textbf{S}moothing (\abbr)

9: %or only partial samples' environment labels are known.

10: 

11: \end{abstract}

12: