2e7b0673876dec6b.tex
1: \begin{abstract}
2: Recent studies have proven that the training of neural machine translation (NMT) can be facilitated by mimicking the learning process of humans.
3: Nevertheless, achievements of such kind of curriculum learning rely on the quality of artificial schedule drawn up with the hand-crafted features, e.g. sentence length or word rarity.
4: We ameliorate this procedure with a more flexible manner by proposing self-paced learning, where NMT model is allowed to 1) automatically quantify the learning confidence over training examples; and 2) flexibly govern its learning via regulating the loss in each iteration step. 
5: Experimental results over multiple translation tasks demonstrate that the proposed model yields better performance than strong baselines and those models trained with human-designed curricula on both translation quality and convergence speed.\footnote{Our codes:  \href{https://github.com/NLP2CT/SPL_for_NMT}{https://github.com/NLP2CT/SPL\_for\_NMT}.}
6: 
7: \end{abstract}
8: