e99b61d1386d5b7d.tex
1: \begin{abstract}
2: %Recently, significant progresses on semi-supervised learning (SSL)have been made by leveraging 
3: Semi-supervised learning (SSL) is a key approach toward more data-efficient machine learning by jointly leverage both labeled and unlabeled data. 
4: We propose \emph{AlphaMatch}, an efficient SSL method 
5: that leverages data augmentations, by efficiently enforcing the label consistency between the data points and the augmented data derived from them.  
6: Our key technical contribution lies on: 1) using alpha-divergence to prioritize the regularization on data with high confidence, 
7: achieving similar effect as FixMatch \citep{sohn2020fixmatch} but in a more flexible fashion, and 2) proposing an optimization-based, EM-like algorithm to enforce the consistency, 
8: which enjoys better convergence than iterative regularization procedures used in recent SSL methods such as FixMatch, UDA, and MixMatch. 
9: AlphaMatch is simple and easy to implement, 
10: and consistently outperforms prior arts on standard benchmarks, e.g. CIFAR-10, SVHN, CIFAR-100, STL-10. Specifically, we achieve 91.3\% test accuracy on CIFAR-10 with just 4 labelled data per class, 
11: substantially improving over the previously best 88.7\% accuracy achieved by FixMatch.
12: 
13: %\qred{unify notation. use alpha-divergence (over Alpha divergence or $\alpha$ divergence?}
14: 
15: 
16: 
17: 
18: \end{abstract}
19: