79f4fce6e6f53d52.tex
1: \begin{abstract}%   <- trailing '%' for backward compatibility of .sty file
2: Divergence estimators based on direct approximation of density-ratios
3: without going through separate approximation of numerator and denominator densities
4: have been successfully applied to machine learning tasks
5: that involve distribution comparison
6: such as outlier detection, transfer learning, and two-sample homogeneity test.
7: However, since density-ratio functions often possess high fluctuation,
8: divergence estimation is still a challenging task in practice.
9: In this paper, we propose to use \emph{relative divergences}
10: for distribution comparison,
11: which involves approximation of \emph{relative density-ratios}.
12: Since relative density-ratios are always smoother than corresponding ordinary density-ratios,
13: our proposed method is favorable in terms of the non-parametric convergence speed.
14: Furthermore, we show that the proposed divergence estimator has asymptotic variance
15: \emph{independent} of the model complexity under a parametric setup,
16: implying that the proposed estimator hardly overfits
17: even with complex models.
18: Through experiments, we demonstrate the usefulness of the proposed approach.
19: \end{abstract}