9f0216073d4bc725.tex
1: \begin{abstract}
2: Estimating divergences in a consistent way is of great importance in many
3: machine learning tasks. Although this is a fundamental problem in nonparametric
4: statistics, to the best of our knowledge there has been no finite sample
5: exponential inequality convergence bound derived for any divergence estimators.
6: The main contribution of our work is to provide such a bound for an estimator
7: of R\'enyi-$\alpha$ divergence for a smooth H\"older class of densities on the
8: $d$-dimensional unit cube $[0,1]^d$.
9: %We also demonstrate the applicability of the estimator in mutual information estimation and
10: We also illustrate our theoretical results with a numerical experiment.
11: \end{abstract}
12: