e050d037d2580c32.tex
1: \begin{abstract}\normalsize\singlespacing
2: \vspace{-0.25cm}{\small{\sf{\textbf{Abstract}}}}---Conventional information-theoretic quantities assume access to probability distributions.  Estimating such distributions is not trivial.  Here, we consider function-based formulations of cross entropy that sidesteps this a priori estimation requirement.  We propose three measures of R\'{e}nyi's $\alpha$-cross-entropies in the setting of reproducing-kernel Hilbert spaces.  Each measure has its appeals.  We prove that we can estimate these measures in an unbiased, non-parametric, and minimax-optimal way.  We do this via sample-constructed Gram matrices.  This yields matrix-based estimators of R\'{e}nyi's $\alpha$-cross-entropies.  These estimators satisfy all of the axioms that R\'{e}nyi established for divergences.  Our cross-entropies can thus be used for assessing distributional differences.  They are also appropriate for handling high-dimensional distributions, since the convergence rate of our estimator is independent of the sample dimensionality.
3: 
4: Python code for implementing these measures can be found at \href{https://github.com/isledge/MBRCE}{https://github.com/isledge/MBRCE}.
5: 
6: \end{abstract}%