c81a1cf5f7a09084.tex
1: \begin{abstract}
2: Empirical divergence maximization (EDM) refers to a recently proposed strategy for estimating $f$-divergences and likelihood ratio functions.
3: This paper extends the idea to empirical vector quantization where one seeks to empirically derive quantization rules that maximize the Kullback-Leibler divergence between two statistical hypotheses.
4: We analyze the estimator's error convergence rate leveraging Tsybakov's margin condition and show that rates as fast as $n^{-1}$ are possible, where $n$ equals the number of training samples.
5: We also show that the Flynn and Gray algorithm can be used to efficiently compute EDM estimates and show that they can be efficiently and accurately represented by recursive dyadic partitions.
6: The EDM formulation have several advantages.
7: First, the formulation gives access to the tools and results of empirical process theory that quantify the estimator's error convergence rate.
8: Second, the formulation provides a previously unknown derivation for the Flynn and Gray algorithm.
9: Third, the flexibility it affords allows one to avoid a small-cell assumption common in other approaches.
10: Finally, we illustrate the potential use of the method through an example.
11: \end{abstract}
12: