b01b9cf0a5157976.tex
1: \begin{abstract}%   <- trailing '%' for backward compatibility of .sty file
2: %\textcolor{blue}{}
3: We study universal consistency and 
4: convergence 
5: rates
6: %of convergence 
7: of simple nearest-neighbor prototype rules for the problem of multiclass classification in metric spaces. 
8: We first show that a novel data-dependent partitioning rule,
9: named \proto{}, is universally
10: % strongly 
11: consistent in any 
12: metric space that admits a universally consistent rule.
13: %separable metric 
14: %space. 
15: %This rule, which we call 
16: %This rule, which we call 
17: \proto{} is a significant simplification of \optinet{}, a recently proposed compression-based algorithm that, 
18: to date,
19: was 
20: %was the first 
21: the only algorithm known to be universally consistent in such a general setting.
22: Practically, \proto{} is simpler to implement and enjoys reduced computational complexity.
23: 
24: We then 
25: proceed to 
26: study convergence rates of the excess error probability.
27: We first obtain 
28: %derive convergence
29: rates for the standard $k$-NN rule under a margin condition and a new generalized-Lipschitz condition.
30: The latter is an extension of a recently proposed modified-Lipschitz condition from $\R^d$ to metric spaces. Similarly to the modified-Lipschitz condition, the new condition avoids any boundness assumptions on the 
31: %support of the underlying 
32: data distribution.
33: %It avoids any boundness assumptions on the support of the underlying data distribution. 
34: %As sucand generalizes recent results to more general metric spaces.
35: While obtaining rates for 
36: %the universally consistent 
37: \proto{} 
38: %rule 
39: %under these conditions 
40: is left open,
41: we show that a second prototype rule that hybridizes between $k$-NN and \proto{}
42: %we call \hybrid{}, 
43: achieves the same rates as $k$-NN while enjoying similar computational advantages as \proto{}.
44: \textcolor{black}{However, as $k$-NN, 
45: this hybrid rule
46: %\hybrid{} 
47: is not consistent in general.}
48: \end{abstract}