1: \begin{abstract}

2: Algorithms for binary classification based on adaptive tree

3: partitioning are formulated and

4: analyzed for both their risk performance and their friendliness to

5: numerical implementation.

6: The algorithms can be viewed as generating a set approximation to the

7: Bayes set and thus fall

8: into the general category of \textit{set estimators}.

9: In contrast with the most studied tree-based algorithms, which utilize

10: piecewise constant approximation

11: on the generated partition

12: [\textit{IEEE Trans. Inform. Theory} \textbf{52} (2006) 1335--1353;

13: \textit{Mach. Learn.} \textbf{66} (2007) 209--242], we consider decorated

14: trees, which allow us to derive higher order methods.

15: Convergence rates for these methods are derived in terms the parameter

16: $\alpha$ of margin conditions

17: and a rate $s$ of best approximation of the Bayes set by decorated

18: adaptive partitions.

19: They can also be expressed in terms of the Besov smoothness $\beta$ of

20: the regression function that governs

21: its approximability by piecewise polynomials on adaptive partition.

22: The execution of the algorithms does not require knowledge of the

23: smoothness or margin conditions.

24: Besov smoothness conditions are weaker than the commonly used H\"older

25: conditions, which govern approximation by nonadaptive partitions,

26: and therefore for a given regression function can result in a higher

27: rate of convergence.

28: This in turn mitigates the compatibility conflict between smoothness

29: and margin parameters.

30: \end{abstract}