1: \begin{abstract}
2: We propose an algorithm named best-scored random forest for binary classification problems. The terminology \emph{best-scored} means to
3: select the one with the best empirical performance out of a certain number of purely random tree candidates as each single tree in the forest. In this way,
4: the resulting forest can be more accurate than the original purely random forest.
5: From the theoretical perspective,
6: within the framework of regularized empirical risk minimization penalized on the number of splits,
7: we establish almost optimal convergence rates for the proposed best-scored random trees under certain conditions which can be extended to the best-scored random forest.
8: In addition, we present a counterexample to illustrate that in order to ensure the consistency of the forest, every dimension must have the chance to be split.
9: In the numerical experiments,
10: for the sake of efficiency, we employ an adaptive random splitting criterion.
11: Comparative experiments with other state-of-art classification methods demonstrate the accuracy of our best-scored random forest.
12: \end{abstract}
13: