1: \begin{abstract}

2: 

3: We introduce the problem of model selection for contextual bandits, where a

4: learner must adapt to the complexity of the optimal policy while balancing exploration and exploitation. Our main result is a new model selection guarantee for linear contextual bandits. We work in the stochastic realizable setting with a sequence of nested linear policy classes of dimension $d_1 < d_2 < \ldots$,

5: where the $m^\star$-th class contains the optimal policy, and we design an

6: algorithm that achieves $\otil\prn{T^{2/3}d^{1/3}_{m^\star}}$

7: regret \emph{with no prior knowledge} of the optimal dimension

8: $d_{m^\star}$. The algorithm also achieves regret $\otil\rbr{T^{3/4} + \sqrt{Td_{m^\star}}}$,

9: which is optimal for $d_{\ms}\geq{}\sqrt{T}$. This is the first

10: contextual bandit model selection result with non-vacuous regret for

11: all values of $d_{m^\star}$, and to the best of our knowledge is the first positive result of this type for any online learning setting with partial information. The

12: core of the algorithm is a new estimator for the gap in the best loss

13: achievable by two linear policy classes, which we show admits a

14: convergence rate faster than the rate required to learn the parameters for either class.

15: \end{abstract}

16: