1: \begin{definition}
2: (Rademacher Complexity) The empirical Rademacher complexity of $\mathcal{F}_{|S}$ is\footnote{The factor $2$ in the defining equation (\ref{eqn:emp-rademacher-def}) is not very important. Some authors omit this factor and include it explicitly as a pre-factor in, for example, Theorem \ref{thm:complexity-rademacher-base}. }
3: \begin{equation}
4: \mathcal{\hat{R}}(\mathcal{F}_{|S}) = \mathbb{E}_{\sigma}\left[\sup_{f \in \mathcal{F}} \frac{2}{n}\sum_{i=1}^{n}\sigma_{i}f(x_{i})\right]\label{eqn:emp-rademacher-def}
5: \end{equation}
6: where $\{\sigma_i\}$ are Rademacher random variables ($\sigma_i = 1$ with prob$.$ $1/2$ and $-1$ with prob$.$ $1/2$). The Rademacher complexity is its expectation: $\mathcal{R}_n(\mathcal{F}) = \mathbb{E}_{S\sim (\mu_{\mathcal{X}})^{n}}[\mathcal{\hat{R}}(\mathcal{F}_{|S})]$.
7: \end{definition}
8: