fc2fa825faea7952.tex
1: \begin{abstract}
2: Mutual information is fundamentally important for measuring statistical
3: dependence between variables and for quantifying information transfer by signaling and communication mechanisms. It can, however, be challenging to evaluate
4: for physical models of such mechanisms and to estimate reliably from data. Furthermore,
5: its relationship to better known statistical procedures is still poorly
6: understood. Here we explore new connections between mutual information
7: and regression-based dependence measures, $\nu^{-1}$, that utilise the determinant of the second-moment matrix of the conditional mean prediction error. We examine
8: convergence properties as $\nu\rightarrow0$ and establish sharp lower
9: bounds on mutual information and capacity of the form $\mathrm{log}(\nu^{-1/2})$. The bounds are tighter than 
10: lower bounds based on the Pearson correlation and ones derived using average mean square-error rate distortion arguments. Furthermore, their estimation is feasible using techniques from nonparametric regression.  
11: As an illustration we provide bootstrap confidence intervals for the
12: lower bounds which, through use of a composite estimator, substantially improve upon inference about mutual information based on $k$-nearest neighbour estimators alone.
13: \end{abstract}
14: