849053034333c3af.tex
1: \begin{abstract}
2: We study some of the most commonly used mutual information
3: estimators, based on histograms of fixed or adaptive bin size,
4: $k$-nearest neighbors and kernels, and focus on optimal selection
5: of their free parameters. We examine the consistency of the
6: estimators (convergence to a stable value with the increase of
7: time series length) and the degree of deviation among the
8: estimators. The optimization of parameters is assessed by
9: quantifying the deviation of the estimated mutual information from
10: its true or asymptotic value as a function of the free parameter.
11: Moreover, some common-used criteria for parameter selection are
12: evaluated for each estimator. The comparative study is based on
13: Monte Carlo simulations on time series from several linear and
14: nonlinear systems of different lengths and noise levels. The
15: results show that the $k$-nearest neighbor is the most stable and
16: less affected by the method-specific parameter. A data adaptive
17: criterion for optimal binning is suggested for linear systems but
18: it is found to be rather conservative for nonlinear systems. It
19: turns out that the binning and kernel estimators give the least
20: deviation in identifying the lag of the first minimum of mutual
21: information from nonlinear systems, and are stable in the presence
22: of noise.
23: \end{abstract}
24: