4c7bdf5fafda5faf.tex
1: \begin{abstract}
2: In the online prediction framework, we use generalized entropy of to
3: study the loss rate of predictors when outcomes are drawn according to
4: stationary ergodic distributions over the binary alphabet. We show
5: that the notion of generalized entropy of a regular game \cite{KVV04}
6: is well-defined for stationary ergodic distributions. In proving this,
7: we obtain new game-theoretic proofs of some classical information
8: theoretic inequalities. Using Birkhoff's ergodic theorem and
9: convergence properties of conditional distributions, we prove that a
10: classical Shannon-McMillan-Breiman theorem holds for a restricted
11: class of regular games, when no computational constraints are imposed
12: on the prediction strategies.
13: 
14: If a game is mixable, then there is an optimal aggregating strategy
15: which loses at most an additive constant when compared to any other
16: lower semicomputable strategy. The loss incurred by this algorithm on
17: an infinite sequence of outcomes is called its \emph{predictive
18:   complexity}. We use our version of Shannon-McMillan-Breiman theorem
19: to prove that when a restriced regular game has a predictive
20: complexity, the predictive complexity converges to the generalized
21: entropy of the game almost everywhere with respect to the stationary
22: ergodic distribution.
23: \end{abstract}