f3084199609167cc.tex
1: \begin{abstract}
2: We establish rates of convergences in time series forecasting using the
3: statistical
4: learning approach based on oracle inequalities.
5: A series of papers (e.g. \cite{modha,meir,baraud:comte:viennet:2001,alqwin})
6: extends
7: the oracle inequalities obtained for iid observations to time series under weak
8: dependence
9: conditions. Given a
10: family of predictors and $n$ observations, oracle inequalities state that a
11: predictor
12: forecasts the series as well as the best predictor in the family up to a
13: remainder term
14: $\Delta_n$. Using the PAC-Bayesian approach, we establish under weak dependence
15: conditions
16: oracle inequalities with optimal rates of convergence $\Delta_n$. We extend
17: results given
18: in \cite{alqwin} for the absolute loss function to any Lipschitz loss function
19: with rates
20: $\Delta_n\sim\sqrt{ c(\Theta)/ n}$ where $c(\Theta)$ measures the complexity of
21: the model.
22: We apply the method for quantile loss functions to forecast the french GDP.
23: Under additional
24: conditions on the loss functions (satisfied by the quadratic loss function) and
25: on the time
26: series, we  refine the rates of convergence to $\Delta_n \sim c(\Theta)/n$.
27: We achieve for
28: the first time these fast rates for 
29: uniformly mixing processes. These rates are known to be optimal in the iid case,
30: see \cite{TsybakovAgg},
31: and for individual sequences, see \cite{lugosi}.
32: In particular, we generalize the results of \cite{DT1}
33: on sparse regression estimation to the case of autoregression.
34: \end{abstract}