1: \begin{abstract}

2: This paper considers a cross-layer optimization problem driven by

3: multi-timescale stochastic exogenous processes in wireless communication

4: networks. Due to the hierarchical information structure in a wireless

5: network, a mixed timescale stochastic iterative algorithm is proposed

6: to track the time-varying optimal solution of the cross-layer optimization

7: problem, where the variables are partitioned into short-term controls

8: updated in a faster timescale, and long-term controls updated in a

9: slower timescale. We focus on establishing a convergence analysis

10: framework for such multi-timescale algorithms, which is difficult

11: due to the timescale separation of the algorithm and the time-varying

12: nature of the exogenous processes. To cope with this challenge, we

13: model the algorithm dynamics using stochastic differential equations

14: (SDEs) and show that the study of the algorithm convergence is equivalent

15: to the study of the stochastic stability of a virtual stochastic dynamic

16: system (VSDS). Leveraging the techniques of Lyapunov stability, we

17: derive a sufficient condition for the algorithm stability and a tracking

18: error bound in terms of the parameters of the multi-timescale exogenous

19: processes. Based on these results, an adaptive compensation algorithm

20: is proposed to enhance the tracking performance. Finally, we illustrate

21: the framework by an application example in wireless heterogeneous

22: network. \end{abstract}

23: