1: \begin{abstract}
2: \textmd{Max weighted queue (MWQ) control policy is a widely used cross-layer
3: control policy that achieves queue stability and a reasonable delay
4: performance. In most of the existing literature, it is assumed that
5: optimal MWQ policy can be obtained instantaneously at every time slot.
6: However, this assumption may be unrealistic in time varying wireless
7: systems, especially when there is no closed-form MWQ solution and
8: iterative algorithms have to be applied to obtain the optimal solution.
9: This paper investigates the convergence behavior and the queue delay
10: performance of the conventional MWQ iterations in which the channel
11: state information (CSI) and queue state information (QSI) are changing
12: in a similar timescale as the algorithm iterations. Our results are
13: established by studying the stochastic stability of an equivalent
14: virtual stochastic dynamic system (VSDS), and an extended Foster-Lyapunov
15: criteria is applied for the stability analysis. We derive a closed
16: form delay bound of the wireless network in terms of the CSI fading
17: rate and the sensitivity of MWQ policy over CSI and QSI. Based on
18: the equivalent VSDS, we propose a novel MWQ iterative algorithm with
19: compensation to improve the tracking performance. We demonstrate that
20: under some mild conditions, the proposed modified MWQ algorithm converges
21: to the optimal MWQ control despite the time-varying CSI and QSI. }
22: \end{abstract}
23: