1: \begin{abstract}

2: Mobile edge computing (MEC) is a promising paradigm for real-time applications with intensive computational needs (e.g., autonomous driving), as it can reduce the processing delay.

3: {In this work, we focus on the timeliness of computational-intensive updates, measured by \textit{Age-of-Information (AoI)}, and study how to jointly optimize the task updating and offloading  policies for AoI with fractional form.

4: % , and study how to jointly optimize the task updating and offloading  policies in MEC.}

5: Specifically, we consider edge load dynamics and formulate a task scheduling problem to minimize the expected time-average AoI.

6: The uncertain edge load dynamics, the nature of the fractional objective, and hybrid continuous-discrete action space {(due to the joint optimization)} make this problem challenging and existing approaches not directly applicable. 

7: To this end, we propose a fractional reinforcement learning (RL) framework 

8: and prove its convergence. 

9: We further design a model-free fractional deep RL (DRL) algorithm, where each device makes scheduling decisions with the hybrid action space without knowing the system dynamics and decisions of other devices. 

10: % This proposed algorithm incorporates dueling double deep Q-network (D3QN) and deep deterministic policy gradient (DDPG) to handle the hybrid action space. 

11: %\revr{Experimental results show that our proposed algorithms reduce the average AoI {by up to $67.4\%$}

12: \revr{Experimental results show that our proposed algorithms reduce the average AoI {by up to $57.6\%$}}

13:  compared with several non-fractional benchmarks.} %, including one with similar neural networks.

14: \end{abstract}

15: