d951a1b0cc58e791.tex
1: \begin{abstract}
2: Offline scheduling in Time Sensitive Networking
3: (TSN) utilizing the Time Aware Shaper (TAS) facilitates optimal
4: deterministic latency and jitter-bounds calculation for Time-
5: Triggered (TT) flows. However, the dynamic nature of traffic
6: in industrial settings necessitates a strategy for adaptively 
7: scheduling flows without interrupting existing schedules. Our research identifies critical gaps in current dynamic scheduling methods for TSN and introduces the novel GCN-TD3 approach. This novel approach utilizes a Graph Convolutional Network (GCN) for representing the various relations
8: within different components of TSN and employs the Twin
9: Delayed Deep Deterministic Policy Gradient (TD3) algorithm
10: to dynamically schedule any incoming flow.  Additionally, an
11: Integer Linear Programming (ILP) based offline scheduler is
12: used both to initiate the simulation and serve as a fallback
13: mechanism. This mechanism is triggered to recalculate the entire
14: schedule when the predefined threshold of Gate Control List(GCL) length exceeds.
15: Comparative analyses demonstrate that GCN-TD3 outperforms
16: existing methods like Deep Double Q-Network (DDQN) and Deep
17: Deterministic Policy Gradient (DDPG), exhibiting convergence
18: within 4000 epochs with a 90\% dynamic TT flow admission rate
19: while maintaining deadlines and reducing jitter to as low as 2us.
20: Finally, two modules were developed for the OMNeT++ simulator,
21: facilitating dynamic simulation to evaluate the methodology.
22: 
23: \end{abstract}
24: