1: \begin{abstract}

2: \gls{iot} devices are available in a multitude of scenarios, and provide constant, contextual data which can be leveraged to automatically reconfigure and optimize smart environments. To realize this vision, \gls{ai} and deep learning techniques are usually employed, however they need large quantity of data which is often not feasible in \gls{iot} scenarios. \glspl{dt} have recently emerged as an effective way to replicate physical entities in the digital domain, to allow for simulation and testing of models and services. In this paper, we present a novel architecture based on the emerging \gls{wot} standard, which provides a \gls{dt} of a smart environment and applies \gls{drl} techniques on real time data. We implement our system in a real deployment, and test it along with a legacy system. Our findings show that the benefits of having a digital twin, specifically for \gls{drl} models, allow for faster convergence and finer tuning.

3: \end{abstract}

4: