1: \begin{abstract}

2:   Motivated by robotic surveillance applications, this paper studies the

3:   novel problem of maximizing the return time entropy of a Markov chain,

4:   subject to a graph topology with travel times and stationary

5:   distribution.  The return time entropy is the weighted average, over all

6:   graph nodes, of the entropy of the first return times of the Markov

7:   chain; this objective function is a function series that does not admit

8:   in general a closed form.

9: 

10:   The paper features theoretical and computational contributions.  First,

11:   we obtain a discrete-time delayed linear system for the return time

12:   probability distribution and establish its convergence properties. We

13:   show that the objective function is continuous over a compact set and

14:   therefore admits a global maximum; a unique globally-optimal solution is

15:   known only for complete graphs with unitary travel times.  We then

16:   establish upper and lower bounds between the return time entropy and the

17:   well-known entropy rate of the Markov chain.  To compute the optimal

18:   Markov chain numerically, we establish the asymptotic equality between

19:   entropy, conditional entropy and truncated entropy, and propose an

20:   iteration to compute the gradient of the truncated entropy. Finally, we

21:   apply these results to the robotic surveillance problem. Our numerical

22:   results show that, for a model of rational intruder over prototypical

23:   graph topologies and test cases, the maximum return time entropy chain

24:   performs better than several existing Markov chains.

25: \end{abstract}

26: