1: \begin{abstract}

2: %Managing risk in dynamic decision problems is of cardinal importance in many fields such as finance

3: %and process control. Popular approaches to defining risk are through various variance related criteria such as the Sharpe Ratio or the standard deviation adjusted reward.

4: In this paper we extend temporal difference policy evaluation algorithms to performance criteria that include the variance of the cumulative reward. Such criteria are useful for risk management, and are important in domains such as finance

5: and process control. We propose both TD(0) and LSTD($\lambda$) variants with linear function approximation, prove their convergence, and demonstrate their utility in a 4-dimensional continuous state space problem.

6: \end{abstract}

7: