1: \begin{abstract}

2:     Fast-converging algorithms are a contemporary requirement 

3:     in reinforcement learning. In the context of linear function 

4:     approximation, the magnitude of the smallest 

5:     eigenvalue of the key matrix is a major factor 

6:     reflecting the convergence speed. Traditional value-based 

7:     RL algorithms focus on minimizing errors.

8:     This paper introduces a variance minimization (VM) approach for value-based RL instead of error minimization.

9:     Based on this approach, we proposed two objectives, the Variance of Bellman Error (VBE) and the Variance of Projected Bellman Error (VPBE), and derived the VMTD, VMTDC, and VMETD algorithms.

10:     We provided proofs of their convergence and optimal policy invariance of the variance minimization.

11:     Experimental studies validate the effectiveness of the proposed algorithms.

12:     % Therefore, this paper proposes two new objective 

13:     % functions and derives three Variance Minimization (VM) algorithms, including VMTD, VMTDC, and VMETD.

14:     % A scalar parameter, $\omega$, is introduced, to improve the performance of parametric 

15:     % temporal difference learning algorithms.

16: 

17:     % In the policy evaluation experiment, two-state, 

18:     % we analyze 

19:     % the convergence speed of these algorithms by calculating the minimum eigenvalue of the key 

20:     % matrices both on-policy and off-policy.In controlled experiments, the VM algorithms demonstrate 

21:     % superior performance.

22: \end{abstract}

23: