1: \begin{abstract}

2: %We present a comprehensive study of orbital optimization in selected configuration interaction plus perturbation theory (SCI+PT) methods, with applications to the semistochastic

3: %heatbath configuration interaction (SHCI) method.

4: We study several approaches to orbital optimization in selected configuration interaction plus perturbation theory (SCI+PT) methods, and test them on the ground and excited states of three molecules using the semistochastic

5: heatbath configuration interaction (SHCI) method. We discuss the ways in which the orbital optimization problem in SCI resembles and differs from that in multi-configurational self-consistent field (MCSCF).

6: Starting from natural orbitals, these approaches divide into three classes of optimization methods according to how they treat coupling between configuration interaction (CI) coefficients and orbital parameters, namely uncoupled, fully coupled, and quasi-fully coupled

7: methods. We demonstrate that taking the coupling into account is crucial for fast convergence and recommend two quasi-fully coupled

8: methods for such applications: accelerated diagonal Newton and Broyden-Fletcher-Goldfarb-Shanno (BFGS).

9: 

10: \end{abstract}