1: \begin{abstract}

2: %There are different methods of solving unconstrained optimization problems, but there have been disparities in convergence speed for most of these methods. First-order methods such as the steepest descent method are very common in solving unconstrained problems but second-order methods such as the Newton-type methods enable faster convergence especially for quadratic functions. In this paper, we compare and analyse first and second order iterative methods in solving two unconstrained problems that are associated with a class of Rosenbrock functions where one function is a perturbed form of another. We also explore the advantages and disadvantages of the steepest descent, Newton, and Conjugate gradient methods in terms of their convergence attributes and trade-offs involved while comparing these methods.

3: This paper gives an in-depth review of the most common iterative methods for unconstrained optimization using two functions that belong to a class of Rosenbrock functions as a performance test. This study covers the Steepest Gradient Descent Method, the Newton-Raphson Method, and the Fletcher-Reeves

4: Conjugate Gradient method. In addition, four different step-size selecting methods including fixed-step-size, variable step-size, quadratic-fit, and golden section method were considered. Due to the computational nature of solving minimization problems, testing the algorithms is an essential part of this paper. Therefore, an extensive set of numerical test results is also provided to present an insightful and a comprehensive comparison of the reviewed algorithms. This study highlights the differences and the trade-offs involved in comparing these algorithms.

5:  \end{abstract}

6: