8787dcd8176eba5b.tex
1: \begin{abstract}
2:     Optimization problems, arise in many practical applications, from the view points of both theory and numerical methods. Especially, significant improvement in deep learning training came from the Quasi-Newton methods. Quasi-Newton search directions provide an attractive alternative to Newton's method in that they do not require computation of the Hessian and yet still attain a superlinear rate of convergence. In Quasi-Newton method,  we require Hessian approximation to satisfy  the secant equation.  In this paper,  the Classical Cauchy-Schwartz Inequality is introduced, then more generalization are proposed. And it is seriously proved that  Quasi-Newton method is a steepest descent method under the ellipsoid norm.
3: \end{abstract}