2d3fc6263c279314.tex
1: \begin{abstract}
2: Motivated by recent developments in serverless systems for large-scale computation as well as improvements in scalable randomized matrix algorithms, we develop OverSketched Newton, a randomized Hessian-based optimization algorithm to solve large-scale convex optimization problems in serverless systems. 
3: OverSketched Newton leverages matrix sketching ideas from Randomized Numerical Linear Algebra to compute the Hessian approximately. 
4: These sketching methods lead to inbuilt resiliency against stragglers that are a characteristic of serverless architectures.
5: Depending on whether the problem is strongly convex or not, we propose different iteration updates using the approximate Hessian.
6: For both cases, we establish convergence guarantees for OverSketched Newton and  empirically validate our results by solving large-scale supervised learning problems on real-world datasets. 
7: Experiments demonstrate a reduction of ${\sim}50\%$ in total running time on AWS Lambda, compared to state-of-the-art distributed optimization schemes.
8: \end{abstract}
9: