1: \begin{abstract}

2: Current training methods for deep neural networks boil down to very high dimensional and

3: non-convex optimization problems which are usually solved by a wide range of

4: stochastic gradient descent methods. While these approaches tend to work 

5: in practice, there are still many gaps in the theoretical understanding of key aspects like 

6: convergence and generalization guarantees, which are induced by the properties of the optimization surface (loss landscape).

7: In order to gain deeper insights, a number of recent publications proposed methods to visualize and analyze the optimization surfaces. 

8: However, the computational cost of these methods are very high, making it hardly possible to use them on larger networks.\\    

9: In this paper, we present the GradVis Toolbox, an open source library for efficient and scalable visualization and analysis of deep neural network

10: loss landscapes in Tensorflow and PyTorch. Introducing more efficient mathematical formulations and a novel parallelization scheme, GradVis

11: allows to plot 2d and 3d projections of optimization surfaces and trajectories, as well as high resolution second order gradient information for large networks. 

12: \end{abstract}

13: