3b36d3a2e0ad24b1.tex
1: \begin{abstract}
2: 	\noindent
3: %	Particle Swarm Optimization is a renowned multi-agent metaheuristic optimization algorithm capable of minimizing nonsmooth and nonconvex functions in high dimensions without the use of gradient information. %27 words
4: 	In this paper we provide a rigorous convergence analysis for the renowned particle swarm optimization method by using tools from stochastic calculus and the analysis of partial differential equations. %30 words
5: 	Based on a time-continuous formulation of the particle dynamics as a system of stochastic differential equations, we establish convergence to a global minimizer of a possibly nonconvex and nonsmooth objective function in two steps. %34 words
6: 	First, we prove consensus formation of an associated mean-field dynamics by analyzing the time-evolution of the variance of the particle distribution. %23 words
7: 	We then show that this consensus is close to a global minimizer by employing the asymptotic Laplace principle and a tractability condition on the energy landscape of the objective function. %30 words
8: 	These results allow for the usage of memory mechanisms, and hold for a rich class of objectives provided certain conditions of well-preparation of the hyperparameters and the initial datum. %29 words
9: 	In a second step, at least for the case without memory effects, we provide a quantitative result about the mean-field approximation  of particle swarm optimization, which specifies the convergence of the interacting particle system to the associated mean-field limit. %41 words
10: 	Combining these two results allows for global convergence guarantees of the numerical particle swarm optimization method with provable polynomial complexity. %20 words
11: 	To demonstrate the applicability of the method we propose an efficient and parallelizable implementation, which is tested in particular on a competitive and well-understood high-dimensional benchmark problem in machine learning. %31 words
12: \end{abstract}\