2b616df90e81dc2e.tex
1: \begin{abstract}
2: We introduce a novel  method  for non-convex optimization which is  at the interface between the swarm-based gradient-descent (SBGD) \cite{eitan_2022,eitan_2023}, and Simulated Annealing (SA) \cite{vcerny1985thermodynamical,Kirkpatrick_1983,geman1986diffusions}. We follow the methodology of SBGD  in which a swarm of agents, each identified with a position, $\bx$ \emph{and} mass $m$, explores the ambient space. The  agents proceed in gradient descent direction, and are subject to Brownian motion with  annealing-rate dictated by a decreasing function of their mass. Thus, instead of the SA protocol for time-decreasing  temperature,  we let the swarm decide how to `cool down'  agents, depending on their accumulated mass over time.  The dynamics of masses is coupled with the dynamics of positions: agents  at higher ground transfer (part of) their mass to those at lower ground. Consequently, the swarm is dynamically divided between heavier, cooler agents viewed as `leaders'    and  lighter, warmer agents viewed as `explorers'. Mean-field convergence analysis and benchmark optimizations demonstrate the effectiveness of the swarm-based method as a multi-dimensional global optimizer.
3: \end{abstract}
4: