1: \begin{abstract}

2: We consider a class of hierarchical multi-agent optimization problems over networks where agents seek to compute an approximate solution to a single-stage stochastic mathematical program with equilibrium constraints (MPEC). MPECs subsume several important problem classes including Stackelberg games, bilevel programs, and traffic equilibrium problems, to name a few. Our goal in this work is to provably resolve stochastic MPECs in distributed regimes where the computing agents have only access to their local objectives as well as the information of the equilibrium constraints. To this end, we devise a new method called  {\it {\bf randomized smoothing distributed zeroth-order gradient tracking}} (rs-DZGT). This is a novel gradient tracking scheme where agents employ an inexact zeroth-order implicit scheme to approximate their (unavailable) local gradients. Leveraging properties of a randomized smoothing technique, we establish the convergence of the method and derive complexity guarantees for computing a stationary point to the minimization of a smoothed implicit global objective. We also provide preliminary numerical experiments where we compare the performance of rs-DZGT on networks under different settings with that of its centralized counterpart.

3: 

4: \end{abstract}

5: