d0291cf7f923710b.tex
1: \begin{abstract}
2: Distributed nonconvex optimization problems underlie many applications in learning and autonomy, and 
3: such problems commonly face asynchrony in agents' computations and communications. 
4: When delays in these operations are bounded, they are called \emph{partially asynchronous}. 
5: In this paper, we present an uncoordinated stepsize selection rule for partially asynchronous block coordinate descent that only requires local 
6: information to implement, and it
7: leads to faster convergence for a class of nonconvex problems than existing stepsize rules, which 
8: require global information in some form.
9: The problems we consider satisfy the error bound condition, and
10: %Existing rules require each agent in a network to use a single, global stepsize, which must be 
11: %chosen according to some upper bound depending on the Lipschitz constant of the gradient of the 
12: %objective function, the number of agents, and the maximum communication delay or time between 
13: %computations of any agent in the system. 
14: %In large-scale systems, it may not be reasonable to assume that agents have access to this 
15: %information, and in practice this formulation leads to conservatively
16: %small stepsizes, which slows algorithm convergence. 
17: the stepsize rule we present 
18: only requires each agent to know (i) a certain type of Lipschitz constant of its block of the gradient of the objective and (ii) 
19: the communication delays experienced between it and its neighbors. 
20: This formulation requires less information to be available to each agent than existing approaches, typically allows for agents to use much larger 
21: stepsizes, and alleviates the impact of stragglers while still guaranteeing convergence to a stationary point. 
22: Simulation results provide comparisons and validate the faster convergence attained by the stepsize rule we develop. 
23: \end{abstract}
24: