1: $

2: This will lead to the geometric convergence of the parallel update, or $