1: \begin{abstract}

2: Measuring the relationship between any \emph{pair} of variables is a rich and active area of research that is central to scientific practice. In contrast, characterizing the common information among any \emph{group} of variables is typically a theoretical exercise with few practical methods for high-dimensional data.

3: A promising solution would be a multivariate generalization of the famous Wyner common information, but this approach relies on solving an apparently intractable optimization problem. 

4: We leverage the recently introduced information sieve decomposition to formulate an incremental version of the common information problem that admits a simple fixed point solution, fast convergence, and complexity that is linear in the number of variables. 

5: This scalable approach allows us to demonstrate the usefulness of common information in high-dimensional learning problems.

6: The sieve outperforms standard methods on dimensionality reduction tasks, solves 

7: a blind source separation problem that cannot be solved with ICA, and accurately recovers structure in brain imaging data. 

8: \end{abstract}

9: