1: \begin{abstract}

2: Multiway data analysis aims to uncover patterns in data structured as multi-indexed arrays, and the covariance of such data plays a crucial role in various machine learning applications. 

3: However, the intrinsically high dimension of multiway covariance presents significant challenges. 

4: To address these challenges, factorized covariance models have been proposed that rely on a separability assumption: the multiway covariance can be accurately expressed as a sum of Kronecker products of mode-wise covariances. 

5: This paper is concerned with the accuracy of such separable models for representing multiway covariances. 

6: We reduce the question of whether a given covariance can be represented as a separable multiway covariance to an equivalent question about separability of quantum states. 

7: Based on this equivalence, we establish that generic multiway covariances tend to be not separable.

8: Moreover, we show that determining the best separable approximation of a generic covariance is NP-hard. 

9: Our results suggest that factorized covariance models might not accurately approximate covariance, without additional assumptions ensuring separability. 

10: To balance these negative results, we propose an iterative Frank-Wolfe algorithm for computing Kronecker-separable covariance approximations with some additional side information. 

11: We establish an oracle complexity bound and empirically observe its consistent convergence to a separable limit point, often close to the ``best'' separable approximation. 

12: These results suggest that practical methods may be able to find a Kronecker-separable approximation of covariances, despite the worst-case NP hardness results.

13: 

14: \bigskip

15: \noindent

16: {\small 

17: \textbf{\textit{Keywords:}}

18: Multiway data, Separable covariance, Kronecker PCA, Low-rank covariance model, Tensor decomposition, Frank-Wolfe method

19: }

20: 

21: 

22: \end{abstract}

23: