f6a6de63eeb499aa.tex
1: \begin{abstract}
2: In this paper we show that the computational complexity of the \ac{itkrm} algorithm for dictionary learning can be significantly reduced by using dimensionality-reduction techniques based on the Johnson-Lindenstrauss lemma. The dimensionality reduction is efficiently carried out with the fast Fourier transform. We introduce the \ac{ictkm} algorithm for fast dictionary learning and study its convergence properties. We show that \ac{ictkm} can locally recover an incoherent, overcomplete generating dictionary of $\natoms$ atoms from training signals of sparsity level $\sparsity$ with high probability. Fast dictionary learning is achieved by embedding the training data and the dictionary into $\jlembeddingdim < \ddim$ dimensions, and recovery is shown to be locally stable with an embedding dimension which scales as low as $m = O(\sparsity \log^4\sparsity \log^3 \natoms)$. The compression effectively shatters the data dimension bottleneck in the computational cost of \ac{itkrm}, reducing it by a factor $O(m/d)$.
3: Our theoretical results are complemented with numerical simulations which demonstrate that \ac{ictkm} is a powerful, low-cost algorithm for learning dictionaries from high-dimensional data sets.
4:  \end{abstract}
5: