cf5a987b5baf68b0.tex
1: \begin{abstract}
2:   This work considers the problem of estimating the parameters of
3:   \emph{negative mixture models}, i.e. mixture models that possibly
4:   involve negative weights. The contributions of this paper are as
5:   follows. (i) We show that every rational probability distributions
6:   on strings, a representation which occurs naturally in spectral
7:   learning, can be computed by a negative mixture of at most two
8:   probabilistic automata (or HMMs).  (ii) We propose a method to
9:   estimate the parameters of negative mixture models having a specific
10:   tensor structure in their low order observable moments. Building
11:   upon a recent paper on tensor decompositions for learning latent variable models, 
12:   we extend this work to the broader setting
13:   of tensors having a symmetric decomposition with positive \emph{and
14:     negative} weights. We introduce a generalization of the
15:   \emph{tensor power method} for complex valued tensors, and establish
16:   theoretical convergence guarantees. (iii) We show how our approach
17:   applies to \emph{negative Gaussian mixture models}, for which we
18:   provide some experiments.
19: \end{abstract}
20: