59ab6389049b6e81.tex
1: \begin{abstract} 
2:   Restricted Boltzmann Machines (RBMs) are general unsupervised
3:   learning devices to ascertain generative models of data
4:   distributions. RBMs are often trained using the Contrastive
5:   Divergence learning algorithm (CD), an approximation to the gradient
6:   of the data log-likelihood. A simple reconstruction error is often used
7:   to decide whether the approximation provided by the CD algorithm is
8:   good enough, though several authors
9:   \cite{schulz-et-al-Convergence-Contrastive-Divergence-2010-NIPSw,
10:     fischer-igel-Divergence-Contrastive-Divergence-2010-ICANN} have
11:   raised doubts concerning the feasibility of this procedure. However,
12:   not many alternatives to the reconstruction error have been used in
13:   the literature. In this manuscript we investigate simple
14:   alternatives to the reconstruction error in order to detect as soon
15:   as possible the decrease in the log-likelihood during learning.
16: \end{abstract}