1: \begin{abstract}

2:   In this paper, we propose an auto-encoder based generative neural

3:   network model whose encoder compresses the inputs into vectors in

4:   the tangent space of a special Lie group manifold: upper triangular

5:   positive definite affine transform matrices (UTDATs). UTDATs are

6:   representations of Gaussian distributions and can straightforwardly

7:   generate Gaussian distributed samples. Therefore, the encoder is

8:   trained together with a decoder (generator) which takes Gaussian

9:   distributed latent vectors as input. Compared with related

10:   generative models such as variational auto-encoder, the proposed

11:   model incorporates the information on geometric properties of

12:   Gaussian distributions. As a special case, we derive an exponential

13:   mapping layer for diagonal Gaussian UTDATs which eliminates matrix

14:   exponential operator compared with general exponential mapping in

15:   Lie group theory. Moreover, we derive an intrinsic loss for UTDAT

16:   Lie group which can be calculated as l-2 loss in the tangent

17:   space. Furthermore, inspired by the Lie group theory, we propose to

18:   use the Lie algebra vectors rather than the raw parameters

19:   (e.g. mean) of Gaussian distributions as compressed representations

20:   of original inputs. Experimental results verity the effectiveness of

21:   the proposed new generative model and the benefits gained from the

22:   Lie group structural information of UTDATs.

23: \end{abstract}

24: