1: \begin{abstract}

2: Long-text generation remains a challenge. 

3: The difficulty of generating

4: coherent

5:  long texts lies in the fact that existing  models overwhelmingly focus on the tasks of local word prediction, and cannot make high level plans on what to generate 

6: or capture the high-level discourse dependencies between chunks of texts. 

7: 

8: Inspired by how humans write, where a list of bullet points or a catalog is first outlined, and then 

9: each bullet point is  expanded to form the whole article, we propose 

10: {\it SOE}, 

11: a 

12: pipelined 

13: system tha involves 

14: of summarizing, outlining and elaborating

15:   for long text generation: 

16: the model first outlines the summaries for different segments of long texts, 

17: and then elaborates on each bullet point to generate the corresponding segment. 

18:  To avoid the  labor-intensive process of summary soliciting, 

19:   we propose the {\it reconstruction} strategy, which extracts 

20:  segment summaries 

21:  in an unsupervised manner 

22:  by selecting its most informative part to reconstruct the segment. 

23: 

24:   

25:   

26:  

27:   The proposed generation system  comes with the following merits: 

28: (1) the summary provides  high-level guidances for text generation and avoids  the local minimum of individual word predictions;

29: (2) the high-level discourse dependencies are captured in the 

30:   conditional dependencies between 

31:  summaries and are preserved during the summary expansion process and (3) additionally,  we are able to consider significantly more contexts by representing  contexts as concise summaries. 

32: 

33:  Extensive experiments demonstrate that SOE produces long texts with significantly better quality, 

34:   along with faster convergence speed. 

35:    \end{abstract}

36: