1: \begin{abstract}

2:   Recurrent neural networks have shown remarkable success in modeling sequences. However low resource situations still adversely affect the generalizability of these models. We introduce a new family of models, called Lattice Recurrent Units (LRU), to address the challenge of learning deep multi-layer recurrent models with limited resources.

3:   LRU models achieve this goal by creating distinct (but coupled) flow of information inside the units: a first flow along time dimension and a second flow along depth dimension. It also offers a symmetry in how information can flow horizontally and vertically.

4:   We analyze the effects of decoupling three different components of our LRU model: \textit{Reset Gate}, \textit{Update Gate} and \textit{Projected State}. We evaluate this family of new LRU models on computational convergence rates and statistical efficiency.

5: Our experiments are performed on four publicly-available datasets, comparing with Grid-LSTM and Recurrent Highway networks. Our results show that LRU has better empirical computational convergence rates and statistical efficiency values, along with learning more accurate language models. 

6: \end{abstract}

7: