1: \begin{abstract}

2: Recurrent Neural Networks (RNN) have recently achieved the best performance in off-line Handwriting Text Recognition.

3: At the same time, learning RNN by gradient descent

4: leads to slow convergence, 

5: and training times are particularly long

6: when the training database consists of full lines of text.

7: In this paper, we propose an easy way

8: to accelerate stochastic gradient descent in this set-up,

9: and in the general context of learning to recognize sequences.

10: The principle is called Curriculum Learning, or shaping.

11: The idea is to first learn to recognize short sequences before training on all available training sequences.

12: Experiments on three different handwritten text databases (Rimes, IAM, OpenHaRT) show that

13: a simple implementation of this strategy

14: can significantly speed up the training of RNN for Text Recognition,

15: and even significantly improve performance in some cases.

16: 

17: 

18: \end{abstract}

19: