1: \begin{abstract}

2: Recent advances in deep learning show that end-to-end speech to text translation model is a promising approach to direct the speech translation field. 

3: In this work, we provide an overview of different end-to-end architectures,

4: as well as the usage of an auxiliary connectionist temporal classification (CTC) loss for better convergence.

5: We also investigate on pre-training variants such as initializing different components of a model using pretrained models, and their impact on the final performance, which gives boosts up to 4\% in \BLEU and 5\% in \TER. 

6: Our experiments are performed on 270h IWSLT TED-talks En$\to$De, and 100h LibriSpeech Audio-books En$\to$Fr.

7: We also show improvements over the current end-to-end state-of-the-art systems on both tasks.

8: \end{abstract}

9: