1: \begin{abstract}
2:
3: % Connectionist Temporal Classification (CTC) has gained significant traction for enhancing stable convergence in both Automatic Speech Recognition (ASR) and Speech Translation (ST) tasks.
4: % In this study, we introduce Bilingual CTC (BiL-CTC), an innovative framework that employs CTC to synchronously engage in cross-modal and cross-lingual predictions, where the transcript and translation serve as the respective labels.
5: % Leveraging recent advancements in CTC optimization yields a potential BiL-CTC+ model that achieves state-of-the-art results on the MuST-C ST benchmarks without the need for external data resources.
6: % We also find that our bilingual learning yields significant improvements in ASR performance.
7: % The code is available at \href{https://github.com/xuchennlp/S2T}{https://github.com/xuchennlp/S2T}.
8:
9: In this study, we present synchronous bilingual Connectionist Temporal Classification (CTC), an innovative framework that leverages dual CTC to bridge the gaps of both modality and language in the speech translation (ST) task.
10: Utilizing transcript and translation as concurrent objectives for CTC, our model bridges the gap between audio and text as well as between source and target languages.
11: Building upon the recent advances in CTC application, we develop an enhanced variant, BiL-CTC+, that establishes new state-of-the-art performances on the MuST-C ST benchmarks under resource-constrained scenarios.
12: Intriguingly, our method also yields significant improvements in speech recognition performance, revealing the effect of cross-lingual learning on transcription and demonstrating its broad applicability.
13: The source code is available at \href{https://github.com/xuchennlp/S2T}{https://github.com/xuchennlp/S2T}.
14:
15: \end{abstract}
16: