Speech-to-Text Translation

MuST-C currently represents the largest publicly available multilingual corpus (one-to-many) for speech translation. It covers eight language directions, from English to German, Spanish, French, Italian, Dutch, Portuguese, Romanian and Russian. The corpus consists of audio, transcriptions and translations of English TED talks, and it comes with a predefined training, validation and test split. Source: One-to-Many Multilingual End-to-End Speech Translation Image Source: https://mt.fbk.eu/must-c

CoVoST is a large-scale multilingual speech-to-text translation corpus. Its latest 2nd version covers translations from 21 languages into English and from English into 15 languages. It has total 2880 hours of speech and is diversified with 78K speakers and 66 accents. Source: CoVoST 2 and Massively Multilingual Speech-to-Text Translation

Kosp2e (read as `kospi'), is a corpus that allows Korean speech to be translated into English text in an end-to-end manner

MediBeng Dataset The MediBeng dataset contains synthetic code-switched dialogues in Bengali and English for training models in speech recognition (ASR), text-to-speech (TTS), and machine translation in clinical settings. The dataset is available under the CC-BY-4.0 license. - Access the dataset on Hugging Face. - For detailed instructions on dataset creation and storage, visit the GitHub Repository ### Dataset Details: - Number of Audio Files: 4800 - Total Duration: 7.11 hours - Number of Speakers: 2 (1 Male, 1 Female) - Utterance Pitch Mean: 335 - 673 Hz - Utterance Pitch Standard Deviation: 210 - 493 Hz - Sampling Rate: 16000 Hz - Data Split: Train and Test - Duration Range: 3.71s - 6.98s - Languages: Code-mixed Bengali-English - Gender Distribution: 1 Male, 1 Female - Total File Size: 324 MB - Speech Type: Medical-related - Data Type: Synthetic - Languages: Bengali, English - Tasks: ASR, TTS, Machine Translation - Context: Clinical (Healthcare) - License: CC-BY-4.0 ### MediBeng Dataset Columns - audio: Synthetic Bengali-English clinical conversations. - text: Code-switched Bengali-English conversations. - translation: English translation. - speaker_name: Speaker's gender (e.g., Male, Female). - utterance_pitch_mean: Mean pitch of the audio in Hertz (Hz). - utterance_pitch_std: Pitch variation (standard deviation in Hertz). ### Dataset Creation: 1. Audio Collection: Conversations in Bengali-English for healthcare. 2. Transcription: Code-switched sentences. 3. Translation: Code-switched sentences English translation. 4. Feature Engineering: Calculating pitch features. 5. Storage: Available in Parquet format on Hugging Face. ### Citation: bibtex @misc{promila_ghosh_2025, author = {Promila Ghosh}, title = {MediBeng (Revision b05b594)}, year = 2025, url = {https://huggingface.co/datasets/pr0mila-gh0sh/MediBeng}, doi = {10.57967/hf/5187}, publisher = {Hugging Face} }