https://github.com/AI4Bharat/IndicXlit
공식 코드Aksharantar: Open Indic-language Transliteration datasets and models for the Next Billion Users
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Transliteration is a mechanism for converting a word in a source (foreign) language to a target language, and often adopts approaches from machine translation. In machine translation, the objective is to preserve the semantic meaning of the utterance as much as possible while following the syntactic structure in the target language. In Transliteration, the objective is to preserve the original pronunciation of the source word as much as possible while following the phonological structures of the target language.
For example, the city’s name “Manchester” has become well known by people of languages other than English. These new words are often named entities that are important in cross-lingual information retrieval, information extraction, machine translation, and often present out-of-vocabulary challenges to spoken language technologies such as automatic speech recognition, spoken keyword search, and text-to-speech.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Aksharantar: Open Indic-language Transliteration datasets and models for the Next Billion Users
Universal Dependency Parsing for Hindi-English Code-switching
Leveraging Multilingual News Websites for Building a Kurdish Parallel Corpus
Towards Offensive Language Identification for Tamil Code-Mixed YouTube Comments and Posts
DeepScribe: Localization and Classification of Elamite Cuneiform Signs Via Deep Learning
Specializing Multilingual Language Models: An Empirical Study
Processing South Asian Languages Written in the Latin Script: the Dakshina Dataset
Beyond Arabic: Software for Perso-Arabic Script Manipulation
XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages
Sequence-to-sequence neural network models for transliteration
A Multi-cascaded Deep Model for Bilingual SMS Classification
Universal Dependency Parsing for Hindi-English Code-switching
Multilingual Text-to-Speech Synthesis for Turkic Languages Using Transliteration
Cross-Lingual Text Classification of Transliterated Hindi and Malayalam
Sinhala Transliteration: A Comparative Analysis Between Rule-based and Seq2Seq Approaches
Can Small Language Models Learn, Unlearn, and Retain Noise Patterns?
Sub-Character Tokenization for Chinese Pretrained Language Models
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.