Lemmatization
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 0
- 보존된 평가 기록
- 0
Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.
Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
ParsiPy: NLP Toolkit for Historical Persian Texts in Python
Breaking the Fake News Barrier: Deep Learning Approaches in Bangla Language
Context Aware Lemmatization and Morphological Tagging Method in Turkish
GliLem: Leveraging GliNER for Contextualized Lemmatization in Estonian
SinaTools: Open Source Toolkit for Arabic Natural Language Processing
A State-of-the-Art Morphosyntactic Parser and Lemmatizer for Ancient Greek
A Comparative Study of Hybrid Models in Health Misinformation Text Classification
One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP Tasks
ACE-2005-PT: Corpus for Event Extraction in Portuguese
eFontes. Part of Speech Tagging and Lemmatization of Medieval Latin Texts.A Cross-Genre Survey
Open-Source Web Service with Morphological Dictionary-Supplemented Deep Learning for Morphosyntactic Analysis of Czech
Recent advancements in computational morphology : A comprehensive survey
Heidelberg-Boston @ SIGTYP 2024 Shared Task: Enhancing Low-Resource Language Analysis With Character-Aware Hierarchical Transformers
Joint Lemmatization and Morphological Tagging with LEMMING
Comparison of Current Approaches to Lemmatization: A Case Study in Estonian
TartuNLP @ SIGTYP 2024 Shared Task: Adapting XLM-RoBERTa for Ancient and Historical Languages
Opera Graeca Adnotata: Building a 34M+ Token Multilayer Corpus for Ancient Greek
Cross-lingual Named Entity Corpus for Slavic Languages
ZAEBUC-Spoken: A Multilingual Multidialectal Arabic-English Speech Corpus
Evaluating Shortest Edit Script Methods for Contextual Lemmatization
BanLemma: A Word Formation Dependent Rule and Dictionary Based Bangla Lemmatizer
The effect of stemming and lemmatization on Portuguese fake news text classification
Advancing Hungarian Text Processing with HuSpaCy: Efficient and Accurate NLP Pipelines
Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge Distillation
Lexicon and Rule-based Word Lemmatization Approach for the Somali Language
Vacaspati: A Diverse Corpus of Bangla Literature
Hybrid lemmatization in HuSpaCy
Exploring Large Language Models for Classical Philology
Advancing Full-Text Search Lemmatization Techniques with Paradigm Retrieval from OpenCorpora
LatinCy: Synthetic Trained Pipelines for Latin NLP
BRENT: Bidirectional Retrieval Enhanced Norwegian Transformer
Exploring the Use of Foundation Models for Named Entity Recognition and Lemmatization Tasks in Slavic Languages
On the Role of Morphological Information for Contextual Lemmatization
Automated Identification of Disaster News For Crisis Management Using Machine Learning
H2-Golden-Retriever: Methodology and Tool for an Evidence-Based Hydrogen Research Grantsmanship
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.