Lemmatization
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 0
- 보존된 평가 기록
- 0
Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.
Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Development of a rule-based lemmatization algorithm through Finite State Machine for Uzbek language
Arabic Word-level Readability Visualization for Assisted Text Simplification
Social Media Personal Event Notifier Using NLP and Machine Learning
Knowledge Authoring with Factual English
Context based lemmatizer for Polish language
TArC: Tunisian Arabish Corpus First complete release
Stylistic Fingerprints, POS-tags and Inflected Languages: A Case Study in Polish
Abusive and Threatening Language Detection in Urdu using Supervised Machine Learning and Feature Combinations
The 2021 Urdu Fake News Detection Task using Supervised Machine Learning and Feature Combinations
HuSpaCy: an industrial-strength Hungarian natural language processing toolkit
ELIT: Emory Language and Information Toolkit
POS tagging, lemmatization and dependency parsing of West Frisian
Lemmatization of Historical Old Literary Finnish Texts in Modern Orthography
A Case Study of Spanish Text Transformations for Twitter Sentiment Analysis
Neural Morphology Dataset and Models for Multiple Languages, from the Large to the Endangered
Named Entity Recognition and Linking Augmented with Large-Scale Structured Data
On the Effectiveness of Dataset Embeddings in Mono-lingual,Multi-lingual and Zero-shot Conditions
Enhancing Sequence-to-Sequence Neural Lemmatization with External Resources
Constraint 2021: Machine Learning Models for COVID-19 Fake News Detection Shared Task
DBTagger: Multi-Task Learning for Keyword Mapping in NLIDBs Using Bi-Directional Recurrent Neural Networks
Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processing
The Role of Interpretable Patterns in Deep Learning for Morphology
CURE: Collection for Urdu Information Retrieval Evaluation and Ranking
TopicModel4J: A Java Package for Topic Models
LemMED: Fast and Effective Neural Morphological Analysis with Short Context Windows
Top2Vec: Distributed Representations of Topics
UDPipe at EvaLatin 2020: Contextualized Embeddings and Treebank Embeddings
The Frankfurt Latin Lexicon: From Morphological Expansion and Word Embeddings to SemioGraphs
Grammatical gender associations outweigh topical gender bias in crosslinguistic word embeddings
Neural Polysynthetic Language Modelling
A Resource for Studying Chatino Verbal Morphology
Stanza: A Python Natural Language Processing Toolkit for Many Human Languages
Morphological Tagging and Lemmatization of Albanian: A Manually Annotated Corpus and Neural Models
The SIGMORPHON 2019 Shared Task: Morphological Analysis in Context and Cross-Lingual Transfer for Inflection
ÚFAL MRPipe at MRP 2019: UDPipe Goes Semantic in the Meaning Representation Parsing Shared Task
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.