Lemmatization
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 0
- 보존된 평가 기록
- 0
Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.
Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Czech Text Processing with Contextual Embeddings: POS Tagging, Lemmatization, Parsing and NER
To lemmatize or not to lemmatize: how word normalisation affects ELMo performance in word sense disambiguation
Unsupervised Lemmatization as Embeddings-Based Word Clustering
Evaluating Contextualized Embeddings on 54 Languages in POS Tagging, Lemmatization and Dependency Parsing
UDPipe at SIGMORPHON 2019: Contextualized Embeddings, Regularization with Morphological Categories, Corpora Merging
Nefnir: A high accuracy lemmatizer for Icelandic
CMU-01 at the SIGMORPHON 2019 Shared Task on Crosslinguality and Context in Morphology
Development of email classifier in Brazilian Portuguese using feature selection for automatic response
Producing Corpora of Medieval and Premodern Occitan
A Simple Joint Model for Improved Contextual Neural Lemmatization
Training Data Augmentation for Context-Sensitive Neural Lemmatization Using Inflection Tables and Raw Text
Multilevel Text Normalization with Sequence-to-Sequence Networks and Multisource Learning
Improving Lemmatization of Non-Standard Languages with Joint Learning
Few-Shot and Zero-Shot Learning for Historical Text Normalization
Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks
Building a Lemmatizer and a Spell-checker for Sorani Kurdish
Towards JointUD: Part-of-speech Tagging and Lemmatization using Recurrent Neural Networks
Imitation Learning for Neural Morphological String Transduction
LemmaTag: Jointly Tagging and Lemmatizing for Morphologically-Rich Languages with BRNNs
Resource-Size matters: Improving Neural Named Entity Recognition with Optimized Large Corpora
Robustness of sentence length measures in written texts
Build Fast and Accurate Lemmatization for Arabic
Impact of Feature Selection on Micro-Text Classification
KeyXtract Twitter Model - An Essential Keywords Extraction Model for Twitter Designed using NLP Tools
SU-RUG at the CoNLL-SIGMORPHON 2017 shared task: Morphological Inflection with Attentional Sequence-to-Sequence Models
Synergistic Union of Word2Vec and Lexicon for Domain Specific Semantic Similarity
An Automated Text Categorization Framework based on Hyperparameter Optimization
Still not there? Comparing Traditional Sequence-to-Sequence Models to Encoder-Decoder Neural Networks on Monotone String Translation Tasks
Authorship Attribution Based on Life-Like Network Automata
An Analysis of Lemmatization on Topic Models of Morphologically Rich Language
Integrated Sequence Tagging for Medieval Latin Using Deep Representation Learning
A Publicly Available Cross-Platform Lemmatizer for Bulgarian
Evaluation of the Accuracy of the BGLemmatizer
Persian Sentiment Analyzer: A Framework based on a Novel Feature Selection Method
Non-Standard Words as Features for Text Categorization
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.