Papers with Code 아카이브
Lemmatization
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 0
- 보존된 평가 기록
- 0
Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.
Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/501Good/lexicon-enhanced-lemmatization
공식 코드Enhancing Sequence-to-Sequence Neural Lemmatization with External Resources
https://github.com/Aditi138/MorphologicalAnalysis
공식 코드CMU-01 at the SIGMORPHON 2019 Shared Task on Crosslinguality and Context in Morphology
https://github.com/INGEOTEC/microTC
공식 코드An Automated Text Categorization Framework based on Hyperparameter Optimization
https://github.com/NeldaKote/Albanian-POS
공식 코드Morphological Tagging and Lemmatization of Albanian: A Manually Annotated Corpus and Neural Models
https://github.com/OperaGraecaAdnotata/OGA
공식 코드A State-of-the-Art Morphosyntactic Parser and Lemmatizer for Ancient Greek
https://github.com/TickleForce/ancient-greek-datasets
공식 코드Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge Distillation
https://github.com/YerevaNN/JointUD
공식 코드Towards JointUD: Part-of-speech Tagging and Lemmatization using Recurrent Neural Networks
https://github.com/ZurichNLP/emnlp2018-imitation-learning-for-neural-morphology
공식 코드Imitation Learning for Neural Morphological String Transduction
https://github.com/arifusta/DBTagger
공식 코드https://github.com/bowphs/sigtyp-2024-hierarchical-transformers
공식 코드https://github.com/computationalstylistics/pl_lemmatization_in_attribution
공식 코드Stylistic Fingerprints, POS-tags and Inflected Languages: A Case Study in Polish
https://github.com/ddangelov/Top2Vec
공식 코드https://github.com/eblict-gigatech/BanLemma
공식 코드BanLemma: A Word Formation Dependent Rule and Dictionary Based Bangla Lemmatizer
https://github.com/emanjavacas/pie
공식 코드Improving Lemmatization of Non-Standard Languages with Joint Learning
https://github.com/emanjavacas/pie-data
공식 코드Improving Lemmatization of Non-Standard Languages with Joint Learning
https://github.com/emorynlp/elit
공식 코드https://github.com/emrecanacikgoz/mrl2022
공식 코드https://github.com/heidelberg-nlp/ancient-language-models
공식 코드https://github.com/hitz-zentroa/ses-lemma
공식 코드Evaluating Shortest Edit Script Methods for Contextual Lemmatization
https://github.com/huspacy/huspacy
공식 코드https://github.com/hyperparticle/LemmaTag
공식 코드LemmaTag: Jointly Tagging and Lemmatizing for Morphologically-Rich Languages with BRNNs
https://github.com/juditacs/deep-morphology
공식 코드The Role of Interpretable Patterns in Deep Learning for Morphology
https://github.com/kevinkrahn/ancient-greek-datasets
공식 코드Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge Distillation
https://github.com/kmccurdy/w2v-gender
공식 코드Grammatical gender associations outweigh topical gender bias in crosslinguistic word embeddings
https://github.com/ltgoslo/brent
공식 코드BRENT: Bidirectional Retrieval Enhanced Norwegian Transformer
https://github.com/mikahama/murre
공식 코드Lemmatization of Historical Old Literary Finnish Texts in Modern Orthography
https://github.com/mikahama/uralicNLP
공식 코드Neural Morphology Dataset and Models for Multiple Languages, from the Large to the Endangered
https://github.com/nlp-uoregon/trankit
공식 코드Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processing
https://github.com/openscilab/parsipy
공식 코드https://github.com/sebastian-nehrdich/byt5-sanskrit-analyzers
공식 코드One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP Tasks
https://github.com/shafieabdi/somalilemmatizer
공식 코드Lexicon and Rule-based Word Lemmatization Approach for the Somali Language
https://github.com/slavicnlp/slavicner
공식 코드https://github.com/soberqian/TopicModel4J
공식 코드https://github.com/stanfordnlp/stanza
공식 코드Stanza: A Python Natural Language Processing Toolkit for Many Human Languages
https://github.com/texttechnologylab/SemioGraph
공식 코드The Frankfurt Latin Lexicon: From Morphological Expansion and Word Embeddings to SemioGraphs
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.