Language Modelling
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 6
- 평가표
- 55
- 보존된 평가 기록
- 466
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/fixie-ai/ultravox
https://github.com/fkodom/dilated-attention-pytorch
https://github.com/fkodom/grouped-query-attention-pytorch
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
https://github.com/fkodom/yet-another-retnet
https://github.com/flagai-open/aquila2
https://github.com/flagalpha/llama2-chinese
https://github.com/flagopen/flaginstruct
Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor
https://github.com/flairNLP/flair
https://github.com/flexible-fl/flex-nlp
https://github.com/float256/rectified-adam-keras
https://github.com/floleuerer/fastai_ulmfit
Universal Language Model Fine-tuning for Text Classification
https://github.com/floraxinru/HotelReviews_SentimentAnalysis
Universal Language Model Fine-tuning for Text Classification
https://github.com/floraxinru/NLP_HotelReviews
Universal Language Model Fine-tuning for Text Classification
https://github.com/flowersteam/lamorel
https://github.com/floydhub/word-language-model
https://github.com/flukeskywalker/highway-networks
https://github.com/flyingpumba/interpbench
Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small
https://github.com/flyliu2017/bert
https://github.com/flyliu2017/bert_modularized
https://github.com/flymin/darts
https://github.com/foamliu/Listen-Attend-Spell
https://github.com/foamliu/Listen-Attend-Spell-v2
https://github.com/foamliu/Listen-Attend-and-Spell
https://github.com/for-ai/language-confusion
Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning
https://github.com/forgi86/lru-reduction
Efficiently Modeling Long Sequences with Structured State Spaces
https://github.com/formulamonks/llm-benchmarker-suite
https://github.com/foundation-model-stack/fms-fsdp
https://github.com/francescodisalvo05/66DaysOfData
https://github.com/francescoperiti/chatgptvbert
https://github.com/francescoperiti/cssdetection
https://github.com/frankcgq105/BERTCHEN
https://github.com/franknb/Text-Summarization
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
https://github.com/frankxwang/dpo-prefix-sharing
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
https://github.com/freds0/data_augmentation_for_asr
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
https://github.com/fredxlpy/cross_lingual_prompt_tuning
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.