Language Modelling
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 6
- 평가표
- 55
- 보존된 평가 기록
- 466
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/jmichaelov/does-surprisal-explain-n400
https://github.com/jmtomczak/vae_householder_flow
https://github.com/joe-prog/https-github.com-facebookresearch-ParlAI
The Goldilocks Principle: Reading Children's Books with Explicit Memory Representations
https://github.com/joelsimonoff/gram-adversary-detection
https://github.com/joelweber97/Python3_TF_Certificate
Universal Language Model Fine-tuning for Text Classification
https://github.com/joey00072/Neural-Style-Transfer-in-Pytorch
https://github.com/joeynmt/joeynmt
https://github.com/joez17/chatbridge
ChatBridge: Bridging Modalities with Large Language Model as a Language Catalyst
https://github.com/johngull/gradinit
GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training
https://github.com/johnhw/differentiable_sorting
https://github.com/johnma2006/mamba-minimal
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
https://github.com/jojonki/MemoryNetworks
https://github.com/jojonki/MultiWOZ-Parser
Large-Scale Multi-Domain Belief Tracking with Knowledge Sharing
https://github.com/jolinxql/LSTM
https://github.com/jonahwinninghoff/Text-Summarization
https://github.com/jondurbin/airoboros
Self-Instruct: Aligning Language Models with Self-Generated Instructions
https://github.com/jonjoncardoso/jonjoncardoso
Very Large Language Model as a Unified Methodology of Text Mining
https://github.com/jonny4929/PaddleSeg_espnetv2
ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network
https://github.com/jonthegeek/stylex
https://github.com/joonasrooben/NLP-text2emoji
https://github.com/josephch405/curriculum-nmt
Improving Neural Machine Translation Models with Monolingual Data
https://github.com/josephdviviano/lstm-variational-dropout
A Theoretically Grounded Application of Dropout in Recurrent Neural Networks
https://github.com/joshuaWang-bit/Textclassification-pytorch
XLNet: Generalized Autoregressive Pretraining for Language Understanding
https://github.com/jowitapodolak/finetuning_BERT_NER
https://github.com/joytianya/google_bert
https://github.com/jpablou/Matching-The-Blanks-Ths
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
https://github.com/jparkhill/TensorMol
https://github.com/jquesnelle/scaled-rope
SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling
https://github.com/jquesnelle/yarn
SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling
https://github.com/jraiskin/arxiv2kindle_pdf
https://github.com/jsbaan/DPAC-DialogueGAN
https://github.com/jsie7/ssm-benchmark
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
https://github.com/jsleep/wav2mid
https://github.com/jsuarez5341/Efficient-Dynamic-Batching
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
https://github.com/jtiger958/style-transfer-pytorch
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.