Language Modelling
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 6
- 평가표
- 55
- 보존된 평가 기록
- 466
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/oleehyo/texteller
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models
https://github.com/om00839/machine-suneung
Multi-Task Deep Neural Networks for Natural Language Understanding
https://github.com/omerbsezer/NeuralStyleTransfer
https://github.com/omerlux/NLP-PTB
Breaking the Softmax Bottleneck: A High-Rank RNN Language Model
https://github.com/omerlux/Recurrent_Neural_Network_-_Part_2
Breaking the Softmax Bottleneck: A High-Rank RNN Language Model
https://github.com/oneflow-inc/libai
https://github.com/onehaitao/R-BERT-relation-extraction
Enriching Pre-trained Language Model with Entity Information for Relation Classification
https://github.com/oneil512/lstmn
https://github.com/ongunuzaymacar/comparatively-finetuning-bert
https://github.com/onlplab/rvs
Into the Unknown: Generating Geospatial Descriptions for New Environments
https://github.com/onurboyar/RecommenderSystems
https://github.com/oooranz/baby-cothought
https://github.com/oootttyyy/webarena
Hierarchical Prompting Assists Large Language Model on Web Navigation
https://github.com/open-finance-lab/finlora
https://github.com/open-mmlab/mmclassification
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
https://github.com/open-mmlab/mmrazor
https://github.com/open3da/ll3da
https://github.com/openaccess-ai-collective/axolotl
Continual Pre-Training of Large Language Models: How to (re)warm your model?
https://github.com/openai/gpt-2
https://github.com/openai/transformer-debugger
Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small
https://github.com/openbiolink/promptsource
https://github.com/openbmb/bminf
CPM: A Large-scale Generative Chinese Pre-trained Language Model
https://github.com/openbmb/debater
https://github.com/openbmb/eurus
Noise Contrastive Alignment of Language Models with Explicit Rewards
https://github.com/openbmb/minicpm-v
Large Multilingual Models Pivot Zero-Shot Multimodal Learning across Languages
https://github.com/openbmb/ultrafeedback
UltraFeedback: Boosting Language Models with Scaled AI Feedback
https://github.com/opencausalab/clear
https://github.com/opendilab/DI-engine
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context
https://github.com/opengptx/lm-evaluation-harness
https://github.com/opengvlab/internimage
Uni-Perceiver v2: A Generalist Model for Large-Scale Vision and Vision-Language Tasks
https://github.com/opengvlab/internvl-mmdetseg
InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks
https://github.com/opengvlab/multi-modality-arena
https://github.com/openlmlab/leval
https://github.com/openlmlab/moss
CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis
https://github.com/openmedlab/pulse
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.