Language Modelling
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 6
- 평가표
- 55
- 보존된 평가 기록
- 466
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/prakhar21/textaugmentation-gpt2
https://github.com/pranav-ust/nlm
https://github.com/pranay185417/delight
https://github.com/pranjalg96/Stylized-Image-captioning
https://github.com/prannaykaul/mm-ovod
Multi-Modal Classifiers for Open-Vocabulary Object Detection
https://github.com/prasanns/rlhf-length-biases
RLCD: Reinforcement Learning from Contrastive Distillation for Language Model Alignment
https://github.com/prashil2792/Question-Answering-System-Deep-Learning
https://github.com/prateekstark/retnet
Retentive Network: A Successor to Transformer for Large Language Models
https://github.com/prathameshza/TrOCR_FineTuning
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models
https://github.com/pravitc/Neural-style-transfer-using-Pytorch
https://github.com/princeton-nlp/SWE-bench
SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
https://github.com/princeton-nlp/SimCSE
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
https://github.com/princeton-nlp/mabel
An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models
https://github.com/princeton-nlp/unintentional-unalignment
Discovering Language Model Behaviors with Model-Written Evaluations
https://github.com/printfer/CS6490_NetworkSecurity_FinalProject
https://github.com/prithviraj-maurya/alexa-point-of-view-dataset
Converting the Point of View of Messages Spoken to Virtual Assistants
https://github.com/proger/hippogriff
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models
https://github.com/projeto-de-algoritmos/Grafos1_Joao_Lucas_Leonardo_Miranda
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
https://github.com/prolearner/hypertorch
https://github.com/proroklab/popgym
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
https://github.com/protllm/protllm
ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Training
https://github.com/pswaldia/NeuralStyleTransfer
https://github.com/pswietojanski/slurp
https://github.com/ptillet/torch-blocksparse
https://github.com/puerrrr/focal-infonce
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
https://github.com/punica-ai/punica
https://github.com/purduedigitaltwin/talk2drive
Personalized Autonomous Driving with Large Language Models: Field Experiments
https://github.com/pwang724/neural-style-transfer
https://github.com/pwc-1/Paper-10/tree/main/speech_encoder_decoder
A Comparison of Techniques for Language Model Integration in Encoder-Decoder Speech Recognition
https://github.com/pwc-1/Paper-10/tree/main/switch_transformers
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
https://github.com/pwc-1/Paper-10/tree/main/tinybert
TinyBERT: Distilling BERT for Natural Language Understanding
https://github.com/pwc-1/Paper-10/tree/main/transformer
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
https://github.com/pwc-1/Paper-10/tree/main/trocr
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models
https://github.com/pwc-1/Paper-5/tree/main/megatron_bert
Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM
https://github.com/pwc-1/Paper-5/tree/main/mistral
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.