Language Modelling
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 6
- 평가표
- 55
- 보존된 평가 기록
- 466
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/EleutherAI/GPTNeo
The Pile: An 800GB Dataset of Diverse Text for Language Modeling
https://github.com/EleutherAI/gpt-neo
https://github.com/EleutherAI/lm-evaluation-harness
https://github.com/EleutherAI/lm_evaluation_harness
https://github.com/EmergentSystemLabStudent/SpCoSLAM
Online Spatial Concept and Lexical Acquisition with Simultaneous Localization and Mapping
https://github.com/EmergentSystemLabStudent/SpCoSLAM_Lets
Online Spatial Concept and Lexical Acquisition with Simultaneous Localization and Mapping
https://github.com/EmilReinert/DeepLearningPipelines
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
https://github.com/EmilyAlsentzer/clinicalBERT
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
https://github.com/Entropy-xcy/bitnet158
BitNet: Scaling 1-bit Transformers for Large Language Models
https://github.com/EthanCoder24/Protofomer-NLP
https://github.com/EthanWYB/bert-classification
https://github.com/EugenHotaj/pytorch-generative/blob/master/notebooks/style_transfer.ipynb
https://github.com/EugenHotaj/pytorch-generative/blob/master/pytorch_generative/nn/attention.py
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
https://github.com/EugenHotaj/pytorch-generative/blob/master/pytorch_generative/nn/utils.py
https://github.com/EugenHotaj/pytorch-generative/blob/master/pytorch_generative/optim.py
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients
https://github.com/EuphoriaYan/bert_component
https://github.com/ExplainableML/cosmos
FLAIR: VLM with Fine-grained Language-informed Image Representations
https://github.com/Ezereal/enas
https://github.com/FLoutione/CPM-mindspore
CPM: A Large-scale Generative Chinese Pre-trained Language Model
https://github.com/Fantasyele/LLaVA-KD
MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection
https://github.com/FaskyCC/TextClassification
https://github.com/FengJiaChunFromSYSU/Bert
https://github.com/FerryHuang/SimVLM
SimVLM: Simple Visual Language Model Pretraining with Weak Supervision
https://github.com/FlagAI-Open/Aquila-MoE
AquilaMoE: Efficient Training for MoE Models with Scale-Up and Scale-Out Strategies
https://github.com/FlyingPumba/circuits-benchmark
Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small
https://github.com/FoundationVision/Infinity
Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction
https://github.com/Franklin-Zhang0/ReasonGen-R1
ReasonGen-R1: CoT for Autoregressive Image generation models through SFT and RL
https://github.com/FreddeFrallan/Contrastive-Tension
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
https://github.com/FreddeFrallan/Multilingual-CLIP
https://github.com/FreedomIntelligence/BlenderLLM
https://github.com/FreedomIntelligence/PlatoLM
PlatoLM: Teaching LLMs in Multi-Round Dialogue via a User Simulator
https://github.com/FrogTravel/PMLDL
BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model
https://github.com/FulminisH/Style-Transfer
https://github.com/G-4-R-Y/Tweet-Sentiment-Extraction
https://github.com/G-4-R-Y/Tweet-Sentiment-Extraction-roBERTa-5fold
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.