https://github.com/lucidrains/self-rewarding-lm-pytorch
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Conformer: Convolution-augmented Transformer for Speech Recognition
Toolformer: Language Models Can Teach Themselves to Use Tools
Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Universal Language Model Fine-tuning for Text Classification
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Universal Language Model Fine-tuning for Text Classification
Extending Context Window of Large Language Models via Positional Interpolation
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
ERNIE: Enhanced Representation through Knowledge Integration
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks
ERNIE: Enhanced Representation through Knowledge Integration
Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned
Probabilistically Masked Language Model Capable of Autoregressive Generation in Arbitrary Word Order
Speaker anonymization using neural audio codec language models
Clinical Camel: An Open Expert-Level Medical Language Model with Dialogue-Based Knowledge Encoding
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.