https://github.com/pwc-1/Paper-5/tree/main/mixtral
Rethinking LLM Language Adaptation: A Case Study on Chinese Mixtral
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Rethinking LLM Language Adaptation: A Case Study on Chinese Mixtral
mLUKE: The Power of Entity Representations in Multilingual Pretrained Language Models
AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities
Decision Transformer: Reinforcement Learning via Sequence Modeling
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
TAPEX: Table Pre-training via Learning a Neural SQL Executor
TinyBERT: Distilling BERT for Natural Language Understanding
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM
mLUKE: The Power of Entity Representations in Multilingual Pretrained Language Models
PhishLang: A Real-Time, Fully Client-Side Phishing Detection Framework Using MobileBERT
MPNet: Masked and Permuted Pre-training for Language Understanding
Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning
VisualBERT: A Simple and Performant Baseline for Vision and Language
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Xmodel-VLM: A Simple Baseline for Multimodal Vision Language Model
Learn from Downstream and Be Yourself in Multimodal Large Language Model Fine-Tuning
Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.