https://github.com/microsoft/XGLUE
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Fusing Context Into Knowledge Graph for Commonsense Question Answering
LoRAShear: Efficient Large Language Model Structured Pruning and Knowledge Recovery
Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studies
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training
Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labels
Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning
CPM: A Large-scale Generative Chinese Pre-trained Language Model
TinyBERT: Distilling BERT for Natural Language Understanding
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
Fast Neural Architecture Search of Compact Semantic Segmentation Models via Auxiliary Cells
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention
A Simple Way to Initialize Recurrent Networks of Rectified Linear Units
Combiner: Full Attention Transformer with Sparse Computation Cost
Generate rather than Retrieve: Large Language Models are Strong Context Generators
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.