Language Modelling
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 6
- 평가표
- 55
- 보존된 평가 기록
- 466
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/pwc-1/Paper-9/tree/main/gpt_neox_japanese
https://github.com/pwc-1/Paper-9/tree/main/hubert
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units
https://github.com/pwc-1/Paper-9/tree/main/jamba
https://github.com/pwc-1/Paper-9/tree/main/layoutlmv2
LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding
https://github.com/pwc-1/Paper-9/tree/main/layoutlmv3
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
https://github.com/pwc-1/Paper-9/tree/main/llama
LawGPT: A Chinese Legal Knowledge-Enhanced Large Language Model
https://github.com/pwc-1/Paper-9/tree/main/longt5
LongT5: Efficient Text-To-Text Transformer for Long Sequences
https://github.com/pwc-1/Paper-9/tree/main/luke
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention
https://github.com/pytorch/opacus
https://github.com/pytorch/pytorch/blob/main/torch/nn/functional.py
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
https://github.com/pytorch/rl/tree/main/examples/decision_transformer
Decision Transformer: Reinforcement Learning via Sequence Modeling
https://github.com/pyy0715/vae-cf-pyorch
https://github.com/pzelasko/espnet
Improved training of end-to-end attention models for speech recognition
https://github.com/qapitan/babi-marcus
https://github.com/qhduan/CPM-LM-TF2
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
https://github.com/qibinc/KOBE
https://github.com/qihoo360/360zhinao
https://github.com/qijindou/CRAB
LLM Reading Tea Leaves: Automatically Evaluating Topic Models with Large Language Models
https://github.com/qingyun-wu/autogen-eval
Cost-Effective Hyperparameter Optimization for Large Language Model Generation Inference
https://github.com/qingzhenduyu/ical
Handwritten Mathematical Expression Recognition with Bidirectionally Trained Transformer
https://github.com/qinhanmin2014/fine-tune-bert-for-text-classification
https://github.com/qirui-chen/MultiHop-EgoQA
https://github.com/qitianwu/nodeformer
https://github.com/qiujihao19/artemis
GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest
https://github.com/qizekun/ReCon
ShapeLLM: Universal 3D Object Understanding for Embodied Interaction
https://github.com/qkaren/unsup_gen_for_cms_reasoning
Plug and Play Language Models: A Simple Approach to Controlled Text Generation
https://github.com/quangpham2006/SmallPlan
TextGames: Learning to Self-Play Text-Based Puzzle Games via Language Model Reasoning
https://github.com/quantum-fusion/AI-deeplearning
A segmental framework for fully-unsupervised large-vocabulary speech recognition
https://github.com/qute012/las-ko
https://github.com/qwenlm/qwen1.5
https://github.com/qwenlm/qwen2-vl
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
https://github.com/qwopqwop200/GPTQ-for-LLaMa
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
https://github.com/qwopqwop200/Magneto-pytorch
https://github.com/qywu/PRAL
A Tailored Pre-Training Model for Task-Oriented Dialog Generation
https://github.com/r-three/RAD
Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.