Papers with Code 아카이브

Language Modeling

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

전체 기법전체 데이터셋

하위 태스크

1

평가표

0

보존된 평가 기록

0

코드

관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/few_shot/pet

Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/language_model/chinesebert

ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/language_model/end_to_end_memory_networks

End-To-End Memory Networks

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/language_model/gpt-3

Language Models are Few-Shot Learners

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/language_model/megatronbert

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/language_model/roformer

LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/language_model/transformer-xl

Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/language_model/xlnet

XLNet: Generalized Autoregressive Pretraining for Language Understanding

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/model_compression/ofa

DynaBERT: Dynamic BERT with Adaptive Width and Depth

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/text_generation/vae-seq2seq

Generating Sentences from a Continuous Space

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/model_zoo/electra

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/paddlenlp/transformers/ctrl

CTRL: A Conditional Transformer Language Model for Controllable Generation

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/paddlenlp/transformers/layoutlmv2

LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/paddlenlp/transformers/mpnet

MPNet: Masked and Permuted Pre-training for Language Understanding

https://github.com/PaddlePaddle/PaddleOCR

LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding

https://github.com/PaddlePaddle/PaddleRec/tree/master/models/recall/deepwalk

DeepWalk: Online Learning of Social Representations

https://github.com/PaddlePaddle/PaddleSeg

ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network

https://github.com/PaddlePaddle/PaddleSpeech

First-Pass Large Vocabulary Continuous Speech Recognition using Bi-Directional Recurrent DNNs

https://github.com/PaddlePaddle/Serving

ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation

https://github.com/Patchwork53/EEEDAY-Dathathon2023-1st-Runners-Up

Bangla Grammatical Error Detection Using T5 Transformer Model

https://github.com/PengdaLiu/LAS-SpeechRecognition

Listen, Attend and Spell

https://github.com/Phrase-in-Context/eval

Longformer: The Long-Document Transformer

https://github.com/PierreSenellart/theoremkb

Extracting Definienda in Mathematical Scholarly Articles with Transformers

https://github.com/Pointcept/GPT4Point

Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Following

https://github.com/PrashantRanjan09/Elmo-Tutorial

Deep contextualized word representations

https://github.com/PrashantRanjan09/WordEmbeddings-Elmo-Fasttext-Word2Vec

Deep contextualized word representations

https://github.com/PreferredAI/cornac/tree/master/cornac/models/vaecf

Variational Autoencoders for Collaborative Filtering

https://github.com/PrideLee/sentiment-analysis

Universal Language Model Fine-tuning for Text Classification

https://github.com/PrimerAI/blanc

Fill in the BLANC: Human-free quality estimation of document summaries

https://github.com/ProsusAI/finBERT

FinBERT: Financial Sentiment Analysis with Pre-trained Language Models

https://github.com/Psarpei/Recognition-of-logical-document-structures

Recurrent Neural Network Grammars

https://github.com/RAGHAVJHA01/chatboat

End-To-End Memory Networks

https://github.com/ROCm/flash-attention

FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning

https://github.com/RUCAIBox/LLMBox

Language Models are Few-Shot Learners

https://github.com/RUCAIBox/Slow_Thinking_with_LLMs

Virgo: A Preliminary Exploration on Reproducing o1-like MLLM

https://github.com/RahulPatnaik/Titan-architechture

Titans: Learning to Memorize at Test Time

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.