https://github.com/awni00/abstract_transformer
Disentangling and Integrating Relational and Sensory Information in Transformer Architectures
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Disentangling and Integrating Relational and Sensory Information in Transformer Architectures
Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training
GateLoop: Fully Data-Controlled Linear Recurrence for Sequence Modeling
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Models
Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor
PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning Optimization
Muse: Text-To-Image Generation via Masked Generative Transformers
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
First-Pass Large Vocabulary Continuous Speech Recognition using Bi-Directional Recurrent DNNs
SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot
SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot
LADDER: Language Driven Slice Discovery and Error Rectification
Independently Recurrent Neural Network (IndRNN): Building A Longer and Deeper RNN
Improving LSTM-based Video Description with Linguistic Knowledge Mined from Text
Improving LSTM-based Video Description with Linguistic Knowledge Mined from Text
Cognitive Reframing of Negative Thoughts through Human-Language Model Interaction
FlauBERT: Unsupervised Language Model Pre-training for French
Structured Sequence Modeling with Graph Convolutional Recurrent Networks
Universal Language Model Fine-tuning for Text Classification
Universal Language Model Fine-tuning for Text Classification
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.