https://github.com/cahya-wirawan/indonesian-language-models
Universal Language Model Fine-tuning for Text Classification
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Universal Language Model Fine-tuning for Text Classification
Improving Transformers with Dynamically Composable Multi-Head Attention
Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small
CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society
Decision Transformer: Reinforcement Learning via Sequence Modeling
WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentation
MAVIS: Mathematical Visual Instruction Tuning with an Automatic Data Engine
The Geometry of Categorical and Hierarchical Concepts in Large Language Models
Language Model Crossover: Variation through Few-Shot Prompting
Description and Evaluation of Semantic Similarity Measures Approaches
Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval
Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval
Quest: Query-centric Data Synthesis Approach for Long-context Scaling of Large Language Model
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
Universal Language Model Fine-tuning for Text Classification
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
On the Cross-lingual Transferability of Monolingual Representations
Similarity Contrastive Estimation for Self-Supervised Soft Contrastive Learning
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.