https://github.com/ml-jku/helm
공식 코드Semantic HELM: A Human-Readable Memory for Reinforcement Learning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Semantic HELM: A Human-Readable Memory for Reinforcement Learning
Linear Alignment of Vision-language Models for Image Captioning
Accurate RNA 3D structure prediction using a language model-based deep learning approach
Accurate RNA 3D structure prediction using a language model-based deep learning approach
Uncovering Intermediate Variables in Transformers using Circuit Probing
Large Scale Transfer Learning for Tabular Data via Language Modeling
Language models scale reliably with over-training and on downstream tasks
Large Scale Transfer Learning for Tabular Data via Language Modeling
MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learning
Masked Language Model Based Textual Adversarial Example Detection
Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models
LookupFFN: Making Transformers Compute-lite for CPU inference
Vocabulary-level Memory Efficiency for Language Model Fine-tuning
Vocabulary-level Memory Efficiency for Language Model Fine-tuning
Autoregressive Action Sequence Learning for Robotic Manipulation
GPT-3 Models are Poor Few-Shot Learners in the Biomedical Domain
Evaluating Transformer Language Models on Arithmetic Operations Using Number Decomposition
Empirical Error Modeling Improves Robustness of Noisy Neural Sequence Labeling
Asynchronous RLHF: Faster and More Efficient Off-Policy RL for Language Models
AKI-BERT: a Pre-trained Clinical Language Model for Early Prediction of Acute Kidney Injury
Unsupervised Boundary-Aware Language Model Pretraining for Chinese Sequence Labeling
Recall, Expand and Multi-Candidate Cross-Encode: Fast and Accurate Ultra-Fine Entity Typing
LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.