Language Modelling
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 6
- 평가표
- 55
- 보존된 평가 기록
- 466
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/huggingface/amused
Muse: Text-To-Image Generation via Masked Generative Transformers
https://github.com/huggingface/bert-syntax
Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies
https://github.com/huggingface/dataspeech
Natural language guidance of high-fidelity text-to-speech with synthetic annotations
https://github.com/huggingface/diffusers
InstructPix2Pix: Learning to Follow Image Editing Instructions
https://github.com/huggingface/distil-whisper
https://github.com/huggingface/node-question-answering
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
https://github.com/huggingface/open-muse
Muse: Text-To-Image Generation via Masked Generative Transformers
https://github.com/huggingface/open-r1
https://github.com/huggingface/parler-tts
Natural language guidance of high-fidelity text-to-speech with synthetic annotations
https://github.com/huggingface/text-generation-inference
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
https://github.com/huggingface/tflite-android-transformers
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
https://github.com/huggingface/transformers-bloom-inference
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
https://github.com/huggingface/trl
https://github.com/huggingface/xlnet
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context
https://github.com/hughbzhang/o1_inference_scaling_laws
Self-Consistency Improves Chain of Thought Reasoning in Language Models
https://github.com/hugozhl/hetu
EvoMoE: An Evolutional Mixture-of-Experts Training Framework via Dense-To-Sparse Gate
https://github.com/huiwy/reflection-on-trees
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
https://github.com/huiyinglu/NLP-Deep-Learning-Chatbot
https://github.com/human9000/nd-mamba2-torch
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
https://github.com/humanmllm/r1-omni
R1-Omni: Explainable Omni-Multimodal Emotion Recognition with Reinforcement Learning
https://github.com/hunto/localmamba
https://github.com/huseinzol05/malaya-speech
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units
https://github.com/hustvl/dig
Gated Linear Attention Transformers with Hardware-Efficient Training
https://github.com/hustvl/vim
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
https://github.com/huyhoang17/Vietnamese_Handwriting_Recognition
https://github.com/huyphan168/PEER
https://github.com/hyang0129/foodclassapp
Regularizing Neural Networks by Penalizing Confident Output Distributions
https://github.com/hyeon95y/sparselinear
https://github.com/hyn2028/llm-cxr
Vision-Language Generative Model for View-Specific Chest X-ray Generation
https://github.com/hypasd-art/CITI
https://github.com/i404788/DPFP-pytorch
https://github.com/i404788/s5-pytorch
Hyena Hierarchy: Towards Larger Convolutional Language Models
https://github.com/ialifinaritra/text_summarization
FlauBERT: Unsupervised Language Model Pre-training for French
https://github.com/iamNCJ/DUMA-pytorch-lightning
https://github.com/iamgroot42/mimir
Pandora's White-Box: Precise Training Data Detection and Extraction in Large Language Models
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.