Language Modelling
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 6
- 평가표
- 55
- 보존된 평가 기록
- 466
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/facebookresearch/meta_secalign
InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents
https://github.com/facebookresearch/multihop_dense_retrieval
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
https://github.com/facebookresearch/multimodal
https://github.com/facebookresearch/perception_models
Perception Encoder: The best visual embeddings are not at the output of the network
https://github.com/facebookresearch/pytorch-dp
https://github.com/facebookresearch/salina
A Simple Way to Initialize Recurrent Networks of Rectified Linear Units
https://github.com/facebookresearch/spartan
https://github.com/facebookresearch/three_bricks
https://github.com/facebookresearch/vissl
ZeRO: Memory Optimizations Toward Training Trillion Parameter Models
https://github.com/facebookresearch/wav2letter
https://github.com/facebookresearch/wav2letter/tree/master/recipes/models/sota/2019
End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architectures
https://github.com/facebookresearch/xformers
https://github.com/facebookresearch/xformers/blob/main/xformers/ops/fmha/flash.py
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
https://github.com/facico/chinese-vicuna
https://github.com/factoryIO/1-simple_neural_style_transfer
https://github.com/faizansuhail89/bert
https://github.com/fanchenyou/transformer-study
XLNet: Generalized Autoregressive Pretraining for Language Understanding
https://github.com/fancyerii/bert
https://github.com/fangrouli/Document-embedding-generation-models
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
https://github.com/fangyiyu/Modified_MNIST_Classification
https://github.com/fanzhichen/ncd-iic
Class-relation Knowledge Distillation for Novel Class Discovery
https://github.com/fastai/fastai/blob/master/fastai/text/models/awdlstm.py
https://github.com/fawazsammani/knowing-when-to-look-adaptive-attention
Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning
https://github.com/fciannel/bert_fciannel
https://github.com/feifeibear/llmspeculativesampling
https://github.com/feiwu77777/Handwriting_gen
https://github.com/feiwu77777/Handwriting_generation
https://github.com/felicienveldema/IR2
Generating More Interesting Responses in Neural Conversation Models with Distributional Constraints
https://github.com/fengleifan/relinear
https://github.com/fereshte-khani/coalign
https://github.com/few-shot-NER-benchmark/BaselineCode
https://github.com/feyzaakyurek/XLM-LwLL
https://github.com/feziodoshi/Neural-Artistic-Style-Video-
https://github.com/ffaisal93/adapt_lang_phylogeny
https://github.com/fiabdu/Commonly-Interesting-Images
VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretraining
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.