Language Modelling
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 6
- 평가표
- 55
- 보존된 평가 기록
- 466
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/TSLNIHAOGIT/bert_run
https://github.com/TTTTTTris/wandaplus
Wanda++: Pruning Large Language Models via Regional Gradients
https://github.com/TU2021/DPO-VP
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
https://github.com/TXH-mercury/VALOR
VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset
https://github.com/TYTYTYTYTYTYTYTYTY/558-project
https://github.com/TYtrack/FedNLP
FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Tasks
https://github.com/TaiseiAso/BiGruAttEncDec
https://github.com/TamSiuhin/Per-Pcs
https://github.com/TangJiaLong/Knowledge-Projection-for-ERE
https://github.com/TanguyJeanneau/white-mirror
https://github.com/TaoQin/taoqin.github.io
BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining
https://github.com/TeaPoly/Conformer-Athena
Conformer: Convolution-augmented Transformer for Speech Recognition
https://github.com/TeddLi/Further-manually-annotated-glockner
https://github.com/TejInaco/multimodalML
Improving LSTM-based Video Description with Linguistic Knowledge Mined from Text
https://github.com/Tencent/TurboTransformers
https://github.com/TengHu/Generating-Sequences-With-Recurrent-Neural-Networks
https://github.com/TensorSpeech/TensorFlowASR
https://github.com/Tetsuya-Nishikawa/ConvLSTM_DEMO
https://github.com/TheConfused1/Real-time-neural-style-transfer
https://github.com/TheNeuromancer/SentEmb
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
https://github.com/TheShadow29/subreddit-classification-dataset
Universal Language Model Fine-tuning for Text Classification
https://github.com/TheophileBlard/french-sentiment-analysis-with-bert
MultiFiT: Efficient Multi-lingual Language Model Fine-tuning
https://github.com/Thijsvanede/ArrayLSTM
https://github.com/ThilinaRajapakse/simpletransformers
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
https://github.com/TianduoWang/MsAT
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
https://github.com/Tiannia/intro_to_ai
https://github.com/TieDanCuihua/Hierarchical-Attention-Networks-for-Document-Classification-Tensorflow
Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks
https://github.com/TieDanCuihua/ORDERED-NEURONS-INTEGRATING-TREE-STRUCTURES-INTO-RECURRENT-NEURAL-NETWORKS--tensorflow
Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks
https://github.com/Tikquuss/meta_XLM
https://github.com/TimDettmers/transformer-xl
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context
https://github.com/Tobias-K93/media-bias-prediction
https://github.com/TobiasLee/Text-Classification
Independently Recurrent Neural Network (IndRNN): Building A Longer and Deeper RNN
https://github.com/TobiasNorlund/flashback-gpt
Building a Swedish Open-Domain Conversational Language Model
https://github.com/TommyWongww/MemoryNetworks
https://github.com/Tony-Y/pytorch_warmup
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.