Language Modelling
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 6
- 평가표
- 55
- 보존된 평가 기록
- 466
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/j9650/CoDeepNEAT
https://github.com/jackaduma/Alpaca-LoRA-RLHF-PyTorch
https://github.com/jackaduma/ChatGLM-LoRA-RLHF-PyTorch
GLM: General Language Model Pretraining with Autoregressive Blank Infilling
https://github.com/jackaduma/LAS_Mandarin_PyTorch
https://github.com/jackaduma/Recurrent-LLM
RecurrentGPT: Interactive Generation of (Arbitrarily) Long Text
https://github.com/jackbandy/bookcorpus-datasheet
The Pile: An 800GB Dataset of Diverse Text for Language Modeling
https://github.com/jackbandy/deep_learning_ulmfit
Universal Language Model Fine-tuning for Text Classification
https://github.com/jackjhliu/End-to-End-Mandarin-ASR
https://github.com/jackjhliu/Pytorch-End-to-End-ASR-on-TIMIT
https://github.com/jacksonwuxs/usablexai_llm
Studying Large Language Model Generalization with Influence Functions
https://github.com/jadevaibhav/ArtistIdentifier
https://github.com/jageshmaharjan/BERT_Service
https://github.com/jakeret/tcn
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
https://github.com/jaketae/conformer
Conformer: Convolution-augmented Transformer for Speech Recognition
https://github.com/jaketae/pytorch-malware-detection
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
https://github.com/jaketae/realformer
https://github.com/jamestjw/OCR
Evaluating Sequence-to-Sequence Models for Handwritten Text Recognition
https://github.com/jangjoongkeon/JK
https://github.com/janivanecky/Artistic-Style
https://github.com/jankrepl/mildlyoverfitted
https://github.com/jannenev/ulmfit-language-model
Universal Language Model Fine-tuning for Text Classification
https://github.com/jaredaevans/DualNeuralStyleTransfer
https://github.com/jaredaevans/MultipleNeuralStyleTransfer
https://github.com/jarfo/kchar
https://github.com/jasonshaoshun/amsal
An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models
https://github.com/jayanti-prasad/TreeLSTM
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
https://github.com/jaydeepthik/neural-style-transfer
https://github.com/jayleicn/ClipBERT
https://github.com/jaywonchung/BERT4Rec-VAE-Pytorch
https://github.com/jb1999/eesen
First-Pass Large Vocabulary Continuous Speech Recognition using Bi-Directional Recurrent DNNs
https://github.com/jb33k/awd-lstm-lm-ThinkNet
https://github.com/jbeno/sentiment
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
https://github.com/jbloomaus/saelens
Sparse Autoencoders Find Highly Interpretable Features in Language Models
https://github.com/jcblaisecruz02/Filipino-Text-Benchmarks
Evaluating Language Model Finetuning Techniques for Low-resource Languages
https://github.com/jcjohnson/neural-style
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.