Language Modelling
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 6
- 평가표
- 55
- 보존된 평가 기록
- 466
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/NUS-HPC-AI-Lab/VideoSys
https://github.com/NVIDIA/DeepLearningExamples/tree/master/PyTorch/LanguageModeling
https://github.com/NVIDIA/DeepLearningExamples/tree/master/PyTorch/LanguageModeling/Transformer-XL
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context
https://github.com/NVIDIA/DeepLearningExamples/tree/master/TensorFlow/LanguageModeling/Transformer-XL
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context
https://github.com/NVIDIA/FasterTransformer
https://github.com/NVIDIA/NeMo-Curator
https://github.com/NVIDIA/OpenSeq2Seq
https://github.com/NVIDIA/elucidated-text-to-audio
https://github.com/NVIDIA/garak
https://github.com/NVlabs/unas
https://github.com/NamCyan/RecSys-VAE4CF
https://github.com/NataliaSkorokhod/neural-style-transfer
https://github.com/NateKoenig/https-github.com-Kautenja-a-neural-algorithm-of-artistic-style
https://github.com/NathanDuran/Sentence-Encoding-for-DA-Classification
XLNet: Generalized Autoregressive Pretraining for Language Understanding
https://github.com/Nic5472K/FriendsOOGroup_TCN
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
https://github.com/NicGian/text_VAE
https://github.com/NightmareVoid/LSTM_for_EEG
https://github.com/Nimesh-Patel/BERT
https://github.com/NivNayman/XNAS
https://github.com/NoMorningstar/style-transfer-1
https://github.com/NonameAuPlatal/Dual_Learning
https://github.com/Nstats/bert_MRC
https://github.com/Nstats/bert_senti_analysis_ch
https://github.com/Nstats/my_bert
https://github.com/OctoberChang/GAMLP?fbclid=IwAR03ugAd7H0U_kQrkihBDMJ-Bxy3siwKVbnBTNkz_IVp5J25L0DFlTK0yfc
Node Feature Extraction by Self-Supervised Multi-scale Neighborhood Prediction
https://github.com/OctopusMind/DPO
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
https://github.com/OctopusMind/longBert
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
https://github.com/Oguzhanercan/Vision-Transformers
https://github.com/OpenMOSS/AnyGPT
AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling
https://github.com/OrigamiDream/gato
https://github.com/Osobarako/alduswarrensewell
https://github.com/PAIR-code/lit
Well-Read Students Learn Better: On the Importance of Pre-training Compact Models
https://github.com/PAIR-code/llm-comparator
https://github.com/PARC/intricate-art-neural-transfer
https://github.com/PDas2206/BERT_emotion_analysis
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.