https://github.com/WelkinYang/Zoneout-Pytorch
Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
The Pile: An 800GB Dataset of Diverse Text for Language Modeling
Centurio: On Drivers of Multilingual Ability of Large Vision-Language Model
Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Model
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
VisualBERT: A Simple and Performant Baseline for Vision and Language
ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations
Contrastive Language Prompting to Ease False Positives in Medical Anomaly Detection
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
MaxUp: A Simple Way to Improve Generalization of Neural Network Training
Unified Language Model Pre-training for Natural Language Understanding and Generation
Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions
ECONET: Effective Continual Pretraining of Language Models for Event Temporal Reasoning
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.