arXiv:1803.10631
Meta-Learning a Dynamical Language Model
원문 초록
We consider the task of word-level language modeling and study the possibility of combining hidden-states-based short-term representations with medium-term representations encoded in dynamical weights of a language model. Our work extends recent experiments on language models with dynamically evolving weights by casting the language modeling problem into an online learning-to-learn framework in which a meta-learner is trained by gradient-descent to continuously update a language model weights.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Making Language Model a Hierarchical Classifier and Generator
CoLMbo: Speaker Language Model for Descriptive Profiling
Mixture of Experts in Large Language Models
Iceberg: Enhancing HLS Modeling with Synthetic Data
Data Efficacy for Language Model Training
Enterprise Large Language Model Evaluation Benchmark
토론
이 논문과 연결된 포럼 글이 아직 없습니다.