Papers with Code · CC BY-SA 4.0

Language Modelling

514 평가 기록 88 datasets

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

논문

Deep Equilibrium Models

1909.01377 2019-09-03 이 페이지의 평가 3건
Test perplexity: 23.2Number of params: 110M

Random Feature Attention

2103.02143 2021-03-03 이 페이지의 평가 2건
Validation perplexity: 22Test perplexity: 23.5