Papers with Code · CC BY-SA 4.0
Language Modelling
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
데이터셋
88개FewCLUE (BUSTM)FewCLUE (CHID-FC)FewCLUE (CLUEWSC-FC)FewCLUE (EPRSTMT)FewCLUE (OCNLI-FC)VietMed100 sleep nights of 8 caregivers2000 HUB5 EnglishA1Arxiv HEP-TH citation graphBookcorpus2Books3CHIP-STSClinicalSTSCuration CorpusDAVIS-DTADM MathematicsFreeLawGitHubGutenberg PG-19HackerNewsMedSTSNIH ExPorterOpenSubtitlesOpenWebtext2PTB Diagnostic ECG DatabasePhilPapersPile CCPubMed CentralPubMed Cognitive Control Abstracts