https://github.com/pascalcarrivain/ksmm
Monarch: Expressive Structured Matrices for Efficient and Accurate Training
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Monarch: Expressive Structured Matrices for Efficient and Accurate Training
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
Recurrent Neural Network based Part-of-Speech Tagger for Code-Mixed Social Media Text
Recurrent Neural Network based Part-of-Speech Tagger for Code-Mixed Social Media Text
Simplifying Paragraph-level Question Generation via Transformer Language Models
XLNet: Generalized Autoregressive Pretraining for Language Understanding
RuBioRoBERTa: a pre-trained biomedical language model for Russian language biomedical text mining
More Than Meets The Eye: Semi-supervised Learning Under Non-IID Data
Multimodal Hypothetical Summary for Retrieval-based Multi-image Question Answering
SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching
Improved training of end-to-end attention models for speech recognition
Self-supervised vision-language pretraining for Medical visual question answering
Operationalizing a National Digital Library: The Case for a Norwegian Transformer Model
Conformer: Convolution-augmented Transformer for Speech Recognition
Conformer: Convolution-augmented Transformer for Speech Recognition
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Language agents achieve superhuman synthesis of scientific knowledge
Representation of linguistic form and function in recurrent neural networks
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.