https://github.com/dqqcasia/st
Pay Less Attention with Lightweight and Dynamic Convolutions
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.
Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.
Source: Wikipedia
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Pay Less Attention with Lightweight and Dynamic Convolutions
Augmenting Reddit Posts to Determine Wellness Dimensions impacting Mental Health
Self-QA: Unsupervised Knowledge Guided Language Model Alignment
Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units
Effectiveness of self-supervised pre-training for speech recognition
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Factorized Neural Transducer for Efficient Language Model Adaptation
EduChat: A Large-Scale Language Model-based Chatbot System for Intelligent Education
Factorized Learning Assisted with Large Language Model for Gloss-free Sign Language Translation
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
LM-Critic: Language Models for Unsupervised Grammatical Error Correction
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.