https://github.com/kyegomez/Sophia
Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training
Moshi: a speech-text foundation model for real-time dialogue
Moshi: a speech-text foundation model for real-time dialogue
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
VisualBERT: A Simple and Performant Baseline for Vision and Language
Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
C$^2$LEVA: Toward Comprehensive and Contamination-Free Language Model Evaluation
Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation Matching
LICHEE: Improving Language Model Pre-training with Multi-grained Tokenization
Adversarial Training for Aspect-Based Sentiment Analysis with BERT
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients
Virology Capabilities Test (VCT): A Multimodal Virology Q&A Benchmark
Efficiently Modeling Long Sequences with Structured State Spaces
Unsupervised Word Segmentation with Bi-directional Neural Language Model
On the Cross-lingual Transferability of Monolingual Representations
Enhancing the Protein Tertiary Structure Prediction by Multiple Sequence Alignment Generation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.