https://github.com/fsoft-aic/competesmoe
공식 코드CompeteSMoE -- Statistically Guaranteed Mixture of Experts Training via Competition
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
CompeteSMoE -- Statistically Guaranteed Mixture of Experts Training via Competition
Uni-Perceiver-MoE: Learning Sparse Generalist Models with Conditional MoEs
ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer
Lifting the Curse of Capacity Gap in Distilling Language Models
SAME: Learning Generic Language-Guided Visual Navigation with State-Adaptive Mixture of Experts
HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts
Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT
PFL-MoE: Personalized Federated Learning Based on Mixture of Experts
Samoyeds: Accelerating MoE Models with Structured Sparsity Leveraging Sparse Tensor Cores
Jakiro: Boosting Speculative Decoding with Decoupled Multi-Head via MoE
Covariate-guided Bayesian mixture model for multivariate time series
Multimodal Cultural Safety: Evaluation Frameworks and Alignment Strategies
Prompt-prompted Adaptive Structured Pruning for Efficient LLM Generation
Checkmating One, by Using Many: Combining Mixture of Experts with MCTS to Improve in Chess
HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformer
HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformer
Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Experts
U-SAM: An audio language Model for Unified Speech, Audio, and Music Understanding
LITE: Modeling Environmental Ecosystems with Multimodal Large Language Models
Few-Shot and Continual Learning with Attentive Independent Mechanisms
TESTAM: A Time-Enhanced Spatio-Temporal Attention Model with Mixture of Experts
Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy
ResMoE: Space-efficient Compression of Mixture of Experts LLMs via Residual Restoration
Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Models
CNMBERT: A Model for Converting Hanyu Pinyin Abbreviations to Chinese Characters
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.