https://github.com/bartwojcik/sadmoe
공식 코드Exploiting Activation Sparsity with Dense to Dynamic-k Mixture-of-Experts Conversion
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Exploiting Activation Sparsity with Dense to Dynamic-k Mixture-of-Experts Conversion
DirectMultiStep: Direct Route Generation for Multi-Step Retrosynthesis
A Multi-Modal Deep Learning Framework for Pan-Cancer Prognosis
Peirce in the Machine: How Mixture of Experts Models Perform Hypothesis Construction
A Modular Task-oriented Dialogue System Using a Neural Mixture-of-Experts
HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts
RoME: Role-aware Mixture-of-Expert Transformer for Text-to-Video Retrieval
Switch Diffusion Transformer: Synergizing Denoising Tasks with Sparse Mixture-of-Experts
Comet: Fine-grained Computation-communication Overlapping for Mixture-of-Experts
MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design
DA-MoE: Addressing Depth-Sensitivity in Graph-Level Analysis through Mixture of Experts
AdaMoE: Token-Adaptive Routing with Null Experts for Mixture-of-Experts Language Models
FLAME-MoE: A Transparent End-to-End Research Platform for Mixture-of-Experts Language Models
Learning Robust Stereo Matching in the Wild with Selective Mixture-of-Experts
EvoMoE: An Evolutional Mixture-of-Experts Training Framework via Dense-To-Sparse Gate
Learning A Sparse Transformer Network for Effective Image Deraining
Parameter Efficient Adaptation for Image Restoration with Heterogeneous Mixture-of-Experts
Efficient and Degradation-Adaptive Network for Real-World Image Super-Resolution
Granger-causal Attentive Mixtures of Experts: Learning Important Features with Neural Networks
Demystifying the Compression of Mixture-of-Experts Through a Unified Framework
PM-MOE: Mixture of Experts on Private Model Parameters for Personalized Federated Learning
Unchosen Experts Can Contribute Too: Unleashing MoE Models' Power by Self-Contrast
Beyond Sharing: Conflict-Aware Multivariate Time Series Anomaly Detection
Mol-MoE: Training Preference-Guided Routers for Molecule Generation
A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications
DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.