https://github.com/microsoft/stochastic-mixture-of-experts
공식 코드Taming Sparsely Activated Transformer with Stochastic Experts
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Taming Sparsely Activated Transformer with Stochastic Experts
WINA: Weight Informed Neuron Activation for Accelerating Large Language Model Inference
DynMoLE: Boosting Mixture of LoRA Experts Fine-Tuning with a Hybrid Routing Mechanism
MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts
FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editing
MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention
ASEM: Enhancing Empathy in Chatbot through Attention-based Sentiment and Emotion Modeling
Model-GLUE: Democratized LLM Scaling for A Large Model Zoo in the Wild
Named Entity and Relation Extraction with Multi-Modal Retrieval
A Survey on Inference Optimization Techniques for Mixture of Experts Models
AlphaLoRA: Assigning LoRA Experts Based on Layer Training Quality
Heterogeneous Mixture of Experts for Remote Sensing Image Super-Resolution
Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts
BIG-MoE: Bypass Isolated Gating MoE for Generalized Multimodal Face Anti-Spoofing
Task-Agnostic Online Reinforcement Learning with an Infinite Mixture of Gaussian Processes
Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts
Towards Robust Multimodal Representation: A Unified Approach with Adaptive Experts and Alignment
Swift Hydra: Self-Reinforcing Generative Framework for Anomaly Detection with Multiple Mamba Models
SummaReranker: A Multi-Task Mixture-of-Experts Re-ranking Framework for Abstractive Summarization
Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation
Efficient and Interpretable Grammatical Error Correction with Mixture of Experts
Specializing Versatile Skill Libraries using Local Mixture of Experts
Linear-MoE: Linear Sequence Modeling Meets Mixture-of-Experts
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.