Online Evolutionary Batch Size Orchestration for Scheduling Deep Learning Workloads in GPU Clusters
원문 초록
Efficient GPU resource scheduling is essential to maximize resource utilization and save training costs for the increasing amount of deep learning workloads in shared GPU clusters. Existing GPU schedulers largely rely on static policies to leverage the performance characteristics of deep learning jobs. However, they can hardly reach optimal efficiency due to the lack of elasticity. To address the problem, we propose ONES, an ONline Evolutionary Scheduler for elastic batch size orchestration. ONES automatically manages the elasticity of each job based on the training batch size, so as to maximize GPU utilization and improve scheduling efficiency. It determines the batch size for each job through an online evolutionary search that can continuously optimize the scheduling decisions. We evaluate the effectiveness of ONES with 64 GPUs on TACC's Longhorn supercomputers. The results show that ONES can outperform the prior deep learning schedulers with a significantly shorter average job completion time.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Confucius3-Math: A Lightweight High-Performance Reasoning LLM for Chinese K-12 Mathematics Learning
ConsumerBench: Benchmarking Generative AI Applications on End-User Devices
Vine Copulas as Differentiable Computational Graphs
FlashDMoE: Fast Distributed MoE in a Single Kernel
Diagonal Batching Unlocks Parallelism in Recurrent Memory Transformers for Long Contexts
CF-DETR: Coarse-to-Fine Transformer for Real-Time Object Detection
토론
이 논문과 연결된 포럼 글이 아직 없습니다.