GNNBENCH: Fair and Productive Benchmarking for Single-GPU GNN System
원문 초록
We hypothesize that the absence of a standardized benchmark has allowed several fundamental pitfalls in GNN System design and evaluation that the community has overlooked. In this work, we propose GNNBench, a plug-and-play benchmarking platform focused on system innovation. GNNBench presents a new protocol to exchange their captive tensor data, supports custom classes in System APIs, and allows automatic integration of the same system module to many deep learning frameworks, such as PyTorch and TensorFlow. To demonstrate the importance of such a benchmark framework, we integrated several GNN systems. Our results show that integration with GNNBench helped us identify several measurement issues that deserve attention from the community.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
LLMThinkBench: Towards Basic Math Reasoning and Overthinking in Large Language Models
PocketVina Enables Scalable and Highly Accurate Physically Valid Docking through Multi-Pocket Conditioning
ConsumerBench: Benchmarking Generative AI Applications on End-User Devices
Survey of HPC in US Research Institutions
BestServe: Serving Strategies with Optimal Goodput in Collocation and Disaggregation Architectures
BenchENAS: A Benchmarking Platform for Evolutionary Neural Architecture Search
토론
이 논문과 연결된 포럼 글이 아직 없습니다.