Papers with Code · CC BY-SA 4.0

데이터셋 탐색

데이터셋의 설명·홈페이지를 찾고, 관련 태스크의 평가 기록을 살펴보세요.

관련 논문 11편

nvBench

nvBench 설명 보기

nvBench is a large-scale NL2VIS (natural languagge to visualisations) benchmark, containing 25,750 (NL, VIS) pairs from 750 tables over 105 domains, synthesized from (NL, SQL) benchmarks to support cross-domain NLPVIS (Natural Language Query to Visualization) task.

관련 논문 1편

EnvBench

EnvBench 설명 보기

EnvBench is a comprehensive benchmark for automating environment setup - an important task in software engineering. We have collected the largest dataset to date for this task and introduced a robust framework for developing and evaluating LLM-based agents that tackle environment setup challenges. Our benchmark includes: * 994 repositories: 329 Python and 665 JVM-based (Java, Kotlin) projects * Genuine configuration challenges: Carefully selected repositories that cannot be configured with simple deterministic scripts * Evaluation metrics: Static analysis for missing imports in Python and compilation checks for JVM languages * Baselines: Zero-shot baselines and agentic workflows tested with GPT-4o and GPT-4o-mini