Papers with Code · CC BY-SA 4.0

spider

아카이브 평가 20건 · 마지막 적재/변경 2026-10-30

평가 기록

과거 수집 기록이며 최신 순위가 아닙니다. 데이터셋 버전·split·실험 조건과 지표 방향이 검증되지 않은 결과는 직접 비교할 수 없습니다. 날짜는 논문 날짜이며 최신 평가일을 뜻하지 않습니다.

표가 화면보다 넓으면 좌우로 스크롤하여 논문과 구현 링크를 확인하세요.

원본 기록 순서 · 순위 미부여
모델	원본 지표·값	논문	구현
XiYan-SQL	Execution Accuracy (Test) 89.65	A Preview of XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQL 2024-11-13	코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5
PET-SQL	Exact Match Accuracy (Test) 66.6 Execution Accuracy (Test) 87.6	PET-SQL: A Prompt-Enhanced Two-Round Refinement of Text-to-SQL with Cross-consistency 2024-03-13	코드 1
DAIL-SQL + GPT-4 + Self-Consistency	Exact Match Accuracy (Dev) 74.4 Execution Accuracy (Dev) 84.4 Execution Accuracy (Test) 86.6	Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation 2023-08-29	코드 1
DIN-SQL + GPT-4	Exact Match Accuracy (Test) 60 Execution Accuracy (Test) 85.3	DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correction 2023-04-21	코드 1
MSc-SQL	Execution Accuracy (Test) 84.7	MSc-SQL: Multi-Sample Critiquing Small Language Models For Text-To-SQL Translation 2024-10-16	코드 1
MARLO + Claude 2.1	Execution Accuracy (Dev) 83.6 Execution Accuracy (Test) 84.0	Learning Metadata-Agnostic Representations for Text-to-SQL In-Context Example Selection 2024-10-17	연결 없음
C3 + ChatGPT + Zero-Shot	Execution Accuracy (Dev) 81.8 Execution Accuracy (Test) 82.3	C3: Zero-shot Text-to-SQL with ChatGPT 2023-07-14	코드 1
RESDSQL-3B + NatSQL	Exact Match Accuracy (Dev) 80.5 Exact Match Accuracy (Test) 72.0 Execution Accuracy (Dev) 84.1 Execution Accuracy (Test) 79.9	RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL 2023-02-12	코드 1
T5-3B+NatSQL+Token Preprocessing	Exact Match Accuracy (Dev) 69.4 Execution Accuracy (Dev) 73.7 Execution Accuracy (Test) 78	Improving Generalization in Language Model-Based Text-to-SQL Semantic Parsing: Two Simple Semantic Boundary-Based Techniques 2023-05-27	코드 1
Graphix-3B+PICARD	Exact Match Accuracy (Dev) 77.1 Execution Accuracy (Dev) 81.0 Execution Accuracy (Test) 77.6	Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing 2023-01-18	코드 1
T5-SR	Exact Match Accuracy (Dev) 77.2 Exact Match Accuracy (Test) 72.4 Execution Accuracy (Test) 75.2	T5-SR: A Unified Seq-to-Seq Decoding Strategy for Semantic Parsing 2023-06-14	코드 1
T5-3B + PICARD	Exact Match Accuracy (Dev) 75.5 Exact Match Accuracy (Test) 71.9 Execution Accuracy (Test) 75.1	PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models 2021-09-10	코드 1 · 코드 2 · 코드 3
SADGA + GAP	Exact Match Accuracy (Dev) 73.1 Exact Match Accuracy (Test) 70.1	SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQL 2021-11-01	코드 1
RYANSQL (BERT)	Exact Match Accuracy (Dev) 66.6 Exact Match Accuracy (Test) 58.2	RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases 2020-04-07	코드 1
datagpt-sql-7B + InvalidSQL-Feedback	Exact Match Accuracy (Dev) 81.6 Execution Accuracy (Dev) 87.2	DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL 2024-09-24	연결 없음
datagpt-sql-7B	Exact Match Accuracy (Dev) 80.3 Execution Accuracy (Dev) 84.8	DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL 2024-09-24	연결 없음
code-davinci-002 175B (LEVER)	Execution Accuracy (Dev) 81.9	LEVER: Learning to Verify Language-to-Code Generation with Execution 2023-02-16	코드 1
DELLM + GPT-4	Execution Accuracy (Dev) 71.68	Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM 2024-02-18	코드 1
RATSQL + GAP	Exact Match Accuracy (Dev) 71.8	Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training 2020-12-18	코드 1 · 코드 2 · 코드 3
MAPO + TABERTLarge (K = 3)	Exact Match Accuracy (Dev) 64.5	TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data 2020-05-17	코드 1