Papers with Code · CC BY-SA 4.0

MBPP

아카이브 평가 99건 · 마지막 적재/변경 2026-10-30

평가 기록

과거 수집 기록이며 최신 순위가 아닙니다. 데이터셋 버전·split·실험 조건과 지표 방향이 검증되지 않은 결과는 직접 비교할 수 없습니다. 날짜는 논문 날짜이며 최신 평가일을 뜻하지 않습니다.

표가 화면보다 넓으면 좌우로 스크롤하여 논문과 구현 링크를 확인하세요.

원본 기록 순서 · 순위 미부여
모델	원본 지표·값	논문	구현
EG-CFG (DeepSeek-V3-0324)	Accuracy 96.6	Execution Guided Line-by-Line Code Generation 2025-06-12	코드 1
QualityFlow (Sonnet-3.5)	Accuracy 94.2	QualityFlow: An Agentic Workflow for Program Synthesis Controlled by LLM Quality Checks 2025-01-20	연결 없음
o1-mini + MapCoder (Hamming.ai)	Accuracy 93.2	MapCoder: Multi-Agent Code Generation for Competitive Problem Solving 2024-05-18	코드 1 · 코드 2
MGDebugger (DeepSeek-V3-0324)	Accuracy 92.4	From Code to Correctness: Closing the Last Mile of Code Generation with Hierarchical Debugging 2024-10-02	코드 1
GPT-4 + AgentCoder	Accuracy 91.8	AgentCoder: Multi-Agent-based Code Generation with Iterative Testing and Optimisation 2023-12-20	코드 1
CodeSim (GPT4o)	Accuracy 90.7	CODESIM: Multi-Agent Code Generation and Problem Solving through Simulation-Driven Planning and Debugging 2025-02-08	코드 1
Jiutian-大模型	Accuracy 90.0	연결 없음 논문 날짜 미기재	연결 없음
GPT-3.5 Turbo (ChatGPT) + AgentCoder	Accuracy 89.9	AgentCoder: Multi-Agent-based Code Generation with Iterative Testing and Optimisation 2023-12-20	코드 1
MapCoder (GPT-4o)	Accuracy 89.7	MapCoder: Multi-Agent Code Generation for Competitive Problem Solving 2024-05-18	코드 1 · 코드 2
GPT-4 (ChatGPT Plus)	Accuracy 87.5	How Does Naming Affect LLMs on Code Analysis Tasks? 2023-07-24	연결 없음
Claude 3 Opus	Accuracy 86.4	The Claude 3 Model Family: Opus, Sonnet, Haiku 2024-03-04	연결 없음
LPW (GPT-4o)	Accuracy 84.8	Planning-Driven Programming: A Large Language Model Programming Workflow 2024-11-21	코드 1
GPT-3.5 Turbo + FlowGenScrum + Test	Accuracy 83.8±0.6	SOEN-101: Code Generation by Emulating Software Process Models Using Large Language Model Agents 2024-03-23	연결 없음
AFlow(GPT-4o-mini)	Accuracy 83.4	AFlow: Automating Agentic Workflow Generation 2024-10-14	코드 1 · 코드 2 · 코드 3 · 코드 4
GPT-3.5 Turbo (ChatGPT)	Accuracy 83.2	How Does Naming Affect LLMs on Code Analysis Tasks? 2023-07-24	연결 없음
EG-CFG (DeepSeek Coder 1.3b Instruct)	Accuracy 83.2	Execution Guided Line-by-Line Code Generation 2025-06-12	코드 1
MapCoder (GPT-4)	Accuracy 83.1	MapCoder: Multi-Agent Code Generation for Competitive Problem Solving 2024-05-18	코드 1 · 코드 2
o1-mini + Language Agent Tree Search (Hamming.ai)	Accuracy 82.3	Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models 2023-10-06	코드 1 · 코드 2
GPT-4 (Bing Chat)	Accuracy 82	How Does Naming Affect LLMs on Code Analysis Tasks? 2023-07-24	연결 없음
GPT-3.5 Turbo + Language Agent Tree Search	Accuracy 81.1	Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models 2023-10-06	코드 1 · 코드 2
MGDebugger (CodeQwen1.5)	Accuracy 80.8	From Code to Correctness: Closing the Last Mile of Code Generation with Hierarchical Debugging 2024-10-02	코드 1
Claude 3 Haiku	Accuracy 80.4	The Claude 3 Model Family: Opus, Sonnet, Haiku 2024-03-04	연결 없음
GPT-4 (Self-Debugging with unit tests + trace)	Accuracy 80.2	Teaching Large Language Models to Self-Debug 2023-04-11	코드 1 · 코드 2
GPT-4 (few-shot)	Accuracy 80	DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence 2024-01-25	코드 1
Claude 3 Sonnet	Accuracy 79.4	The Claude 3 Model Family: Opus, Sonnet, Haiku 2024-03-04	연결 없음
Bard (PaLM 2/chat-bison-001)	Accuracy 76.2	How Does Naming Affect LLMs on Code Analysis Tasks? 2023-07-24	연결 없음
GPT-3.5 Turbo (Self-Debugging with unit tests + trace)	Accuracy 72.8	Teaching Large Language Models to Self-Debug 2023-04-11	코드 1 · 코드 2
Claude	Accuracy 71.4	How Does Naming Affect LLMs on Code Analysis Tasks? 2023-07-24	연결 없음
code-davinci-002 175B (Self-Debugging with unit tests + trace)	Accuracy 70.8	Teaching Large Language Models to Self-Debug 2023-04-11	코드 1 · 코드 2
GPT-3.5 Turbo (few-shot)	Accuracy 70.8	DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence 2024-01-25	코드 1