← Code Generation

Papers with Code · CC BY-SA 4.0

CoNaLa

아카이브 평가 14건 · 마지막 적재/변경 2026-10-30

원본 데이터셋 링크 1

평가 기록

과거 수집 기록이며 최신 순위가 아닙니다. 데이터셋 버전·split·실험 조건과 지표 방향이 검증되지 않은 결과는 직접 비교할 수 없습니다. 날짜는 논문 날짜이며 최신 평가일을 뜻하지 않습니다.

표가 화면보다 넓으면 좌우로 스크롤하여 논문과 구현 링크를 확인하세요.

원본 기록 순서 · 순위 미부여
모델	원본 지표·값	논문	구현
PanGu-Coder-FT-I	BLEU 44.32	Fine-Tuning Large Language Models for Answering Programming Questions with Code Snippets 2023-06-26	연결 없음
RoBERTaMarian	BLEU 35.74 Exact Match Accuracy 13.8	Leveraging pre-trained language models for code generation 2024-02-29	코드 1
MarianCG	BLEU 34.43 Exact Match Accuracy 10.2	MarianCG: a code generation transformer model inspired by machine translation 2022-11-22	코드 1
TranX + BERT w/mined	BLEU 34.2 Exact Match Accuracy 5.8	The impact of lexical and grammatical processing on generating code from natural language 2022-02-28	코드 1 · 코드 2
BERT + TAE	BLEU 33.41	Code Generation from Natural Language with Less Prior and More Monolingual Data 2021-01-01	코드 1
BERTMarian	BLEU 32.46 Exact Match Accuracy 12.40	Leveraging pre-trained language models for code generation 2024-02-29	코드 1
External Knowledge With API + Reranking	BLEU 32.26	Incorporating External Knowledge through Pre-training for Natural Language to Code Generation 2020-04-20	코드 1 · 코드 2
External Knowledge With API	BLEU 30.69	Incorporating External Knowledge through Pre-training for Natural Language to Code Generation 2020-04-20	코드 1 · 코드 2
BART W/ Mined	BLEU 30.55	Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation 2021-06-08	코드 1
ELECTRAMarian	BLEU 30.18 Exact Match Accuracy 10.0	Leveraging pre-trained language models for code generation 2024-02-29	코드 1
Reranker	BLEU 30.11 Exact Match Accuracy 2.8	Reranking for Neural Semantic Parsing 2019-07-01	연결 없음
LUKEMarian	BLEU 29.83 Exact Match Accuracy 7.6	Leveraging pre-trained language models for code generation 2024-02-29	코드 1
BART Base	BLEU 26.24	Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation 2021-06-08	코드 1
TranX	BLEU 24.30	TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation 2018-10-05	코드 1 · 코드 2 · 코드 3 · 코드 4