← Code Completion

Papers with Code · CC BY-SA 4.0

SAFIM

아카이브 평가 15건 · 마지막 적재/변경 2026-10-30

원본 데이터셋 링크 1

평가 기록

과거 수집 기록이며 최신 순위가 아닙니다. 데이터셋 버전·split·실험 조건과 지표 방향이 검증되지 않은 결과는 직접 비교할 수 없습니다. 날짜는 논문 날짜이며 최신 평가일을 뜻하지 않습니다.

표가 화면보다 넓으면 좌우로 스크롤하여 논문과 구현 링크를 확인하세요.

원본 기록 순서 · 순위 미부여
모델	원본 지표·값	논문	구현
deepseek-coder-33b-base	Algorithmic 60.78 Average 69.01 Control 71.10 API 75.16	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks 2024-03-07	코드 1
deepseek-coder-6.7b-base	Algorithmic 54.74 Average 63.40 Control 65.79 API 69.68	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks 2024-03-07	코드 1
starcoderbase	Algorithmic 44.11 Average 55.54 Control 54.46 API 68.06	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks 2024-03-07	코드 1
gpt-4-1106-preview	Algorithmic 42.11 Average 53.28 Control 55.15 API 62.58	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks 2024-03-07	코드 1
CodeLlama-13b-hf	Algorithmic 41.41 Average 52.78 Control 57.25 API 59.68	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks 2024-03-07	코드 1
deepseek-coder-1.3b-base	Algorithmic 41.20 Average 52.63 Control 54.10 API 62.58	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks 2024-03-07	코드 1
CodeLlama-34b-hf	Algorithmic 38.55 Average 49.66 Control 53.98 API 56.45	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks 2024-03-07	코드 1
CodeLlama-7b-hf	Algorithmic 34.68 Average 45.00 Control 53.56 API 46.77	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks 2024-03-07	코드 1
gpt-3.5-turbo-0301	Algorithmic 31.24 Average 40.86 Control 37.48 API 53.87	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks 2024-03-07	코드 1
incoder-6B	Algorithmic 25.16 Average 33.79 Control 28.16 API 48.06	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks 2024-03-07	코드 1
codegen-16B-multi	Algorithmic 25.94 Average 30.99 Control 35.74 API 31.29	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks 2024-03-07	코드 1
codegen-2B-multi	Algorithmic 23.49 Average 29.55 Control 32.89 API 32.26	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks 2024-03-07	코드 1
incoder-1B	Algorithmic 21.06 Average 29.27 Control 22.89 API 43.87	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks 2024-03-07	코드 1
codegen-6B-multi	Algorithmic 23.60 Average 28.71 Control 34.80 API 27.74	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks 2024-03-07	코드 1
codegen-350M-multi	Algorithmic 16.30 Average 22.94 Control 26.06 API 26.45	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks 2024-03-07	코드 1