MedMCQA

아카이브 평가 22건 · 마지막 적재/변경 2026-10-30

평가 기록

과거 수집 기록이며 최신 순위가 아닙니다. 데이터셋 버전·split·실험 조건과 지표 방향이 검증되지 않은 결과는 직접 비교할 수 없습니다. 날짜는 논문 날짜이며 최신 평가일을 뜻하지 않습니다.

표가 화면보다 넓으면 좌우로 스크롤하여 논문과 구현 링크를 확인하세요.

원본 기록 순서 · 순위 미부여
모델	원본 지표·값	논문	구현
Med-PaLM 2 (ER)	Test Set (Acc-%) 0.723	Towards Expert-Level Medical Question Answering with Large Language Models 2023-05-16	코드 1
Med-PaLM 2 (CoT+SC)	Test Set (Acc-%) 0.715	Towards Expert-Level Medical Question Answering with Large Language Models 2023-05-16	코드 1
Med-PaLM 2 (5-shot)	Test Set (Acc-%) 0.713	Towards Expert-Level Medical Question Answering with Large Language Models 2023-05-16	코드 1
VOD (BioLinkBERT)	Dev Set (Acc-%) 0.583 Test Set (Acc-%) 0.629	Variational Open-Domain Question Answering 2022-09-23	코드 1 · 코드 2
Codex 5-shot CoT	Dev Set (Acc-%) 0.597 Test Set (Acc-%) 0.627	Can large language models reason about medical questions? 2022-07-17	코드 1
BioMedGPT-10B	Test Set (Acc-%) 0.514	BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicine 2023-08-18	코드 1
PubmedBERT(Gu et al., 2022)	Dev Set (Acc-%) 0.40 Test Set (Acc-%) 0.41	MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answering 2022-03-27	코드 1
SciBERT (Beltagy et al., 2019)	Dev Set (Acc-%) 0.39 Test Set (Acc-%) 0.39	MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answering 2022-03-27	코드 1
BioBERT (Lee et al.,2020)	Dev Set (Acc-%) 0.38 Test Set (Acc-%) 0.37	MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answering 2022-03-27	코드 1
BERT (Devlin et al., 2019)-Base	Dev Set (Acc-%) 0.35 Test Set (Acc-%) 0.33	MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answering 2022-03-27	코드 1
Meditron-70B (CoT + SC)	Dev Set (Acc-%) 66.0	MEDITRON-70B: Scaling Medical Pretraining for Large Language Models 2023-11-27	코드 1
Flan-PaLM (540B, SC)	Dev Set (Acc-%) 0.576	Large Language Models Encode Clinical Knowledge 2022-12-26	코드 1
Flan-PaLM (540B, Few-shot)	Dev Set (Acc-%) 0.565	Large Language Models Encode Clinical Knowledge 2022-12-26	코드 1
PaLM (540B, Few-shot)	Dev Set (Acc-%) 0.545	Large Language Models Encode Clinical Knowledge 2022-12-26	코드 1
Flan-PaLM (540B, CoT)	Dev Set (Acc-%) 0.536	Large Language Models Encode Clinical Knowledge 2022-12-26	코드 1
GAL 120B (zero-shot)	Dev Set (Acc-%) 0.529	Galactica: A Large Language Model for Science 2022-11-16	코드 1
Flan-PaLM (62B, Few-shot)	Dev Set (Acc-%) 0.462	Large Language Models Encode Clinical Knowledge 2022-12-26	코드 1
PaLM (62B, Few-shot)	Dev Set (Acc-%) 0.434	Large Language Models Encode Clinical Knowledge 2022-12-26	코드 1
Flan-PaLM (8B, Few-shot)	Dev Set (Acc-%) 0.345	Large Language Models Encode Clinical Knowledge 2022-12-26	코드 1
BLOOM (few-shot, k=5)	Dev Set (Acc-%) 0.325	Galactica: A Large Language Model for Science 2022-11-16	코드 1
OPT (few-shot, k=5)	Dev Set (Acc-%) 0.296	Galactica: A Large Language Model for Science 2022-11-16	코드 1
PaLM (8B, Few-shot)	Dev Set (Acc-%) 0.267	Large Language Models Encode Clinical Knowledge 2022-12-26	코드 1