Papers with Code · CC BY-SA 4.0

PubMedQA

아카이브 평가 30건 · 마지막 적재/변경 2026-10-30

평가 기록

과거 수집 기록이며 최신 순위가 아닙니다. 데이터셋 버전·split·실험 조건과 지표 방향이 검증되지 않은 결과는 직접 비교할 수 없습니다. 날짜는 논문 날짜이며 최신 평가일을 뜻하지 않습니다.

표가 화면보다 넓으면 좌우로 스크롤하여 논문과 구현 링크를 확인하세요.

원본 기록 순서 · 순위 미부여
모델	원본 지표·값	논문	구현
Meditron-70B (CoT + SC)	Accuracy 81.6	MEDITRON-70B: Scaling Medical Pretraining for Large Language Models 2023-11-27	코드 1
BioGPT-Large(1.5B)	Accuracy 81.0	BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining 2022-10-19	코드 1 · 코드 2 · 코드 3 · 코드 4
RankRAG-llama3-70B (Zero-Shot)	Accuracy 79.8	RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMs 2024-07-02	연결 없음
Med-PaLM 2 (5-shot)	Accuracy 79.2	Towards Expert-Level Medical Question Answering with Large Language Models 2023-05-16	코드 1
Flan-PaLM (540B, Few-shot)	Accuracy 79	Large Language Models Encode Clinical Knowledge 2022-12-26	코드 1
BioGPT(345M)	Accuracy 78.2	BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining 2022-10-19	코드 1 · 코드 2 · 코드 3 · 코드 4
Codex 5-shot CoT	Accuracy 78.2	Can large language models reason about medical questions? 2022-07-17	코드 1
Human Performance (single annotator)	Accuracy 78.0	PubMedQA: A Dataset for Biomedical Research Question Answering 2019-09-13	코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5
MetaGen Blended RAG (zero-shot)	Accuracy 77.9	MetaGen Blended RAG: Higher Accuracy for Domain-Specific Q&A Without Fine-Tuning 2025-05-23	코드 1
GAL 120B (zero-shot)	Accuracy 77.6	Galactica: A Large Language Model for Science 2022-11-16	코드 1
Flan-PaLM (62B, Few-shot)	Accuracy 77.2	Large Language Models Encode Clinical Knowledge 2022-12-26	코드 1
MediSwift-XL	Accuracy 76.8	MediSwift: Efficient Sparse Pre-trained Biomedical Language Models 2024-03-01	연결 없음
Flan-T5-XXL	Accuracy 76.80	Evaluation of large language model performance on the Biomedical Language Understanding and Reasoning Benchmark 2024-05-17	연결 없음
BioMedGPT-10B	Accuracy 76.1	BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicine 2023-08-18	코드 1
Claude 3 Opus (5-shot)	Accuracy 75.8	The Claude 3 Model Family: Opus, Sonnet, Haiku 2024-03-04	연결 없음
Flan-PaLM (540B, SC)	Accuracy 75.2	Large Language Models Encode Clinical Knowledge 2022-12-26	코드 1
Med-PaLM 2 (ER)	Accuracy 75.0	Towards Expert-Level Medical Question Answering with Large Language Models 2023-05-16	코드 1
Claude 3 Opus (zero-shot)	Accuracy 74.9	The Claude 3 Model Family: Opus, Sonnet, Haiku 2024-03-04	연결 없음
Med-PaLM 2 (CoT + SC)	Accuracy 74.0	Towards Expert-Level Medical Question Answering with Large Language Models 2023-05-16	코드 1
BLOOM (zero-shot)	Accuracy 73.6	Galactica: A Large Language Model for Science 2022-11-16	코드 1
CoT-T5-11B (1024 Shot)	Accuracy 73.42	The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning 2023-05-23	코드 1 · 코드 2
BioLinkBERT (large)	Accuracy 72.2	LinkBERT: Pretraining Language Models with Document Links 2022-03-29	코드 1
BioLinkBERT (base)	Accuracy 70.2	LinkBERT: Pretraining Language Models with Document Links 2022-03-29	코드 1
OPT (zero-shot)	Accuracy 70.2	Galactica: A Large Language Model for Science 2022-11-16	코드 1
Flan-PaLM (8B, Few-shot)	Accuracy 67.6	Large Language Models Encode Clinical Knowledge 2022-12-26	코드 1
BioELECTRA uncased	Accuracy 64.2	BioELECTRA:Pretrained Biomedical text Encoder using Discriminators 2021-06-11	코드 1
PaLM (62B, Few-shot)	Accuracy 57.8	Large Language Models Encode Clinical Knowledge 2022-12-26	코드 1
PubMedBERT uncased	Accuracy 55.84	Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing 2020-07-31	코드 1 · 코드 2
PaLM (540B, Few-shot)	Accuracy 55	Large Language Models Encode Clinical Knowledge 2022-12-26	코드 1
PaLM (8B, Few-shot)	Accuracy 34	Large Language Models Encode Clinical Knowledge 2022-12-26	코드 1