KARGEN: Knowledge-enhanced Automated Radiology Report Generation Using Large Language Models
원문 초록
Harnessing the robust capabilities of Large Language Models (LLMs) for narrative generation, logical reasoning, and common-sense knowledge integration, this study delves into utilizing LLMs to enhance automated radiology report generation (R2Gen). Despite the wealth of knowledge within LLMs, efficiently triggering relevant knowledge within these large models for specific tasks like R2Gen poses a critical research challenge. This paper presents KARGEN, a Knowledge-enhanced Automated radiology Report GENeration framework based on LLMs. Utilizing a frozen LLM to generate reports, the framework integrates a knowledge graph to unlock chest disease-related knowledge within the LLM to enhance the clinical utility of generated reports. This is achieved by leveraging the knowledge graph to distill disease-related features in a designed way. Since a radiology report encompasses both normal and disease-related findings, the extracted graph-enhanced disease-related features are integrated with regional image features, attending to both aspects. We explore two fusion methods to automatically prioritize and select the most relevant features. The fused features are employed by LLM to generate reports that are more sensitive to diseases and of improved quality. Our approach demonstrates promising results on the MIMIC-CXR and IU-Xray datasets.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
A Study on Neuro-Symbolic Artificial Intelligence: Healthcare Perspectives
Inference-Time Computations for LLM Reasoning and Planning: A Benchmark and Insights
KnowRA: Knowledge Retrieval Augmented Method for Document-level Relation Extraction with Comprehensive Reasoning Abilities
HEIE: MLLM-Based Hierarchical Explainable AIGC Image Implausibility Evaluator
LoSiA: Efficient High-Rank Fine-Tuning via Subnet Localization and Optimization
SoundMind: RL-Incentivized Logic Reasoning for Audio-Language Models
토론
이 논문과 연결된 포럼 글이 아직 없습니다.