Medical Report Generation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 3
- 보존된 평가 기록
- 4
Medical report generation (MRG) is a task which focus on training AI to automatically generate professional report according the input image data. This can help clinicians make faster and more accurate decision since the task itself is both time consuming and error prone even for experienced doctors.
Aggfgg
Deep neural network and transformer based architecture are currently the most popular methods for this certain task, however, when we try to transfer out pre-trained model into this certain domain, their performance always degrade.
The following are some of the reasons why RSG is hard for pre-trained models:
- Language datasets in a particular domain can sometimes be quite different from the large number of datasets available on the Internet
- During the fine-tuning phase, datasets in the medical field are often unevenly distributed
More recently, multi-modal learning and contrastive learning have shown some inspiring results in this field, but it's still challenging and requires further attention.
Here are some additional readings to go deeper on the task:
On the Automatic Generation of Medical Imaging Reports
A scoping review of transfer learning research on medical image analysis using ImageNet
A Survey on Incorporating Domain Knowledge into Deep Learning for Medical Image Analysis
https://arxiv.org/abs/2004.12150
(Image credit : Transformers in Medical Imaging: A Survey)
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
A Survey on Trustworthiness in Foundation Models for Medical Image Analysis
Towards a Holistic Framework for Multimodal Large Language Models in Three-dimensional Brain CT Report Generation
CoMT: Chain-of-Medical-Thought Reduces Hallucination in Medical Report Generation
Structural Entities Extraction and Patient Indications Incorporation for Chest X-ray Report Generation
Factual Serialization Enhancement: A Key Innovation for Chest X-ray Report Generation
Topicwise Separable Sentence Retrieval for Medical Report Generation
GSCo: Towards Generalizable AI in Medicine via Generalist-Specialist Collaboration
Prompt-Guided Generation of Structured Chest X-Ray Report Using a Pre-trained LLM
Dia-LLaMA: Towards Large Language Model-driven CT Report Generation
MedCycle: Unpaired Medical Report Generation via Cycle-Consistency
HistGen: Histopathology Report Generation via Local-Global Feature Encoding and Cross-modal Context Interaction
Vision-Language Models for Medical Report Generation and Visual Question Answering: A Review
ICON: Improving Inter-Report Consistency in Radiology Report Generation via Lesion-aware Mixup Augmentation
Unmasking and Quantifying Racial Bias of Large Language Models in Medical Report Generation
Dynamic Traceback Learning for Medical Report Generation
PeFoMed: Parameter Efficient Fine-tuning of Multimodal Large Language Models for Medical Imaging
Medical Report Generation based on Segment-Enhanced Contrastive Representation Learning
Improving Medical Report Generation with Adapter Tuning and Knowledge Enhancement in Vision-Language Foundation Models
Complex Organ Mask Guided Radiology Report Generation
RECAP: Towards Precise Radiology Report Generation via Dynamic Disease Progression Reasoning
C^2M-DoT: Cross-modal consistent multi-view medical report generation with domain transfer network
PromptMRG: Diagnosis-Driven Prompts for Medical Report Generation
IIHT: Medical Report Generation with Image-to-Indicator Hierarchical Transformer
Rethinking Medical Report Generation: Disease Revealing Enhancement with Knowledge Graph
CausalVLR: A Toolbox and Benchmark for Visual-Linguistic Causal Reasoning
ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoning
Multi-modal Pre-training for Medical Vision-language Understanding and Generation: An Empirical Study with A New Benchmark
Customizing General-Purpose Foundation Models for Medical Report Generation
Act Like a Radiologist: Radiology Report Generation across Anatomical Regions
Automatic Radiology Report Generation by Learning with Increasingly Hard Negatives
Boosting Radiology Report Generation by Infusing Comparison Prior
Interactive and Explainable Region-guided Radiology Report Generation
MvCo-DoT:Multi-View Contrastive Domain Transfer Network for Medical Report Generation
Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report Generation
Cross-Modal Causal Intervention for Medical Report Generation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.