Medical Report Generation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 3
- 보존된 평가 기록
- 4
Medical report generation (MRG) is a task which focus on training AI to automatically generate professional report according the input image data. This can help clinicians make faster and more accurate decision since the task itself is both time consuming and error prone even for experienced doctors.
Aggfgg
Deep neural network and transformer based architecture are currently the most popular methods for this certain task, however, when we try to transfer out pre-trained model into this certain domain, their performance always degrade.
The following are some of the reasons why RSG is hard for pre-trained models:
- Language datasets in a particular domain can sometimes be quite different from the large number of datasets available on the Internet
- During the fine-tuning phase, datasets in the medical field are often unevenly distributed
More recently, multi-modal learning and contrastive learning have shown some inspiring results in this field, but it's still challenging and requires further attention.
Here are some additional readings to go deeper on the task:
On the Automatic Generation of Medical Imaging Reports
A scoping review of transfer learning research on medical image analysis using ImageNet
A Survey on Incorporating Domain Knowledge into Deep Learning for Medical Image Analysis
https://arxiv.org/abs/2004.12150
(Image credit : Transformers in Medical Imaging: A Survey)
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Lesion Guided Explainable Few Weak-shot Medical Report Generation
DeltaNet:Conditional Medical Report Generation for COVID-19 Diagnosis
Hybrid Reinforced Medical Report Generation with M-Linear Attention and Repetition Penalty
M^4I: Multi-modal Models Membership Inference
Representative Image Feature Extraction via Contrastive Learning Pretraining for Chest X-ray Report Generation
A Medical Semantic-Assisted Transformer for Radiographic Report Generation
Competence-based Multimodal Curriculum Learning for Medical Report Generation
A Self-Guided Framework for Radiology Report Generation
Cross-modal Clinical Graph Transformer for Ophthalmic Report Generation
A Benchmark for Automatic Medical Consultation System: Frameworks, Tasks and Datasets
AlignTransformer: Hierarchical Alignment of Visual Regions and Disease Tags for Medical Report Generation
Factored Attention and Embedding for Unstructured-view Topic-related Ultrasound Report Generation
Brain Cancer Survival Prediction on Treatment-na ive MRI using Deep Anchor Attention Learning with Vision Transformer
Transformers in Medical Imaging: A Survey
Auto-Encoding Knowledge Graph for Unsupervised Medical Report Generation
Weakly Supervised Contrastive Learning for Chest X-Ray Report Generation
Medical-VLBERT: Medical Visual Language BERT for COVID-19 CT Report Generation With Alternate Learning
Longer Version for "Deep Context-Encoding Network for Retinal Image Captioning"
Writing by Memorizing: Hierarchical Retrieval-based Medical Report Generation
Automated radiology report generation using conditioned transformers
VisualGPT: Data-efficient Adaptation of Pretrained Language Models for Image Captioning
Inspecting state of the art performance and NLP metrics in image-based medical report generation
Reinforced Medical Report Generation with X-Linear Attention and Repetition Penalty
DeepOpht: Medical Report Generation for Retinal Images via Deep Models and Visual Explanation
A Survey on Deep Learning and Explainability for Automatic Report Generation from Medical Images
Auxiliary Signal-Guided Knowledge Encoder-Decoder for Medical Report Generation
Rethinking and Improving Natural Language Generation with Layer-Wise Multi-View Decoding
Unifying Neural Learning and Symbolic Reasoning for Spinal Medical Report Generation
S4G: Amodal Single-view Single-Shot SE(3) Grasp Detection in Cluttered Scenes
Addressing Data Bias Problems for Chest X-ray Image Report Generation
Knowledge-driven Encode, Retrieve, Paraphrase for Medical Image Report Generation
On the Automatic Generation of Medical Imaging Reports
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.