Cross-Modal Information Maximization for Medical Imaging: CMIM
원문 초록
In hospitals, data are siloed to specific information systems that make the same information available under different modalities such as the different medical imaging exams the patient undergoes (CT scans, MRI, PET, Ultrasound, etc.) and their associated radiology reports. This offers unique opportunities to obtain and use at train-time those multiple views of the same information that might not always be available at test-time. In this paper, we propose an innovative framework that makes the most of available data by learning good representations of a multi-modal input that are resilient to modality dropping at test-time, using recent advances in mutual information maximization. By maximizing cross-modal information at train time, we are able to outperform several state-of-the-art baselines in two different settings, medical image classification, and segmentation. In particular, our method is shown to have a strong impact on the inference-time performance of weaker modalities.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Deep Modeling and Optimization of Medical Image Classification
Advancements in Medical Image Classification through Fine-Tuning Natural Domain Foundation Models
Learning Concept-Driven Logical Rules for Interpretable and Generalizable Medical Image Classification
Improving Generalizability of Kolmogorov-Arnold Networks via Error-Correcting Output Codes
V-EfficientNets: Vector-Valued Efficiently Scaled Convolutional Neural Network Models
FedGSCA: Medical Federated Learning with Global Sample Selector and Client Adaptive Adjuster under Label Noise
토론
이 논문과 연결된 포럼 글이 아직 없습니다.