Vispi: Automatic Visual Perception and Interpretation of Chest X-rays
원문 초록
Medical imaging contains the essential information for rendering diagnostic and treatment decisions. Inspecting (visual perception) and interpreting image to generate a report are tedious clinical routines for a radiologist where automation is expected to greatly reduce the workload. Despite rapid development of natural image captioning, computer-aided medical image visual perception and interpretation remain a challenging task, largely due to the lack of high-quality annotated image-report pairs and tailor-made generative models for sufficient extraction and exploitation of localized semantic features, particularly those associated with abnormalities. To tackle these challenges, we present Vispi, an automatic medical image interpretation system, which first annotates an image via classifying and localizing common thoracic diseases with visual support and then followed by report generation from an attentive LSTM model. Analyzing an open IU X-ray dataset, we demonstrate a superior performance of Vispi in disease classification, localization and report generation using automatic performance evaluation metrics ROUGE and CIDEr.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
ViCrit: A Verifiable Reinforcement Learning Proxy Task for Visual Perception in VLMs
NOVA: A Benchmark for Anomaly Localization and Clinical Reasoning in Brain MRI
A Cytology Dataset for Early Detection of Oral Squamous Cell Carcinoma
AI-Enhanced Pediatric Pneumonia Detection: A CNN-Based Approach Using Data Augmentation and Generative Adversarial Networks (GANs)
LangMamba: A Language-driven Mamba Framework for Low-dose CT Denoising with Vision-language Models
Hybrid-View Attention for csPCa Classification in TRUS
토론
이 논문과 연결된 포럼 글이 아직 없습니다.