MedCycle: Unpaired Medical Report Generation via Cycle-Consistency
원문 초록
Generating medical reports for X-ray images presents a significant challenge, particularly in unpaired scenarios where access to paired image-report data for training is unavailable. Previous works have typically learned a joint embedding space for images and reports, necessitating a specific labeling schema for both. We introduce an innovative approach that eliminates the need for consistent labeling schemas, thereby enhancing data accessibility and enabling the use of incompatible datasets. This approach is based on cycle-consistent mapping functions that transform image embeddings into report embeddings, coupled with report auto-encoding for medical report generation. Our model and objectives consider intricate local details and the overarching semantic context within images and reports. This approach facilitates the learning of effective mapping functions, resulting in the generation of coherent reports. It outperforms state-of-the-art results in unpaired chest X-ray report generation, demonstrating improvements in both language and clinical metrics.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
UMIT: Unifying Medical Imaging Tasks via Vision-Language Models
GEMA-Score: Granular Explainable Multi-Agent Score for Radiology Report Evaluation
Activating Associative Disease-Aware Vision Token Memory for LLM-Based X-ray Report Generation
A Survey of Medical Vision-and-Language Applications and Their Techniques
CXPMRG-Bench: Pre-training and Benchmarking for X-ray Medical Report Generation on CheXpert Plus Dataset
R2GenCSR: Retrieving Context Samples for Large Language Model based X-ray Medical Report Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.