Temporal Context Matters: Enhancing Single Image Prediction with Disease Progression Representations
원문 초록
Clinical outcome or severity prediction from medical images has largely focused on learning representations from single-timepoint or snapshot scans. It has been shown that disease progression can be better characterized by temporal imaging. We therefore hypothesized that outcome predictions can be improved by utilizing the disease progression information from sequential images. We present a deep learning approach that leverages temporal progression information to improve clinical outcome predictions from single-timepoint images. In our method, a self-attention based Temporal Convolutional Network (TCN) is used to learn a representation that is most reflective of the disease trajectory. Meanwhile, a Vision Transformer is pretrained in a self-supervised fashion to extract features from single-timepoint images. The key contribution is to design a recalibration module that employs maximum mean discrepancy loss (MMD) to align distributions of the above two contextual representations. We train our system to predict clinical outcomes and severity grades from single-timepoint images. Experiments on chest and osteoarthritis radiography datasets demonstrate that our approach outperforms other state-of-the-art techniques.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
CNN-LSTM Hybrid Model for AI-Driven Prediction of COVID-19 Severity from Spike Sequences and Clinical Data
Diagnosing COVID-19 Severity from Chest X-Ray Images Using ViT and CNN Architectures
K-Paths: Reasoning over Graph Paths for Drug Repurposing and Drug Interaction Prediction
Explainable fault and severity classification for rolling element bearings using Kolmogorov-Arnold networks
HCT: Hybrid Convnet-Transformer for Parkinson's disease detection and severity prediction from gait
A generalized framework to predict continuous scores from medical ordinal labels
토론
이 논문과 연결된 포럼 글이 아직 없습니다.