Multi-Modal Hypergraph Diffusion Network with Dual Prior for Alzheimer Classification
원문 초록
The automatic early diagnosis of prodromal stages of Alzheimer's disease is of great relevance for patient treatment to improve quality of life. We address this problem as a multi-modal classification task. Multi-modal data provides richer and complementary information. However, existing techniques only consider either lower order relations between the data and single/multi-modal imaging data. In this work, we introduce a novel semi-supervised hypergraph learning framework for Alzheimer's disease diagnosis. Our framework allows for higher-order relations among multi-modal imaging and non-imaging data whilst requiring a tiny labelled set. Firstly, we introduce a dual embedding strategy for constructing a robust hypergraph that preserves the data semantics. We achieve this by enforcing perturbation invariance at the image and graph levels using a contrastive based mechanism. Secondly, we present a dynamically adjusted hypergraph diffusion model, via a semi-explicit flow, to improve the predictive uncertainty. We demonstrate, through our experiments, that our framework is able to outperform current techniques for Alzheimer's disease diagnosis.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Multimodal Learning with Uncertainty Quantification based on Discounted Belief Fusion
Hateful Meme Detection through Context-Sensitive Prompting and Fine-Grained Labeling
FAME-ViL: Multi-Tasking Vision-Language Model for Heterogeneous Fashion Tasks
Contrastive Audio-Visual Masked Autoencoder
UAVM: Towards Unifying Audio and Visual Models
On Modality Bias Recognition and Reduction
토론
이 논문과 연결된 포럼 글이 아직 없습니다.