Explaining latent representations of generative models with large multimodal models
원문 초록
Learning interpretable representations of data generative latent factors is an important topic for the development of artificial intelligence. With the rise of the large multimodal model, it can align images with text to generate answers. In this work, we propose a framework to comprehensively explain each latent variable in the generative models using a large multimodal model. We further measure the uncertainty of our generated explanations, quantitatively evaluate the performance of explanation generation among multiple large multimodal models, and qualitatively visualize the variations of each latent variable to learn the disentanglement effects of different generative models on explanations. Finally, we discuss the explanatory capabilities and limitations of state-of-the-art large multimodal models.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Adversarial Disentanglement by Backpropagation with Physics-Informed Variational Autoencoder
RealFactBench: A Benchmark for Evaluating Large Language Models in Real-World Fact-Checking
Dual-View Disentangled Multi-Intent Learning for Enhanced Collaborative Filtering
Instruction-Tuned Video-Audio Models Elucidate Functional Specialization in the Brain
Revisiting Cross-Modal Knowledge Distillation: A Disentanglement Approach for RGBD Semantic Segmentation
LiTEx: A Linguistic Taxonomy of Explanations for Understanding Within-Label Variation in Natural Language Inference
토론
이 논문과 연결된 포럼 글이 아직 없습니다.