MI-VisionShot: Few-shot adaptation of vision-language models for slide-level classification of histopathological images
원문 초록
Vision-language supervision has made remarkable strides in learning visual representations from textual guidance. In digital pathology, vision-language models (VLM), pre-trained on curated datasets of histological image-captions, have been adapted to downstream tasks, such as region of interest classification. Zero-shot transfer for slide-level prediction has been formulated by MI-Zero, but it exhibits high variability depending on the textual prompts. Inspired by prototypical learning, we propose MI-VisionShot, a training-free adaptation method on top of VLMs to predict slide-level labels in few-shot learning scenarios. Our framework takes advantage of the excellent representation learning of VLM to create prototype-based classifiers under a multiple-instance setting by retrieving the most discriminative patches within each slide. Experimentation through different settings shows the ability of MI-VisionShot to surpass zero-shot transfer with lower variability, even in low-shot scenarios. Code coming soon at thttps://github.com/cvblab/MIVisionShot.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Language-Guided Contrastive Audio-Visual Masked Autoencoder with Automatically Generated Audio-Visual-Text Triplets from Videos
Representation Learning through Multimodal Attention and Time-Sync Comments for Affective Video Content Analysis
Multi-modal Siamese Network for Entity Alignment
On Designing Diffusion Autoencoders for Efficient Generation and Representation Learning
Dual Dimensions Geometric Representation Learning Based Document Dewarping
Few-Shot Learning by Explicit Physics Integration: An Application to Groundwater Heat Transport
토론
이 논문과 연결된 포럼 글이 아직 없습니다.