OCC-MLLM:Empowering Multimodal Large Language Model For the Understanding of Occluded Objects
원문 초록
There is a gap in the understanding of occluded objects in existing large-scale visual language multi-modal models. Current state-of-the-art multimodal models fail to provide satisfactory results in describing occluded objects for visual-language multimodal models through universal visual encoders. Another challenge is the limited number of datasets containing image-text pairs with a large number of occluded objects. Therefore, we introduce a novel multimodal model that applies a newly designed visual encoder to understand occluded objects in RGB images. We also introduce a large-scale visual-language pair dataset for training large-scale visual-language multimodal models and understanding occluded objects. We start our experiments comparing with the state-of-the-art models.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generation
VIS-Shepherd: Constructing Critic for LLM-based Data Visualization Generation
KptLLM++: Towards Generic Keypoint Comprehension with Large Language Model
TalkFashion: Intelligent Virtual Try-On Assistant Based on Multimodal Large Language Model
ASCD: Attention-Steerable Contrastive Decoding for Reducing Hallucination in MLLM
CFBenchmark-MM: Chinese Financial Assistant Benchmark for Multimodal Large Language Model
토론
이 논문과 연결된 포럼 글이 아직 없습니다.