Harnessing Caption Detailness for Data-Efficient Text-to-Image Generation
원문 초록
Training text-to-image (T2I) models with detailed captions can significantly improve their generation quality. Existing methods often rely on simplistic metrics like caption length to represent the detailness of the caption in the T2I training set. In this paper, we propose a new metric to estimate caption detailness based on two aspects: image coverage rate (ICR), which evaluates whether the caption covers all regions/objects in the image, and average object detailness (AOD), which quantifies the detailness of each object's description. Through experiments on the COCO dataset using ShareGPT4V captions, we demonstrate that T2I models trained on high-ICR and -AOD captions achieve superior performance on DPG and other benchmarks. Notably, our metric enables more effective data selection-training on only 20% of full data surpasses both full-dataset training and length-based selection method, improving alignment and reconstruction ability. These findings highlight the critical role of detail-aware metrics over length-based heuristics in caption selection for T2I tasks.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
CharaConsist: Fine-Grained Consistent Character Generation
NeoBabel: A Multilingual Open Tower for Visual Generation
Ovis-U1 Technical Report
Rethink Sparse Signals for Pose-guided Text-to-image Generation
XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulation
ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.