Text-guided Eyeglasses Manipulation with Spatial Constraints
원문 초록
Virtual try-on of eyeglasses involves placing eyeglasses of different shapes and styles onto a face image without physically trying them on. While existing methods have shown impressive results, the variety of eyeglasses styles is limited and the interactions are not always intuitive or efficient. To address these limitations, we propose a Text-guided Eyeglasses Manipulation method that allows for control of the eyeglasses shape and style based on a binary mask and text, respectively. Specifically, we introduce a mask encoder to extract mask conditions and a modulation module that enables simultaneous injection of text and mask conditions. This design allows for fine-grained control of the eyeglasses' appearance based on both textual descriptions and spatial constraints. Our approach includes a disentangled mapper and a decoupling strategy that preserves irrelevant areas, resulting in better local editing. We employ a two-stage training scheme to handle the different convergence speeds of the various modality conditions, successfully controlling both the shape and style of eyeglasses. Extensive comparison experiments and ablation analyses demonstrate the effectiveness of our approach in achieving diverse eyeglasses styles while preserving irrelevant areas.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Real-Time Per-Garment Virtual Try-On with Temporal Consistency for Loose-Fitting Garments
Low-Barrier Dataset Collection with Real Human Body for Interactive Per-Garment Virtual Try-On
VITON-DRR: Details Retention Virtual Try-on via Non-rigid Registration
Inverse Virtual Try-On: Generating Multi-Category Product-Style Images from Clothed Individuals
VTBench: Comprehensive Benchmark Suite Towards Real-World Virtual Try-on Models
Incorporating Visual Correspondence into Diffusion Model for Virtual Try-On
토론
이 논문과 연결된 포럼 글이 아직 없습니다.