FLDM-VTON: Faithful Latent Diffusion Model for Virtual Try-on
원문 초록
Despite their impressive generative performance, latent diffusion model-based virtual try-on (VTON) methods lack faithfulness to crucial details of the clothes, such as style, pattern, and text. To alleviate these issues caused by the diffusion stochastic nature and latent supervision, we propose a novel Faithful Latent Diffusion Model for VTON, termed FLDM-VTON. FLDM-VTON improves the conventional latent diffusion process in three major aspects. First, we propose incorporating warped clothes as both the starting point and local condition, supplying the model with faithful clothes priors. Second, we introduce a novel clothes flattening network to constrain generated try-on images, providing clothes-consistent faithful supervision. Third, we devise a clothes-posterior sampling for faithful inference, further enhancing the model performance over conventional clothes-agnostic Gaussian sampling. Extensive experimental results on the benchmark VITON-HD and Dress Code datasets demonstrate that our FLDM-VTON outperforms state-of-the-art baselines and is able to generate photo-realistic try-on images with faithful clothing details.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Real-Time Per-Garment Virtual Try-On with Temporal Consistency for Loose-Fitting Garments
Low-Barrier Dataset Collection with Real Human Body for Interactive Per-Garment Virtual Try-On
VITON-DRR: Details Retention Virtual Try-on via Non-rigid Registration
Inverse Virtual Try-On: Generating Multi-Category Product-Style Images from Clothed Individuals
VTBench: Comprehensive Benchmark Suite Towards Real-World Virtual Try-on Models
Incorporating Visual Correspondence into Diffusion Model for Virtual Try-On
토론
이 논문과 연결된 포럼 글이 아직 없습니다.