Diffusion Video Autoencoders: Toward Temporally Consistent Face Video Editing via Disentangled Video Encoding
원문 초록
Inspired by the impressive performance of recent face image editing methods, several studies have been naturally proposed to extend these methods to the face video editing task. One of the main challenges here is temporal consistency among edited frames, which is still unresolved. To this end, we propose a novel face video editing framework based on diffusion autoencoders that can successfully extract the decomposed features - for the first time as a face video editing model - of identity and motion from a given video. This modeling allows us to edit the video by simply manipulating the temporally invariant feature to the desired direction for the consistency. Another unique strength of our model is that, since our model is based on diffusion models, it can satisfy both reconstruction and edit capabilities at the same time, and is robust to corner cases in wild face videos (e.g. occluded faces) unlike the existing GAN-based methods.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Causally Steered Diffusion for Automated Video Counterfactual Generation
FADE: Frequency-Aware Diffusion Model Factorization for Video Editing
Zero-to-Hero: Zero-Shot Initialization Empowering Reference-Based Video Appearance Editing
Video Editing for Audio-Visual Dubbing
DC-SAM: In-Context Segment Anything in Images and Videos via Dual Consistency
FlashDepth: Real-time Streaming Video Depth Estimation at 2K Resolution
토론
이 논문과 연결된 포럼 글이 아직 없습니다.