RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformers
원문 초록
Recent advancements in video generation have enabled models to synthesize high-quality, minute-long videos. However, generating even longer videos with temporal coherence remains a major challenge, and existing length extrapolation methods lead to temporal repetition or motion deceleration. In this work, we systematically analyze the role of frequency components in positional embeddings and identify an intrinsic frequency that primarily governs extrapolation behavior. Based on this insight, we propose RIFLEx, a minimal yet effective approach that reduces the intrinsic frequency to suppress repetition while preserving motion consistency, without requiring any additional modifications. RIFLEx offers a true free lunch--achieving high-quality $2\times$ extrapolation on state-of-the-art video diffusion transformers in a completely training-free manner. Moreover, it enhances quality and enables $3\times$ extrapolation by minimal fine-tuning without long videos. Project page and codes: \href{https://riflex-video.github.io/}{https://riflex-video.github.io/.}
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
$I^{2}$-World: Intra-Inter Tokenization for Efficient Dynamic 4D Scene Forecasting
Scaling RL to Long Videos
Omni-Video: Democratizing Unified Video Understanding and Generation
PresentAgent: Multimodal Agent for Presentation Video Generation
Lost in Latent Space: An Empirical Study of Latent Diffusion Models for Physics Emulation
Epona: Autoregressive Diffusion World Model for Autonomous Driving
토론
이 논문과 연결된 포럼 글이 아직 없습니다.