TC4D: Trajectory-Conditioned Text-to-4D Generation
원문 초록
Recent techniques for text-to-4D generation synthesize dynamic 3D scenes using supervision from pre-trained text-to-video models. However, existing representations for motion, such as deformation models or time-dependent neural representations, are limited in the amount of motion they can generate-they cannot synthesize motion extending far beyond the bounding box used for volume rendering. The lack of a more flexible motion model contributes to the gap in realism between 4D generation methods and recent, near-photorealistic video generation models. Here, we propose TC4D: trajectory-conditioned text-to-4D generation, which factors motion into global and local components. We represent the global motion of a scene's bounding box using rigid transformation along a trajectory parameterized by a spline. We learn local deformations that conform to the global trajectory using supervision from a text-to-video model. Our approach enables the synthesis of scenes animated along arbitrary trajectories, compositional scene generation, and significant improvements to the realism and amount of generated motion, which we evaluate qualitatively and through a user study. Video results can be viewed on our website: https://sherwinbahmani.github.io/tc4d.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
$I^{2}$-World: Intra-Inter Tokenization for Efficient Dynamic 4D Scene Forecasting
HoloTime: Taming Video Diffusion Models for Panoramic 4D Scene Generation
World Model-Based End-to-End Scene Generation for Accident Anticipation in Autonomous Driving
WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actions
Scene Splatter: Momentum 3D Scene Generation from Single Image with Video Diffusion Model
WorldPrompter: Traversable Text-to-Scene Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.