Image to Video Generation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 0
- 보존된 평가 기록
- 0
Image to Video Generation refers to the task of generating a sequence of video frames based on a single still image or a set of still images. The goal is to produce a video that is coherent and consistent in terms of appearance, motion, and style, while also being temporally consistent, meaning that the generated video should look like a coherent sequence of frames that are temporally ordered. This task is typically tackled using deep generative models, such as Generative Adversarial Networks (GANs) or Variational Autoencoders (VAEs), that are trained on large datasets of videos. The models learn to generate plausible video frames that are conditioned on the input image, as well as on any other auxiliary information, such as a sound or text track.
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/Lightricks/LTX-Video
공식 코드https://github.com/PKU-YuanGroup/ConsisID
공식 코드Identity-Preserving Text-to-Video Generation by Frequency Decomposition
https://github.com/PKU-YuanGroup/OpenS2V-Nexus
공식 코드OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generation
https://github.com/SobeyMIL/MVOC
공식 코드MVOC: a training-free multiple video object composition method with diffusion models
https://github.com/TIGER-AI-Lab/ConsistI2V
공식 코드ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generation
https://github.com/ai-forever/kandinsky-3
공식 코드https://github.com/alibaba/animate-anything
공식 코드AnimateAnything: Fine-Grained Open Domain Image Animation with Motion Guidance
https://github.com/antgroup/echomimic_v2
공식 코드EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animation
https://github.com/astra-vision/SceneRF
공식 코드SceneRF: Self-Supervised Monocular 3D Scene Reconstruction with Radiance Fields
https://github.com/bilibili/index-anisora
공식 코드AniSora: Exploring the Frontiers of Animation Video Generation in the Sora Era
https://github.com/da-group-pku/magic-1-for-1
공식 코드Magic 1-For-1: Generating One Minute Video Clips within One Minute
https://github.com/facebookresearch/AnimatedDrawings
공식 코드A Method for Animating Children's Drawings of the Human Figure
https://github.com/fudan-generative-vision/champ
공식 코드Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance
https://github.com/gulucaptain/videoassembler
공식 코드MagDiff: Multi-Alignment Diffusion for High-Fidelity Video Generation and Editing
https://github.com/hpcaitech/open-sora
공식 코드https://github.com/junting/seg2vid
공식 코드https://github.com/lichao-sun/mora
공식 코드Mora: Enabling Generalist Video Generation via A Multi-Agent Framework
https://github.com/litwellchi/mmtrail
공식 코드MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions
https://github.com/magref-video/magref
공식 코드https://github.com/mayuelala/followyourclick
공식 코드Follow-Your-Click: Open-domain Regional Image Animation via Short Prompts
https://github.com/merlresearch/TI2V-Zero
공식 코드TI2V-Zero: Zero-Shot Image Conditioning for Text-to-Video Diffusion Models
https://github.com/nihaomiao/cvpr23_lfdm
공식 코드Conditional Image-to-Video Generation with Latent Flow Diffusion Models
https://github.com/royorel/FFHQ-Aging-Dataset
공식 코드https://github.com/royorel/Lifespan_Age_Transformation_Synthesis
공식 코드https://github.com/shilin-lu/vine
공식 코드Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances
https://github.com/skyworkai/skyreels-a2
공식 코드SkyReels-A2: Compose Anything in Video Diffusion Transformers
https://github.com/stability-ai/generative-models
공식 코드Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets
https://github.com/stepfun-ai/step-video-ti2v
공식 코드Step-Video-TI2V Technical Report: A State-of-the-Art Text-Driven Image-to-Video Generation Model
https://github.com/stevenlsw/physgen
공식 코드PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generation
https://github.com/tiger-ai-lab/anyv2v
공식 코드AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Tasks
https://github.com/transpchan/Live3D
공식 코드https://github.com/vchitect/vbench
공식 코드VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Models
https://github.com/weixi-feng/tc-bench
공식 코드TC-Bench: Benchmarking Temporal Compositionality in Text-to-Video and Image-to-Video Generation
https://github.com/wengzejia1/genrec
공식 코드GenRec: Unifying Video Generation and Recognition with Diffusion Models
https://github.com/yangzhaojason/DualDiff
공식 코드DualDiff+: Dual-Branch Diffusion for High-Fidelity Video Generation with Reward Guidance
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.