https://github.com/ControlNet/MARLIN
공식 코드MARLIN: Masked Autoencoder for facial video Representation LearnINg
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Talking head generation is the task of generating a talking face from a set of images of a person.
<span style="color:grey; opacity: 0.6">( Image credit: Few-Shot Adversarial Learning of Realistic Neural Talking Head Models )</span>
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
MARLIN: Masked Autoencoder for facial video Representation LearnINg
InsTaG: Learning Personalized 3D Talking Head from Few-Second Video
Write-a-speaker: Text-based Emotional and Rhythmic Talking-head Generation
EMOdiffhead: Continuously Emotional Control in Talking Head Generation via Diffusion
MoDiTalker: Motion-Disentangled Diffusion Model for High-Fidelity Talking Head Generation
MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptation
A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild
SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis
DreamTalk: When Emotional Talking Head Generation Meets Diffusion Probabilistic Models
Joint Co-Speech Gesture and Expressive Talking Face Generation using Diffusion with Adapters
Learning Landmarks Motion from Speech for Speaker-Agnostic 3D Talking Heads Generation
StyleTalk: One-shot Talking Head Generation with Controllable Speaking Styles
Depth-Aware Generative Adversarial Network for Talking Head Video Generation
AnimeCeleb: Large-Scale Animation CelebHeads Dataset for Head Reenactment
What comprises a good talking-head video generation?: A Survey and Benchmark
DiffDub: Person-generic Visual Dubbing Using Inpainting Renderer with Diffusion Auto-encoder
A Comprehensive Multi-scale Approach for Speech and Dynamics Synchrony in Talking Head Generation
Autoregressive GAN for Semantic Unconditional Head Motion Generation
Perceptual Conversational Head Generation with Regularized Driver and Enhanced Renderer
Comparative Analysis of Audio Feature Extraction for Real-Time Talking Portrait Synthesis
RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatars
Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatars
Adaptive Super Resolution For One-Shot Talking-Head Generation
Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesis
DiffTalk: Crafting Diffusion Models for Generalized Audio-Driven Portraits Animation
Txt2Vid: Ultra-Low Bitrate Compression of Talking-Head Videos via Text
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.