Papers with Code 아카이브
Talking Face Generation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 2
- 평가표
- 2
- 보존된 평가 기록
- 2
Talking face generation aims to synthesize a sequence of face images that correspond to given speech semantics
<span style="color:grey; opacity: 0.6">( Image credit: Talking Face Generation by Adversarially Disentangled Audio-Visual Representation )</span>
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
UniSync: A Unified Framework for Audio-Visual Synchronization
PC-Talk: Precise Facial Animation Control for Audio-Driven Talking Face Generation
Playmate: Flexible Control of Portrait Animation via 3D-Implicit Space Guided Diffusion
JoyGen: Audio-Driven 3D Depth-Aware Talking-Face Video Editing
GLCF: A Global-Local Multimodal Coherence Analysis Framework for Talking Face Generation Detection
Joint Co-Speech Gesture and Expressive Talking Face Generation using Diffusion with Adapters
VQTalker: Towards Multilingual Talking Avatars through Facial Motion Tokenization
PortraitTalk: Towards Customizable One-Shot Audio-to-Talking Face Generation
Sonic: Shifting Focus to Global Audio Perception in Portrait Animation
MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes
JEAN: Joint Expression and Audio-guided NeRF-based Talking Face Generation
StyleTalk++: A Unified Framework for Controlling the Speaking Styles of Talking Heads
KAN-Based Fusion of Dual-Domain for Audio-Driven Facial Landmarks Generation
SegTalker: Segmentation-based Talking Face Generation with Mask-guided Local Editing
High-fidelity and Lip-synced Talking Face Synthesis via Landmark-based Diffusion Model
Emotional Conversation: Empowering Talking Faces with Cohesive Expression, Gaze and Pose Generation
Controllable Talking Face Generation by Implicit Facial Keypoints Editing
OpFlowTalker: Realistic and Natural Talking Face Generation via Optical Flow Guidance
Faces that Speak: Jointly Synthesising Talking Face and Speech from Text
SPEAK: Speech-Driven Pose and Emotion-Adjustable Talking Head Generation
SwapTalk: Audio-Driven Talking Face Generation with One-Shot Customization in Latent Space
Audio-Visual Speech Representation Expert for Enhanced Talking Face Video Generation and Evaluation
GSTalker: Real-time Audio-Driven Talking Face Generation via Deformable Gaussian Splatting
Deepfake Generation and Detection: A Benchmark and Survey
Superior and Pragmatic Talking Face Generation with Teacher-Student Framework
Style2Talker: High-Resolution Talking Head Generation with Emotion Style and Art Style
FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantization
G4G:A Generic Framework for High Fidelity Talking Face Generation with Fine-grained Intra-modal Alignment
AVI-Talking: Learning Audio-Visual Instructions for Expressive 3D Talking Face Generation
EmoSpeaker: One-shot Fine-grained Emotion-Controlled Talking Face Generation
EmoTalker: Emotionally Editable Talking Face Generation via Diffusion Model
Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis
DREAM-Talk: Diffusion-based Realistic Emotional Audio-driven Method for Single Image Talking Face Generation
VectorTalker: SVG Talking Face Generation with Progressive Vectorisation
GSmoothFace: Generalized Smooth Talking Face Generation via Fine Grained 3D Face Guidance
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.