Look, Listen and Recognise: Character-Aware Audio-Visual Subtitling
원문 초록
The goal of this paper is automatic character-aware subtitle generation. Given a video and a minimal amount of metadata, we propose an audio-visual method that generates a full transcript of the dialogue, with precise speech timestamps, and the character speaking identified. The key idea is to first use audio-visual cues to select a set of high-precision audio exemplars for each character, and then use these exemplars to classify all speech segments by speaker identity. Notably, the method does not require face detection or tracking. We evaluate the method over a variety of TV sitcoms, including Seinfeld, Fraiser and Scrubs. We envision this system being useful for the automatic generation of subtitles to improve the accessibility of the vast amount of videos available on modern streaming services. Project page : \url{https://www.robots.ox.ac.uk/~vgg/research/look-listen-recognise/}
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Colors Matter: AI-Driven Exploration of Human Feature Colors
Transforming faces into video stories -- VideoFace2.0
Robust AI-Generated Face Detection with Imbalanced Data
FairDeFace: Evaluating the Fairness and Adversarial Robustness of Face Obfuscation Methods
MTCAE-DFER: Multi-Task Cascaded Autoencoder for Dynamic Facial Expression Recognition
Leveraging Content and Context Cues for Low-Light Image Enhancement
토론
이 논문과 연결된 포럼 글이 아직 없습니다.