Safe-Sora: Safe Text-to-Video Generation via Graphical Watermarking
원문 초록
The explosive growth of generative video models has amplified the demand for reliable copyright preservation of AI-generated content. Despite its popularity in image synthesis, invisible generative watermarking remains largely underexplored in video generation. To address this gap, we propose Safe-Sora, the first framework to embed graphical watermarks directly into the video generation process. Motivated by the observation that watermarking performance is closely tied to the visual similarity between the watermark and cover content, we introduce a hierarchical coarse-to-fine adaptive matching mechanism. Specifically, the watermark image is divided into patches, each assigned to the most visually similar video frame, and further localized to the optimal spatial region for seamless embedding. To enable spatiotemporal fusion of watermark patches across video frames, we develop a 3D wavelet transform-enhanced Mamba architecture with a novel spatiotemporal local scanning strategy, effectively modeling long-range dependencies during watermark embedding and retrieval. To the best of our knowledge, this is the first attempt to apply state space models to watermarking, opening new avenues for efficient and robust watermark protection. Extensive experiments demonstrate that Safe-Sora achieves state-of-the-art performance in terms of video quality, watermark fidelity, and robustness, which is largely attributed to our proposals. We will release our code upon publication.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
M4V: Multi-Modal Mamba for Text-to-Video Generation
MambaFusion: Height-Fidelity Dense Global Fusion for Multi-modal 3D Object Detection
LoViC: Efficient Long Video Generation with Context Compression
Adaptive Gate-Aware Mamba Networks for Magnetic Resonance Fingerprinting
EAGLE: An Efficient Global Attention Lesion Segmentation Model for Hepatic Echinococcosis
Video Perception Models for 3D Scene Synthesis
토론
이 논문과 연결된 포럼 글이 아직 없습니다.