Research map / Video / Video generation
I2VGuard: Safeguarding Images against Misuse in Diffusion-based Image-to-Video Models
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Proposes I2VGuard, an adversarial perturbation method that adds imperceptible noise to images so that diffusion image-to-video models (SVD, CogVideoX, ControlNeXt-SVD) generate degraded, temporally inconsistent videos.
Problem
Protecting images from misuse in diffusion-based image-to-video generation, where generated videos can depict people or animals in harmful or copyright-infringing ways; prior image protections target editing rather than temporal video generation.
Approach
Combines a spatial encoder attack (push VAE latents toward a black-image target), a temporal attack (push temporal self-attention maps away from original maps), and a contrastive diffusion attack (pull predicted frames toward black target frames and away from original frames) into a white-box adversarial perturbation optimized on the input image.
Key results
- On SVD, guarded images reduce subject consistency from 95.86% to 91.57% and aesthetic quality from 56.76% to 53.42%.
- On CogVideoX, guarded images reduce subject consistency from 97.02% to 93.50%, with CogVideoX showing more resistance than SVD.
- Guarded images achieve PSNR 31.83 and SSIM 0.868 versus 26.22 and 0.774 for random noise of comparable strength.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Apply I2VGuard to the input image | SVD · SVD generated video | Subject Consistency (%): 95.86±2.62 -> 91.57±3.95 | Helped |
| Apply I2VGuard to the input image | SVD · SVD generated video | Motion Smoothness (%): 97.90±1.43 -> 97.18±1.21 | Helped |
| Apply I2VGuard to the input image | SVD · SVD generated video | Aesthetic Quality (%): 56.76±4.75 -> 53.42±4.93 | Helped |
| Apply I2VGuard to the input image | SVD · SVD generated video | Image Quality: 67.28±6.18 -> 64.38±8.23 | Helped |
| Apply I2VGuard to the input image | CogVideoX · CogVideoX generated video | Subject Consistency (%): 97.02±1.96 -> 93.50±3.58 | Helped |
| Apply I2VGuard to the input image | CogVideoX · CogVideoX generated video | Motion Smoothness (%): 99.19±0.27 -> 97.97±0.32 | Helped |
| Apply I2VGuard to the input image | CogVideoX · CogVideoX generated video | Aesthetic Quality (%): 59.94±5.53 -> 53.95±5.62 | Helped |
| Apply I2VGuard to the input image | CogVideoX · CogVideoX generated video | Image Quality: 67.60±6.49 -> 65.24±9.85 | Helped |
| Use I2VGuard rather than random noise for image perturbation | Input images · Original versus modified images | PSNR: 26.22±0.04 -> 31.83±0.19 | Helped |
| Use I2VGuard rather than random noise for image perturbation | Input images · Original versus modified images | SSIM: 0.774±0.003 -> 0.868±0.016 | Helped |
| Use I2VGuard rather than random noise for image perturbation | Input images · Original versus modified images | FID: 14.31 -> 16.78 | Hurt |
Surprising findings
- Random noise has little effect on generation because the VAE filters it out, while structured perturbations do degrade output.
- Pose control in ControlNeXt-SVD remains robust even when spatial appearance is distorted by the attack.
Limitations
- Evaluated only on white-box access to specific models; transferability is limited for stronger models like CogVideoX requiring larger noise.
- Small self-collected dataset of 300 images; no public benchmark.
- Protection time per image (minutes) and high GPU memory requirements.
Experimental setup
Datasets: 300-image dataset of people and animals with dynamic actions (self-collected)
Benchmarks: VBench
Metrics: PSNR SSIM FID Subject Consistency Motion Smoothness Aesthetic Quality Image Quality (MUSIQ)
Baselines: PhotoGuard Random Noise
Builds on: PhotoGuard Latent Diffusion Models Stable Video Diffusion
Closest papers by meaning
- DiffusionGuard: A Robust Defense Against Malicious Diffusion-based Image Editing (ICLR 2025 · similarity 0.88)
- AdvI2I: Adversarial Image Attack on Image-to-Image Diffusion Models (ICML 2025 · similarity 0.87)
- Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Model (NeurIPS 2024 · similarity 0.87)
- Pixel Is Not a Barrier: An Effective Evasion Attack for Pixel-Domain Diffusion Models (AAAI 2025 · similarity 0.86)
- OSV: One Step is Enough for High-Quality Image to Video Generation (CVPR 2025 · similarity 0.86)
- AdvPaint: Protecting Images from Inpainting Manipulation via Adversarial Attention Disruption (ICLR 2025 · similarity 0.86)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
