Research map / Image generation / Autoregressive and latent generation
Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Introduces W-Bench, a benchmark evaluating eleven watermarking methods against image regeneration, global/local editing, and image-to-video generation, and proposes VINE, a robust watermarking model built on SDXL-Turbo with blur-based surrogate attacks.
Problem
Existing image watermarks are vulnerable to text-to-image-based image editing, regeneration, and image-to-video generation, which can erase embedded watermarks and threaten copyright protection.
Approach
Frequency analysis shows that T2I editing removes mid/high-frequency watermark patterns, so blurring distortions are used as differentiable surrogate attacks during training; the watermark encoder is built from the one-step SDXL-Turbo diffusion model with a condition adaptor, skip connections and zero-convolution layers, and optionally fine-tuned with a straight-through estimator through Instruct-
Key results
- VINE-Robust achieves 99.66% TPR@0.1%FPR under stochastic regeneration and 99.98% under deterministic regeneration, versus 91.09% and 92.13% for the strongest baselines reported, while keeping PSNR 37.34 dB.
- VINE-Base attains the best image quality (PSNR 40.51, SSIM 0.9954, LPIPS 0.0029, FID 0.08) among the compared methods.
- On image-to-video generation, VINE-Robust reaches 36.33% TPR@0.1%FPR, behind TrustMark's 39.60%, and the authors state I2V remains a limitation.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Add blurring distortions to the noise layer (ablation) | Simple UNet watermark encoder · Image editing (stochastic regeneration TPR@0.1%FPR) | TPR@0.1%FPR (%): 54.61 -> 86.85 | Helped |
| Add blurring distortions to the noise layer (ablation) | Simple UNet watermark encoder · Watermarked image quality (PSNR) | PSNR: 38.21 -> 35.85 | Hurt |
| Fine-tune with Instruct-Pix2Pix using a straight-through estimator (ablation) | Simple UNet with blurring distortions · Image editing (stochastic regeneration TPR@0.1%FPR) | TPR@0.1%FPR (%): 86.85 -> 98.59 | Helped |
| Fine-tune with Instruct-Pix2Pix using a straight-through estimator (ablation) | Simple UNet with blurring distortions · Watermarked image quality (PSNR) | PSNR: 35.85 -> 31.24 | Hurt |
| Replace Simple UNet with pretrained SDXL-Turbo using ControlNet conditioning (ablation) | Config C watermark encoder · Watermarked image quality (FID) | FID: 4.67 -> 2.87 | Hurt |
| Replace ControlNet with a condition adaptor (ablation) | SDXL-Turbo watermark encoder · Watermarked image quality (FID) | FID: 2.87 -> 0.53 | Helped |
| Replace ControlNet with a condition adaptor (ablation) | SDXL-Turbo watermark encoder · Global editing (UltraEdit TPR@0.1%FPR) | TPR@0.1%FPR (%): 70.69 -> 70.68 | No clear effect |
| Add skip connections and zero-convolution layers (ablation) | SDXL-Turbo with condition adaptor · Watermarked image quality (FID) | FID: 0.53 -> 0.08 | Helped |
| Add skip connections and zero-convolution layers (ablation) | SDXL-Turbo with condition adaptor · Deterministic regeneration (TPR@0.1%FPR) | TPR@0.1%FPR (%): 94.78 -> 99.25 | Helped |
| Fine-tune with Instruct-Pix2Pix (ablation) | VINE-B · Instruct-Pix2Pix global editing (TPR@0.1%FPR) | TPR@0.1%FPR (%): 96.30 -> 97.46 | Helped |
| Fine-tune with Instruct-Pix2Pix (ablation) | VINE-B · Watermarked image quality (PSNR) | PSNR: 40.51 -> 37.34 | Hurt |
| Use randomly initialized rather than pretrained weights (ablation) | VINE-R · Watermarked image quality (FID) | FID: 0.15 -> 1.03 | Hurt |
Surprising findings
- Bit accuracy and AUROC alone are insufficient: SSL shows higher bit accuracy than TrustMark but lower TPR@0.1%FPR because of a high false positive rate.
- Methods that perform well on local editing with UltraEdit do not transfer to global editing with the same model, indicating global editing degrades watermarks more.
Limitations
- Limited effectiveness against image-to-video generation (I2V), where TPR@0.1%FPR is low.
- Larger model than baselines, causing higher memory requirements and slower inference.
- Fine-tuning with Instruct-Pix2Pix in the straight-through estimator is needed to reach strong robustness, adding training cost.
Experimental setup
Datasets: OpenImage UltraEdit Instruct-Pix2Pix dataset
Benchmarks: W-Bench
Metrics: TPR@0.1%FPR TPR@1%FPR PSNR SSIM LPIPS FID bit accuracy AUROC
Baselines: MBRS CIN PIMoG RivaGAN SepMark DWTDCT DWTDCTSVD SSL StegaStamp TrustMark EditGuard
Builds on: SDXL-Turbo ControlNet Instruct-Pix2Pix StegaStamp WAVES
Closest papers by meaning
- An Undetectable Watermark for Generative Image Models (ICLR 2025 · similarity 0.88)
- Image Watermarks are Removable using Controllable Regeneration from Clean Noise (ICLR 2025 · similarity 0.88)
- Transferable Black-Box One-Shot Forging of Watermarks via Image Preference Models (NeurIPS 2025 · similarity 0.88)
- BitMark: Watermarking Bitwise Autoregressive Image Generative Models (NeurIPS 2025 · similarity 0.87)
- Safe-Sora: Safe Text-to-Video Generation via Graphical Watermarking (NeurIPS 2025 · similarity 0.87)
- A Locally Tokenized Generative Model for Robust Time-Series Watermarking (NeurIPS 2026 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
