atlas

Research map / Image generation / Autoregressive and latent generation

Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances

ICLR 2025 · Image generation › Autoregressive and latent generation · approach: Robust diffusion watermarking · 0 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Introduces W-Bench, a benchmark evaluating eleven watermarking methods against image regeneration, global/local editing, and image-to-video generation, and proposes VINE, a robust watermarking model built on SDXL-Turbo with blur-based surrogate attacks.

Problem

Existing image watermarks are vulnerable to text-to-image-based image editing, regeneration, and image-to-video generation, which can erase embedded watermarks and threaten copyright protection.

Approach

Frequency analysis shows that T2I editing removes mid/high-frequency watermark patterns, so blurring distortions are used as differentiable surrogate attacks during training; the watermark encoder is built from the one-step SDXL-Turbo diffusion model with a condition adaptor, skip connections and zero-convolution layers, and optionally fine-tuned with a straight-through estimator through Instruct-

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add blurring distortions to the noise layer (ablation)Simple UNet watermark encoder · Image editing (stochastic regeneration TPR@0.1%FPR)TPR@0.1%FPR (%): 54.61 -> 86.85Helped
Add blurring distortions to the noise layer (ablation)Simple UNet watermark encoder · Watermarked image quality (PSNR)PSNR: 38.21 -> 35.85Hurt
Fine-tune with Instruct-Pix2Pix using a straight-through estimator (ablation)Simple UNet with blurring distortions · Image editing (stochastic regeneration TPR@0.1%FPR)TPR@0.1%FPR (%): 86.85 -> 98.59Helped
Fine-tune with Instruct-Pix2Pix using a straight-through estimator (ablation)Simple UNet with blurring distortions · Watermarked image quality (PSNR)PSNR: 35.85 -> 31.24Hurt
Replace Simple UNet with pretrained SDXL-Turbo using ControlNet conditioning (ablation)Config C watermark encoder · Watermarked image quality (FID)FID: 4.67 -> 2.87Hurt
Replace ControlNet with a condition adaptor (ablation)SDXL-Turbo watermark encoder · Watermarked image quality (FID)FID: 2.87 -> 0.53Helped
Replace ControlNet with a condition adaptor (ablation)SDXL-Turbo watermark encoder · Global editing (UltraEdit TPR@0.1%FPR)TPR@0.1%FPR (%): 70.69 -> 70.68No clear effect
Add skip connections and zero-convolution layers (ablation)SDXL-Turbo with condition adaptor · Watermarked image quality (FID)FID: 0.53 -> 0.08Helped
Add skip connections and zero-convolution layers (ablation)SDXL-Turbo with condition adaptor · Deterministic regeneration (TPR@0.1%FPR)TPR@0.1%FPR (%): 94.78 -> 99.25Helped
Fine-tune with Instruct-Pix2Pix (ablation)VINE-B · Instruct-Pix2Pix global editing (TPR@0.1%FPR)TPR@0.1%FPR (%): 96.30 -> 97.46Helped
Fine-tune with Instruct-Pix2Pix (ablation)VINE-B · Watermarked image quality (PSNR)PSNR: 40.51 -> 37.34Hurt
Use randomly initialized rather than pretrained weights (ablation)VINE-R · Watermarked image quality (FID)FID: 0.15 -> 1.03Hurt

Surprising findings

Limitations

Experimental setup

Datasets: OpenImage UltraEdit Instruct-Pix2Pix dataset

Benchmarks: W-Bench

Metrics: TPR@0.1%FPR TPR@1%FPR PSNR SSIM LPIPS FID bit accuracy AUROC

Baselines: MBRS CIN PIMoG RivaGAN SepMark DWTDCT DWTDCTSVD SSL StegaStamp TrustMark EditGuard

Builds on: SDXL-Turbo ControlNet Instruct-Pix2Pix StegaStamp WAVES

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy