atlas

Research map / Image generation / Autoregressive and latent generation

EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protection

CVPR 2024 · Image generation › Autoregressive and latent generation · approach: Robust diffusion watermarking · 91 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes EditGuard, a dual-watermark framework that embeds a localization image watermark and a 64-bit copyright watermark via a united image-bit steganography network, enabling zero-shot tamper localization of AIGC edits without tampered training data.

Problem

Existing deep image watermarking only protects copyright and cannot localize realistic AIGC-based tampering, while passive tamper localization methods generalize poorly to unseen tampering types and need tampered training data.

Approach

Exploits the fragility and locality of image-into-image steganography: a hidden localization image watermark is damaged exactly where the container is tampered, so comparing decoded and pre-defined watermarks yields a mask. Combined with bit-into-image steganography for copyright, the whole system is trained only on self-recovery with no tampered data, plus a prompt-based posterior estimation modu

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use EditGuard instead of the strongest listed passive localization baselineEditGuard · CAISAv1, Coverage, NIST16, and ColumbiaF1-score: 0.852 -> 0.954; 0.735 -> 0.955; 0.470 -> 0.911; 0.923 -> 0.988Helped
Use EditGuard instead of the strongest listed passive localization baselineEditGuard · Stable Diffusion Inpaint, ControlNet, SDXL, RePaint, Lama, and FaceSwapF1-score: 0.547 -> 0.966; 0.542 -> 0.968; 0.633 -> 0.965; 0.681 -> 0.967; 0.483 -> 0.965; 0.781 -> 0.896Helped
Use EditGuard rather than the watermarking baselinesEditGuard · COCO test images, Stable Diffusion Inpaint tamperingNIQE: 7.095 -> 5.567Helped
Add the lightweight feature interaction module (LFIM) (ablation)EditGuard · Stable Diffusion Inpaint, cleanIoU: 0.904 -> 0.936Helped
Add the transformer block (ablation)EditGuard · Stable Diffusion Inpaint, cleanIoU: 0.927 -> 0.936Helped
Add prompt-based fusion (ablation)EditGuard · Stable Diffusion Inpaint, random degradationsF1-score: 0.903 -> 0.938Helped
Use bi-level optimization rather than joint training of all components (ablation)EditGuard · Stable Diffusion Inpaint, cleanbit accuracy: 49.17 -> 99.95Helped

Surprising findings

Limitations

Experimental setup

Datasets: COCO CelebA CAISAv1 Coverage NIST16 Columbia

Benchmarks: CAISAv1 Coverage NIST16 Columbia AGE-Set-C AGE-Set-F

Metrics: F1-score AUC IoU bit accuracy PSNR SSIM NIQE

Baselines: MVSS-Net OSN PSCC-Net TruFor HiFi-Net IML-ViT MBRS CIN PIMoG SepMark

Builds on: HiDDeN invertible neural networks / flow-based steganography SepMark CIN

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy