atlas

Research map / 3D vision / NeRF and radiance fields

WateRF: Robust Watermarks in Radiance Fields for Protection of Copyrights

CVPR 2024 · 3D vision › NeRF and radiance fields · approach: Dynamic and editable NeRF · 27 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Fine-tunes pretrained NeRF models (Vanilla NeRF and TensoRF) so rendered images carry a binary watermark, using a DWT LL-subband input to a pretrained HiDDeN decoder and deferred back-propagation with a patch loss.

Problem

Watermarking NeRF-based 3D representations to protect copyright, where prior methods only work for either implicit or explicit NeRF and are not robust to distortions such as cropping.

Approach

Embed watermark bits into NeRF weights by fine-tuning with a frequency-domain loss: the rendered image's 2-level DWT LL subband is fed to a frozen pretrained HiDDeN decoder, and deferred back-propagation with a patch-wise loss (MAE, TV, SSIM) preserves quality while enabling full-resolution rendering; no encoder is needed at fine-tuning time.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
fine-tune NeRF with WateRF instead of CopyRNeRFNeRF watermarking · LLFF + Blender, 16 bitsbit accuracy (%): 91.16 -> 94.24Helped
fine-tune TensoRF with WateRFTensoRF · LLFF + Blender, 16 bitsbit accuracy (%): 91.16 -> 95.67Helped
use WateRF rather than CopyRNeRFNeRF · LLFF + Blender, 16 bitsPSNR: 26.29 -> 28.81Helped
use WateRF rather than CopyRNeRFTensoRF · LLFF + Blender, 16 bitsPSNR: 26.29 -> 32.79Helped
add DWT frequency-domain embedding instead of DFT (ablation)WateRF with TensoRF · LLFF + Blender, 16 bitsbit accuracy (%): 71.06 -> 95.67Helped
add DWT frequency-domain embedding instead of DCT (ablation)WateRF with TensoRF · LLFF + Blender, 16 bitsbit accuracy (%): 43.75 -> 95.67Helped
add DWT frequency-domain embedding rather than no frequency transform (ablation)WateRF with TensoRF · LLFF + Blender, 16 bitsbit accuracy (%): 72.68 -> 95.67Helped
use DWT level 2 rather than level 1 (ablation)WateRF with TensoRF · LLFF + Blender, 16 bitsbit accuracy (%): 91.16 -> 95.67Helped
use DWT level 2 rather than level 3 (ablation)WateRF with TensoRF · LLFF + Blender, 16 bitsbit accuracy (%): 90.96 -> 95.67Helped
use DWT level 2 rather than level 4 (ablation)WateRF with TensoRF · LLFF + Blender, 16 bitsbit accuracy (%): 85.02 -> 95.67Helped
add patch-wise loss (ablation)WateRF with NeRF · LLFF + Blender, 16 bitsbit accuracy: 82.47 -> 94.78Helped
add DWT (ablation)WateRF with NeRF · LLFF + Blender, 16 bitsbit accuracy: 43.54 -> 94.78Helped

Surprising findings

Limitations

Experimental setup

Datasets: Blender (NeRF synthetic) LLFF

Benchmarks: Blender LLFF

Metrics: bit accuracy PSNR SSIM LPIPS training time

Baselines: CopyRNeRF HiDDeN+NeRF

Builds on: HiDDeN NeRF TensoRF deferred back-propagation (ARF) CopyRNeRF

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy