atlas

Research map / Vision-language and multimodal / Human and embodied modeling

ScreenMark: Watermarking Arbitrary Visual Content on Screen

AAAI 2025 · Vision-language and multimodal › Human and embodied modeling · approach: Layout-aware document understanding · 3 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes ScreenMark, a learning-based watermark that diffuses bit messages into irregular screen-overlay patterns blended via pre-multiplied alpha, trained in three progressive stages, to protect arbitrary visual screen content against screenshots.

Problem

Watermarking for visual screen content (VSC) displayed on computer screens, which is multi-modal and dynamic and vulnerable to screenshot leakage; existing watermarks target single media types and cannot respond in real time to screen changes.

Approach

Instead of encoding messages into a carrier image, a message diffuser turns a 100-bit message into an irregular watermark pattern that is alpha-blended as a floating mask over any screen content; a screen decoder recovers it from screenshots, trained in three progressive stages with image-, pixel- and joint-level distorters.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use ScreenMark instead of DWSFImageNet image-level watermarking · ImageNet, image-level attacksBAR average (%): 96.60 -> 96.80Helped
Use ScreenMark instead of DWSFScreenImage image-level watermarking · ScreenImage, image-level attacksBAR average (%): 96.37 -> 98.82Helped
Use ScreenMark instead of DWSFImageNet pixel-level watermarking · ImageNet, pixel-level attacksBAR average (%): 97.50 -> 97.39Hurt
Use ScreenMark instead of MBRSScreenImage pixel-level watermarking · ScreenImage, pixel-level attacksBAR average (%): 97.36 -> 98.19Helped
Use ScreenMark instead of DWSFImageNet visual watermark quality · ImageNetPSNR: 41.47 -> 41.38Hurt
Use ScreenMark instead of PIMoGImageNet visual watermark quality · ImageNetSSIM: 0.9850 -> 0.9969Helped
Use ScreenMark instead of DWSFImageNet visual watermark quality · ImageNetLPIPS: 0.0083 -> 0.0058Helped
Use ScreenMark instead of DWSFScreenImage visual watermark quality · ScreenImagePSNR: 42.60 -> 41.86Hurt
Use ScreenMark instead of DWSFScreenImage visual watermark quality · ScreenImageSSIM: 0.9905 -> 0.9948Helped
Use ScreenMark instead of DWSFScreenImage visual watermark quality · ScreenImageLPIPS: 0.0074 -> 0.0055Helped
Use ScreenMark instead of single-modal watermark methodsVSC protection when screen content changes · VSC reaction timereaction time (ms): 14.91 -> 0Helped
Use three-stage progressive training instead of end-to-end training (ablation)ScreenMark · Training convergenceconvergence behaviorHelped

Surprising findings

Limitations

Experimental setup

Datasets: ScreenImage ImageNet

Benchmarks: ImageNet ScreenImage

Metrics: bit accuracy rate PSNR SSIM LPIPS reaction time

Baselines: StegaStamp MBRS PIMoG DWSF

Builds on: StegaStamp HiDDeN MBRS PIMoG DWSF

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy