AI Paper Atlas

Research map / Image generation / Text-to-image diffusion

Generating Visual Scenes from Touch

Fengyu Yang, Jiacheng Zhang, Andrew Owens

ICCV 2023 · Image generation › Text-to-image diffusion · approach: Layout-to-image control · 27 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add touch signal to reflectance-to-image model (ablation)Visuo-tactile diffusion model · Touch and Go shading estimationFID: 40.7 -> 36.9Improved
add touch signal to reflectance-to-image model (ablation)Visuo-tactile diffusion model · Touch and Go shading estimationPSNR: 14.5 -> 15.4Improved
remove hands from generated images (ablation)Visuo-tactile diffusion model · Touch and Go touch-to-imageFID: 48.7 -> 81.5Hurt
remove hands from generated images (ablation)Visuo-tactile diffusion model · Touch and Go touch-to-imageCVTP and material consistency: CVTP 0.12 -> 0.12; material 0.22 -> 0.24No clear effect
use latent diffusion with touch conditioning instead of Pix2Pix-based VisGel modeltouch-to-image generation · Touch and GoFID: 128.3 -> 48.7Improved
use latent diffusion instead of Pix2Pix-based VisGel modeltouch-to-image generation · VisGelPSNR: 17.9 -> 21.5Improved
use diffusion stylization instead of Yang et al.tactile-driven image stylization · Touch and GoFID: 22.5 -> 15.8Improved
condition on touch embedding from contrastive pretraining instead of unconditional or no pretraining (ablation)touch-to-image generation · Touch and Gogeneration qualityImproved
provide 5 GelSight frames instead of a single frame (ablation)touch conditioning · Touch and Gogeneration qualityImproved
increase denoising starting point N in stylization (ablation)tactile-driven image stylization · Touch and Gocontent preservation versus style matchMixed

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy