AI Paper Atlas

Research map / Image generation / Text-to-image diffusion

Watch Your Steps: Local Image and Scene Editing by Text Instructions

Ashkan Mirzaei, Tristan T Aumentado-Armstrong, Marcus A Brubaker, Jonathan Kelly, Alex Levinshtein, Konstantinos G Derpanis, Igor Gilitschenski

ECCV 2024 · Image generation › Text-to-image diffusion · approach: Text-driven synthesis and semantic guidance · 50 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add relevance-map mask guidance to IP2P image editingInstructPix2Pix · IP2P test set (5,000 images)CLIP image similarity vs text-image direction similarityImproved
raise mask threshold tau (ablation)relevance-guided image editing · IP2P test setimage similarity and edit successMixed
raise image guidance scale in IP2P instead of using relevance masks (ablation)InstructPix2Pix · IP2P test settext-image direction similarityHurt
add relevance field and relevance-guided edits to iterative NeRF dataset updatesIN2N · NeRF editing, 14 tasksEdit PSNR: 28.70 -> 31.01Improved
add relevance field and relevance-guided edits to iterative NeRF dataset updatesIN2N · NeRF editing, 14 tasksNIQE: 6.43 -> 5.53Improved
add relevance-guided localizationIN2N · NeRF editing, 14 tasksCLIP text-image similarity: 0.2683 -> 0.2673No clear effect
edit NeRF views with IP2P independently per frame (ablation)IP2P · NeRF editing, 14 tasksCLIP frame similarity: 0.9876 -> 0.9669 (ours vs per-frame IP2P)Hurt
add relevance field versus IN2N on CLIP edit similarityIN2N · NeRF editing, 14 tasksCLIP edit similarity: 0.8822 -> 0.8754No clear effect
compute relevance at high noise level t_rel = 0.8 (ablation)relevance map · relevance mapsmask quality (qualitative)Improved
supervise a relevance field from multiple views instead of single-view maps (ablation)relevance map · relevance mapsmask accuracy (qualitative)Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy