Research map / Image generation / Editing and style transfer
Program-Guided Image Manipulators
Jiayuan Mao, Xiuming Zhang, Yikai Li, William T. Freeman, Joshua B. Tenenbaum, Jiajun Wu
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| guide the neural painting network with induced programs instead of Non-Stationary single-image network | PG-IM · Nearly-Regular Patterns inpainting | L1 mean: 103.7 -> 21.48 | Improved |
| use PG-IM instead of GatedConv trained on Places365 | PG-IM · Nearly-Regular Patterns inpainting | L1 mean: 50.45 -> 21.48 | Improved |
| use PG-IM instead of GatedConv | PG-IM · Facade inpainting | L1 mean: 26.26 -> 14.40 | Improved |
| use PG-IM instead of PatchMatch | PG-IM · Facade inpainting | L1 mean: 81.35 -> 14.40 | Improved |
| use PG-IM instead of Image Quilting | PG-IM · Nearly-Regular Patterns inpainting | L1 mean: 12.30 -> 21.48 | Hurt |
| use PG-IM instead of Image Quilting | PG-IM · Facade inpainting | Inception Score: 1.217 -> 1.218 | Mixed |
| use PG-IM instead of Non-Stationary | PG-IM · Facade inpainting | Inception Score: 1.199 -> 1.218 | Improved |
| add object attribute reasoning to program | PG-IM · Attribute-aware extrapolation (Internet images) | qualitative colour regularity | Improved |
Closest papers by meaning
- Image Translation as Diffusion Visual Programmers (ICLR 2024 · similarity 0.85)
- Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulation (ICLR 2024 · similarity 0.84)
- Zero-Shot Robotic Manipulation with Pre-Trained Image-Editing Diffusion Models (ICLR 2024 · similarity 0.84)
- Learning to Manipulate Artistic Images (AAAI 2024 · similarity 0.83)
- Unleashing In-context Learning of Autoregressive Models for Few-shot Image Manipulation (CVPR 2025 · similarity 0.83)
- General Articulated Objects Manipulation in Real Images via Part-Aware Diffusion Process (NeurIPS 2024 · similarity 0.83)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
