Research map / Image generation / GANs
SESAME: Semantic Editing of Scenes by Adding, Manipulating or Erasing Objects
Evangelos Ntavelis, Andrés Romero, Iason Kastanis, Luc Van Gool, Radu Timofte
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add SESAME discriminator in place of PatchGAN (ablation) | Hong et al. generator, Full labels · Cityscapes addition | mIoU: 60.7 -> 64.0 | Improved |
| add SESAME discriminator in place of PatchGAN (ablation) | Hong et al. generator, Full labels · Cityscapes addition | FID: 12.11 -> 11.76 | Improved |
| use SESAME generator in place of Hong et al. generator (ablation) | PatchGAN, BBox labels · Cityscapes addition | FID: 11.50 -> 11.13 | Improved |
| use SESAME discriminator with SESAME generator (ablation) | SESAME generator, BBox labels · ADE20k addition | FID: 28.16 -> 26.66 | Improved |
| use BBox semantics instead of Full semantics (ablation) | Hong et al. generator + PatchGAN · Cityscapes addition | FID: 12.11 -> 11.50 | Improved |
| use BBox semantics instead of Full semantics (ablation) | Hong et al. generator + PatchGAN · ADE20k addition | FID: 28.48 -> 28.36 | No clear effect |
| add SESAME discriminator in place of PatchGAN (ablation) | Pix2PixHD generator · Cityscapes label-to-image generation | FID: 95.0 -> 55.4 | Improved |
| add SESAME discriminator in place of PatchGAN (ablation) | SPADE generator · Cityscapes label-to-image generation | FID: 71.8 -> 54.2 | Improved |
| add SESAME discriminator in place of PatchGAN (ablation) | SPADE generator · ADE20k label-to-image generation | mIoU: 38.5 -> 49.0 | Improved |
| merge streams with concatenation or element-wise product instead of Sum Global Pooling (ablation) | SESAME discriminator · Cityscapes addition | FID: 11.96 and 12.02 | Improved |
| replace SESAME discriminator with PatchGAN for object replacement (ablation) | SESAME generator · Cityscapes object replacement | FID: 10.63 -> 9.3 | Improved |
| add SESAME discriminator with Pix2PixHD++ generator (Full semantics) (ablation) | SPADEPix2PixHD generator · Cityscapes addition | FID: 11.92 -> 12.74 | Hurt |
Later papers that compared with this method
5 later accepted papers report Sesame as a baseline in their results tables; 5 of them report a better number on most of the results they share with it.
- CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matching (NeurIPS 2025 · better on 1 of 1 shared result)
- Fractional Diffusion Bridge Models (NeurIPS 2025 · better on 1 of 1 shared result)
- Context-Consistent Semantic Image Editing with Style-Preserved Modulation (ECCV 2022 · better on 12 of 12 shared results)
- Retrieval-Based Spatially Adaptive Normalization for Semantic Image Synthesis (CVPR 2022 · better on 2 of 3 shared results)
- Semantic Layout Manipulation With High-Resolution Sparse Attention (TPAMI 2022 · better on 3 of 3 shared results)
Matched by method name in results tables read by AI. Authors' own tables tend to favour the newer method, and a comparison can be missed when a method is renamed.
Closest papers by meaning
- Linear Semantics in Generative Adversarial Networks (CVPR 2021 · similarity 0.90)
- EditGAN: High-Precision Semantic Image Editing (NeurIPS 2021 · similarity 0.90)
- Navigating the GAN Parameter Space for Semantic Image Editing (CVPR 2021 · similarity 0.90)
- Semantic Image Manipulation Using Scene Graphs (CVPR 2020 · similarity 0.89)
- Semantic Pyramid for Image Generation (CVPR 2020 · similarity 0.89)
- Editing in Style: Uncovering the Local Semantics of GANs (CVPR 2020 · similarity 0.89)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
