Research map / Image generation / Editing and style transfer
Omni IIE Bench: Benchmarking the Practical Capabilities of Image Editing Models
Yujia Yang, Yuanxiang Wang, Zhenyu Guan, Tiankun Yang, Chenxi Bao, Haopeng Jin, Jinwen Luo, Xinyu Zuo, Lisheng Duan, Haijin Liang, Jin Ma, Xinming Wang and 2 more
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| move from single-turn to multi-turn editing | Qwen-image-edit · Omni IIE Bench | SSIM: 0.455 -> 0.391 | Hurt |
| move from single-turn to multi-turn editing | Qwen-image-edit · Omni IIE Bench | Overall: 0.687 -> 0.676 | Hurt |
| move from single-turn to multi-turn editing | MGIE · Omni IIE Bench | Overall: 0.520 -> 0.404 | Hurt |
| move from single-turn to multi-turn editing | InstructPix2Pix · Omni IIE Bench | Overall: 0.530 -> 0.549 | Mixed |
| move from single-turn to multi-turn editing | Qwen-image-edit · Omni IIE Bench | QA instruction compliance: 0.744 -> 0.818 | Improved |
| evaluate instruction compliance with QA in addition to image-similarity metrics | MGIE · Omni IIE Bench single-turn | QA instruction compliance: 0.070 | Hurt |
Closest papers by meaning
- I2EBench: A Comprehensive Benchmark for Instruction-based Image Editing (NeurIPS 2024 · similarity 0.91)
- ImgEdit: A Unified Image Editing Dataset and Benchmark (NeurIPS 2025 · similarity 0.90)
- KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Models (NeurIPS 2025 · similarity 0.90)
- EdiVal-Agent: An Object-Centric Framework for Automated, Fine-Grained Evaluation of Multi-Turn Editing (ICLR 2026 · similarity 0.90)
- UnicEdit-10M: A Dataset and Benchmark Breaking the Scale-Quality Barrier via Unified Verification for Reasoning-Enriched Edits (CVPR 2026 · similarity 0.90)
- Towards Scalable Human-aligned Benchmark for Text-guided Image Editing (CVPR 2025 · similarity 0.89)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
