AI Paper Atlas

Research map / Multi-agent systems and games / LLM agents

Coding with Eyes: Visual Feedback Unlocks Reliable GUI Code Generating and Debugging

Zhilin Liu, Ye Huang, TingXie TingXie, Ruizhi Zhang, Wen Li, Lixin Duan

ECCV 2026 · Multi-agent systems and games › LLM agents · approach: GUI agent memory and trajectories · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add VF-Coder visual-feedback debuggingGemini-3-Flash · InteractGUI Bench (PySide6), Gemini-3-Flash base% Resolved: 21.68 -> 28.29Improved
Add Gemini CLI text-feedback agentGemini-3-Flash · InteractGUI Bench (PySide6), Gemini-3-Flash base% Resolved: 21.68 -> 24.81Improved
Add Cursor CLI text-feedback agentGemini-3-Flash · InteractGUI Bench (PySide6), Gemini-3-Flash baseAvg. Visual Score: 0.4284 -> 0.5028Improved
Add GUI Operator (visual interaction debugging) (ablation)VF-Coder · InteractGUI Bench ablation (Gemini-3-Flash)% Resolved: 24.79 -> 27.64Improved
Give Code Fixer the bug screenshot (ablation)VF-Coder · InteractGUI Bench ablation (Gemini-3-Flash)% Resolved: 27.64 -> 28.29Improved
Give Code Fixer the bug screenshot (ablation)VF-Coder · InteractGUI Bench ablation (Gemini-3-Flash)Avg. Visual Score: 0.5390 -> 0.5584Improved
VF-Coder vs Kimi Agent on 80-app subsetKimi-K2.5 · InteractGUI Bench subset (80 apps, manual), Kimi-K2.5 base% Resolved: 18.75 -> 25.00Improved
VF-Coder vs Kimi Agent on visual scoreKimi-K2.5 · InteractGUI Bench subset (80 apps, manual), Kimi-K2.5 baseAvg. Visual Score: 0.5648 -> 0.5530Hurt
Add VF-Coder on top of Bolt.diyBolt.diy · WebGen-BenchAccuracy (%): 31.8 -> 41.8Improved
Add VF-Coder on Design2Code-Hard text-heavy dimensionsGemini-3-Flash · Design2Code-Hard, Gemini-3-Flash baseText: Self-Revision 98.65 vs VF-Coder 96.31Mixed
Add VF-Coder vs Cursor CLI on costGemini-3-Flash · InteractGUI Bench (PySide6), Gemini-3-Flash baseAvg. cost ($): 0.1726 -> 0.2064Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy