AI Paper Atlas

Research map / Multi-agent systems and games / LLM agents

Mind2Web: Towards a Generalist Agent for the Web

NeurIPS 2023 · Multi-agent systems and games › LLM agents · approach: Agentic benchmarks and orchestration · 69 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
multi-choice QA formulation instead of direct generation of target element (ablation)MindAct Flan-T5-B · Mind2Web Cross-Taskstep success rate: 17.5 -> 41.0Helped
multi-choice QA formulation instead of direct generation (ablation)MindAct Flan-T5-B · Mind2Web Cross-Websitestep success rate: 11.0 -> 29.5Helped
scale Flan-T5 from Base to XL (ablation)MindAct · Mind2Web Cross-Taskstep success rate: 41.0 -> 52.0Helped
scale Flan-T5 from Base to XL (ablation)MindAct · Mind2Web Cross-Websitestep success rate: 29.5 -> 38.9Helped
scale Flan-T5 from Base to XL (ablation)MindAct · Mind2Web Cross-Domainstep success rate: 31.6 -> 39.6Helped
fine-tune Flan-T5-XL instead of zero-shot (ablation)MindAct Flan-T5-XL · Mind2Web Cross-Taskelement accuracy: 10.8 -> 52.0Helped
fine-tune Flan-T5-XL instead of zero-shot (ablation)MindAct Flan-T5-XL · Mind2Web Cross-Websiteelement accuracy: 7.8 -> 38.9Helped
random grouping of candidate options (5 seeds) (ablation)MindAct Flan-T5 · Mind2Web all splitsstep success rate: std < 1No clear effect
test on unseen websites/domains instead of seen websites (cross-task)MindAct Flan-T5-XL · Mind2Webstep success rate: 52.0 -> 38.9 (Cross-Website)Hurt
use GPT-4 in-context (3 shots) instead of GPT-3.5MindAct · Mind2Web Cross-Websiteelement accuracy: 19.3 -> 35.8Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy