atlas

Research map / Multi-agent systems and games / LLM agents

Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration

NeurIPS 2024 · Multi-agent systems and games › LLM agents · approach: LLM multi-agent decision making · 26 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes Mobile-Agent-v2, a training-free multi-agent framework (planning, decision, reflection agents plus a memory unit) for mobile device operation that improves task completion over single-agent Mobile-Agent.

Problem

Mobile device operation assistants built on single-agent MLLM architectures struggle to navigate task progress and focus content from long, interleaved image-text operation histories.

Approach

Split the single agent into three roles: a text-only planning agent that condenses history into task progress, a decision agent that acts and updates a memory unit of focus content, and a reflection agent that compares before/after screenshots to detect erroneous or ineffective operations.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use the Mobile-Agent-v2 multi-agent architecture instead of the single-agent Mobile-AgentMobile device operation assistant · Non-English and English mobile tasksSR: 5/10 -> 9/10 (non-English system basic); 3/10 -> 6/10 (non-English system advanced); 2/10 -> 8/10 (non-English external Helped
Inject manual operation knowledgeMobile-Agent-v2 · English external apps, advanced instructionsSR: 7/10 -> 9/10Helped
Add the planning agent (ablation)Mobile-Agent-v2 · Ablation evaluation, basic instructionsSR: 59.1 -> 88.6Helped
Add the memory unit (ablation)Mobile-Agent-v2 · Ablation evaluation, basic instructionsSR: 77.3 -> 88.6Helped
Add the reflection agent (ablation)Mobile-Agent-v2 · Ablation evaluation, basic instructionsSR: 86.4 -> 88.6Helped

Surprising findings

Limitations

Experimental setup

Benchmarks: Mobile-Agent-v2 dynamic evaluation (88 instructions, Chinese HarmonyOS and English Android)

Metrics: success rate completion rate decision accuracy reflection accuracy

Baselines: Mobile-Agent GPT-4V w/o agent Gemini-1.5-Pro Qwen-VL-Max

Builds on: Mobile-Agent AppAgent GroundingDINO

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy