AI Paper Atlas

Research map / Reinforcement learning / Visual and representation RL

Explore with Long-term Memory: A Benchmark and Multimodal LLM-based Reinforcement Learning Framework for Embodied Exploration

Sen Wang, Bangwei Liu, Zhenkun Gao, Lizhuang Ma, Xuhong Wang, Yuan Xie, Xin Tan

CVPR 2026 · Reinforcement learning › Visual and representation RL · approach: In-context and adaptive RL · 13 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
train with RL on navigation only (no memory tool) (ablation)RA-Mem · LMEE-Bench (58-task subset)Nav SR: 20.96 -> 20.59No clear effect
add memory retrieval tool in RL training (ablation)RA-Mem · LMEE-Bench (58-task subset)QA Score: 35.52 -> 43.62Improved
add memory retrieval tool in RL training (ablation)RA-Mem · LMEE-Bench (58-task subset)Nav SR: 20.96 -> 23.53Improved
add action-frontier consistency penalty (ablation)MemoryExplorer · LMEE-Bench (58-task subset)Nav SR: 22.43 -> 23.53Improved
add tool-usage penalty (ablation)MemoryExplorer · LMEE-Bench (58-task subset)Nav SR: 21.32 -> 23.53Improved
add tool-usage penalty (ablation)MemoryExplorer · LMEE-Bench (58-task subset)QA Score: 41.03 -> 43.62Improved
train on multiple-choice questions instead of simple progress question (ablation)MemoryExplorer · LMEE-Bench (58-task subset)QA Score: 41.33 -> 43.62Improved
train on all question types versus multiple-choice only (ablation)MemoryExplorer · GOAT-Bench (Val Unseen subset)Success rate: 46.40 -> 48.20Improved
train on all question types versus multiple-choice only (ablation)MemoryExplorer · LMEE-Bench (58-task subset)Nav SR: 23.53 -> 22.06Hurt
shift reward weights toward action and frontier (0.4,0.4,0.1,0.1) versus default (ablation)MemoryExplorer · LMEE-Bench (58-task subset)Nav SPL: 14.99 -> 12.43Hurt
use RL with active memory retrieval versus RA-Mem promptingMemoryExplorer · GOAT-Bench (Val Unseen subset)Success rate: 42.81 -> 46.40Improved
use RA-Mem query-based retrieval versus 3D-Mem memory pre-filteringRA-Mem · GOAT-Bench (Val Unseen subset)Success rate: 37.05 -> 42.81Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy