AI Paper Atlas

Research map / Reinforcement learning / Visual and representation RL

DF-ExpEnse: Diffusion Filtered Exploration for Sample Efficient Finetuning

Calvin Luo, Chen Sun, Shuran Song

ICML 2026 · Reinforcement learning › Visual and representation RL · approach: Skill learning and diffusion policies · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add DF-ExpEnse exploration (candidate set plus critic-ensemble UCB selection) to vanilla DSRLDSRL · RoboMimic (Can, Square, Tool Hang) and OpenAI Gymsuccess rate / reward vs timestepsImproved
add DF-ExpEnse to DSRL on RoboMimic LiftDSRL · RoboMimic Liftsuccess rateNo clear effect
add DF-ExpEnse to ResFiTResFiT · DexMimicGen (Can Sort, Box Cleanup, Coffee)success rate vs timestepsImproved
select the action with max Q (Max-Q, alpha=0) from sampled candidates instead of vanilla samplingDSRL · RoboMimic manipulation taskssuccess rateHurt
add critic disagreement term (alpha=0.5) to action selection instead of Max-Q (ablation)DF-ExpEnse · RoboMimic and Gym taskssample efficiencyImproved
add BC-SR (candidates from initial pretrained policy, p=1) (ablation)DF-ExpEnse · RoboMimic Can and Squaresample efficiencyImproved
add BC-SR to Max-Q (ablation)Max-Q · RoboMimic Can and Squaresample efficiencyImproved
add fleet normalization versus isolated agents in the same fleet (ablation)DF-ExpEnse · RoboMimic and OpenAI Gymsample efficiencyImproved
increase critic ensemble size from 2 to 10 (ablation)DF-ExpEnse · RoboMimic Cansample efficiencyImproved
increase critic ensemble size from 5 to 10 (ablation)DF-ExpEnse · RoboMimic Cansample efficiencyNo clear effect
increase action candidate sample size from 3 to 5 or 7 (ablation)DF-ExpEnse · RoboMimic Cansample efficiencyNo clear effect
increase fleet size toward 4 from smaller fleets (ablation)DF-ExpEnse · RoboMimic Cansample efficiencyImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy