AI Paper Atlas

Research map / Reinforcement learning / Policy gradient and actor-critic

Decoupled Q-Chunking

Qiyang Li, Seohong Park, Sergey Levine

ICLR 2026 · Reinforcement learning › Policy gradient and actor-critic · approach: Stabilizing deep actor-critic · 15 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
decouple critic chunk size from policy chunk size (DQC) instead of coupled QCQ-chunking · cube-quadruple-100Msuccess rate (%): 35 -> 92Improved
use DQC instead of n-step return backupNS · cube-quadruple-100Msuccess rate (%): 27 -> 92Improved
use DQC instead of n-step return backupNS · humanoidmaze-giantsuccess rate (%): 95 -> 92No clear effect
use DQC instead of SHARSASHARSA · puzzle-4x5success rate (%): 1 -> 96Improved
use DQC instead of SHARSASHARSA · puzzle-4x6-1Bsuccess rate (%): 64 -> 83Hurt
add distilled critic for partial chunks (DQC vs QC-NS, ha=5) (ablation)QC-NS · cube-triple-100Msuccess rate (%): 51 -> 98Improved
add distilled critic for partial chunks (DQC vs QC-NS, ha=5) (ablation)QC-NS · cube-quadruple-100Msuccess rate (%): 53 -> 92Improved
add distilled critic for partial chunks (DQC vs QC-NS, ha=5) (ablation)QC-NS · puzzle-4x6-1Bsuccess rate (%): 95 -> 68Hurt
add proper decoupling with distilled critic instead of naive partial execution (ablation)DQC-naive · cube-triple-100Msuccess rate (%): 27 -> 98Improved
policy chunk size ha=5 instead of ha=1 at h=25 (ablation)DQC · cube-quadruple-100Msuccess rate (%): 45 -> 92Improved
policy chunk size ha=5 instead of ha=1 at h=25 (ablation)DQC · humanoidmaze-giantsuccess rate (%): 92 -> 51Hurt
add optimism in backup or distillation (kappa not 0.5) (ablation)DQC · OGBench goal-conditioned taskssuccess rate (%)Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy