Research map / Reinforcement learning / Visual and representation RL
Meta-Q-Learning
Read the paperCheck your idea against 108,967 papers
AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Add a GRU-based trajectory context to TD3 | TD3 · MuJoCo continuous-control meta-RL validation tasks | average undiscounted return | Helped |
| Adapt the meta-trained policy using new-task data (ablation) | MQL · Half-Cheetah-Fwd-Back and Ant-Fwd-Back | return | Helped |
| Use propensity-weighted updates from the meta-training replay buffer (ablation) | MQL · Half-Cheetah-Fwd-Back and Ant-Fwd-Back | return | Helped |
| Set the proximal penalty coefficient to 1 - ESS instead of fixed lambda = 0.5 (ablation) | MQL adaptation · MQL ablation environments | return | Helped |
| Adapt the policy using propensity-weighted replay data and new-task data | MQL · Half-Cheetah-Vel-OOD-Medium and Half-Cheetah-Vel-OOD-Hard | average return | Helped |
| Explicitly update the policy on new-task data | MQL · Half-Cheetah-Vel-OOD-Hard | average return | Helped |
| Use adaptation on top of TD3 with context (ablation) | MQL · Walker-2D-Params | return | No clear effect |
Closest papers by meaning
- Meta-Reinforcement Learning with Universal Policy Adaptation: Provable Near-Optimality under All-task Optimum Comparator (NeurIPS 2024 · similarity 0.92)
- Offline Meta-Reinforcement Learning with Online Self-Supervision (ICML 2022 · similarity 0.92)
- Guided Meta-Policy Search (NeurIPS 2019 · similarity 0.92)
- Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variables (ICML 2019 · similarity 0.91)
- MAMBA: an Effective World Model Approach for Meta-Reinforcement Learning (ICLR 2024 · similarity 0.90)
- MetaCARD: Meta-Reinforcement Learning with Task Uncertainty Feedback via Decoupled Context-Aware Reward and Dynamics Components (AAAI 2024 · similarity 0.90)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
