Research map / Probabilistic and scientific modeling / Dynamical systems
Can Temporal-Difference and Q-Learning Learn Representation? A Mean-Field Theory
Yufeng Zhang, Qi Cai, Zhuoran Yang, Yongxin Chen, Zhaoran Wang
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Use a smaller scaling parameter alpha in the two-layer network | Mean-field TD with overparameterized two-layer network · Theory: Theorem 4.3 | deviation of rho_t from rho_0 vs optimality-gap error | Mixed |
| Go beyond the NTK regime (alpha smaller than sqrt(m)) instead of alpha = sqrt(m) | TD learning with two-layer neural network · Theory: feature representation evolution | deviation of feature representation from initialization | Improved |
| Set stepsize scaling eta = alpha^-2 in the mean-field PDE | Mean-field TD dynamics · Theory: Theorem 4.3 | MSPBE optimality gap | Improved |
Closest papers by meaning
- Towards Principled Representation Learning from Videos for Reinforcement Learning (ICLR 2024 · similarity 0.84)
- Improving Unsupervised Hierarchical Representation with Reinforcement Learning (CVPR 2024 · similarity 0.82)
- Inference via Interpolation: Contrastive Representations Provably Enable Planning and Inference (NeurIPS 2024 · similarity 0.81)
- Deep Reinforcement Learning with Time-Scale Invariant Memory (AAAI 2025 · similarity 0.81)
- Contrastive Representations for Temporal Reasoning (NeurIPS 2025 · similarity 0.81)
- Bridging State and History Representations: Understanding Self-Predictive RL (ICLR 2024 · similarity 0.81)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
