Research map / Reinforcement learning / Policy gradient and actor-critic
Eventual Discounting Temporal Logic Counterfactual Experience Replay
Cameron Voloshin, Abhinav Verma, Yisong Yue
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Add LTL counterfactual experience replay (LCER) (ablation) | Q-learning · Minecraft, Pacman, Flatworld 1-2 | learning speed | Improved |
| Add LCER to PPO (ablation) | PPO · Flatworld 3-4 | learning speed | Improved |
| Add LCER to PPO (ablation) | PPO · Carlo | learning speed | No clear effect |
| Train with LCER, check final policy behavior | Q-learning and PPO · all environments | LTL task satisfaction | Improved |
Closest papers by meaning
- Do It for HER: First-Order Temporal Logic Reward Specification in Reinforcement Learning (AAAI 2026 · similarity 0.88)
- Reinforcement Learning with LTL and $\omega$-Regular Objectives via Optimality-Preserving Translation to Average Rewards (NeurIPS 2024 · similarity 0.88)
- DeepLTL: Learning to Efficiently Satisfy Complex LTL Specifications for Multi-Task RL (ICLR 2025 · similarity 0.86)
- One Subgoal at a Time: Zero-Shot Generalization to Arbitrary Linear Temporal Logic Requirements in Multi-Task Reinforcement Learning (NeurIPS 2025 · similarity 0.85)
- Regret-Free Reinforcement Learning for Temporal Logic Specifications (ICML 2025 · similarity 0.85)
- Partial Identifiability in Inverse Reinforcement Learning for Agents with Non-Exponential Discounting (AAAI 2025 · similarity 0.85)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
