atlas

Research map / Reinforcement learning / Policy gradient and actor-critic

Optimal Off-Policy Evaluation from Multiple Logging Policies

ICML 2021 · Reinforcement learning › Policy gradient and actor-critic · approach: Confidence intervals and OPE benchmarks · 2 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use SMRDR, choosing the control variate to minimize variance under stratified sampling instead of using MRDR's iid-sampling objectiveOPE with multiple logging policies · optdigits and pendigitsRelative-RMSE: up to 45% reduction in errorHelped
Use SMRDR instead of DROPE with multiple logging policies · optdigits and pendigits, especially when n1/n2 is smallRelative-RMSEHelped
Use DR instead of SMRDROPE with multiple logging policies · optdigits when n1/n2 is largeRelative-RMSEHelped
Choose between IS, IS-Avg, IS-PW, DR-Avg, and DR-PW based on the data instance rather than using a fixed orderingOPE with multiple logging policies · optdigitsRelative-RMSEMixed

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy