Research map / Probabilistic and scientific modeling / Treatment effects
Falsification before Extrapolation in Causal Effect Estimation
Zeshan Hussain, Michael Oberst, Ming-Chieh Shih, David Sontag
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| Falsify studies against RCT validation effects, then conservatively take the union of accepted-study confidence intervals | Observational effect estimation on WHI held-out subgroups · WHI held-out subgroups | Coverage: 0.39 -> 0.45 | Improved |
| Falsify studies against RCT validation effects, then conservatively take the union of accepted-study confidence intervals | Observational effect estimation on WHI held-out subgroups · WHI held-out subgroups | Length: 0.416 -> 0.081 | Improved |
| Exclude falsification and meta-analyze all observational studies | Observational effect estimation on WHI held-out subgroups · WHI held-out subgroups | Coverage: 0.45 vs. 0.03 | Hurt |
| After falsification, meta-analyze the remaining studies instead of conservatively taking their interval union | ExPCS · WHI held-out subgroups | Coverage: 0.45 vs. 0.28 | Hurt |
| Select only the original unbiased observational study | ExPCS · WHI held-out subgroups | Coverage: 0.45 vs. 0.44 | No clear effect |
| Select only the original unbiased observational study | ExPCS · WHI held-out subgroups | Length: 0.081 vs. 0.068 | Hurt |
| Use falsification followed by conservative interval combination rather than random-effects meta-analysis | Observational effect estimation on semi-synthetic IHDP data · IHDP extrapolated subgroups | Coverage | Improved |
| Use ExPCS rather than ExOCS when observational sample sizes are small | Observational effect estimation on semi-synthetic IHDP data · IHDP extrapolated subgroups | Coverage | Improved |
| Use ExPCS rather than Simple Union when falsification has adequate power | Observational effect estimation on semi-synthetic IHDP data · IHDP extrapolated subgroups | Length | Improved |
Closest papers by meaning
- A Unified Framework for the Transportability of Population-Level Causal Measures (NeurIPS 2025 · similarity 0.89)
- Data Fusion for Partial Identification of Causal Effects (NeurIPS 2025 · similarity 0.89)
- Generalizing Causal Effects from Randomized Controlled Trials to Target Populations across Diverse Environments (ICML 2025 · similarity 0.88)
- Do Contemporary Causal Inference Models Capture Real-World Heterogeneity? Findings from a Large-Scale Benchmark (ICLR 2025 · similarity 0.88)
- Automating the Selection of Proxy Variables of Unmeasured Confounders (ICML 2024 · similarity 0.87)
- End-To-End Causal Effect Estimation from Unstructured Natural Language Data (NeurIPS 2024 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
