AI Paper Atlas

Research map / Probabilistic and scientific modeling / Variational and generative sampling

Probabilistic Precision and Recall Towards Reliable Evaluation of Generative Models

Dogyun Park, Suhyun Kim

ICCV 2023 · Probabilistic and scientific modeling › Variational and generative sampling · approach: Score-based generative modeling analysis · 10 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use probabilistic scoring rule (PSR) instead of binary scoring rule for precisionP-precision · Gaussian toy with outlierrobustness to outliers: I-precision +0.2 vs P-precision +0.05 under 5% outliers (ADM, ImageNet 128)Improved
remove probabilistic subsupport estimation (A) from PSR (ablation)P-precision · Gaussian toy with outlier, u in [-3,-1]outlier robustnessImproved
use identical radius R for all samples instead of sample-specific kNN radius (B) (ablation)P-precision · Gaussian toy with outlieroutlier robustness and consistency over kImproved
use symmetric scoring for diversity (P-recall) instead of Coveragediversity metric · N(0,I) vs N(0,vI), v in [0.2,1.5]sensitivity to diversity change: Coverage stays at 1 for v 0.2 to 1Improved
use PP&PR instead of IP&IR for small sample sizeprecision/recall metrics · identical Gaussians, varying Nbias and standard deviationImproved
Density metric with small NDensity · identical Gaussians, N <= 10000bias and standard deviationHurt
increase classifier guidance scale from 0.5 to 10.0 in ADMADM · ImageNet 128fidelity-diversity trade-off captured by metricsMixed
F1 of PP&PR compared with FID rankingPP&PR · ImageNet, AFHQv2, LSUN Bedroomconsistency with FIDImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy