atlas

Research map / Image generation / Image restoration

DRACO: A Denoising-Reconstruction Autoencoder for Cryo-EM

NeurIPS 2024 · Image generation › Image restoration · approach: Raw and low-light noise modeling · 3 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes DRACO, a denoising-reconstruction masked autoencoder pre-trained on odd/even cryo-EM micrographs (Noise2Noise-style) from a curated 270k-micrograph EMPIAR dataset, serving as a denoiser and foundation model for cryo-EM downstream tasks.

Problem

Self-supervised vision foundation models such as MAE overlook the extreme noise in cryo-EM micrographs, and cryo-EM lacks large, well-curated pre-training data and clean references for denoising.

Approach

Split each movie into odd and even sub-movies treated as independent noisy observations for Noise2Noise-style denoising on visible patches, combined with MAE-style reconstruction of masked patches supervised by the full-sum micrograph, in a masked autoencoder framework.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use DRACO-L instead of ResNet18 trained from scratchMicrograph curation · Micrograph curation testaccuracy: 0.938 -> 0.983Helped
Use DRACO-L instead of the strongest listed baselineParticle picking · Human HCN1F1 score: 0.782 -> 0.816Helped
Use DRACO-L instead of the strongest listed baselineParticle picking · 70S ribosomeF1 score: 0.786 -> 0.824Helped
Use DRACO-L instead of the strongest listed baselineParticle picking · LetBF1 score: 0.682 -> 0.725Helped
Use DRACO denoising instead of the strongest listed baselineMicrograph denoising · Human ApoferritinSNR: -0.31 -> 2.01Helped
Use DRACO denoising instead of the strongest listed baselineMicrograph denoising · HA TrimerSNR: -0.83 -> 3.69Helped
Use DRACO denoising instead of the strongest listed baselineMicrograph denoising · Phage MS2SNR: -6.71 -> 0.23Helped
Use DRACO denoising instead of the strongest listed baselineMicrograph denoising · RNA polymeraseSNR: 8.66 -> 12.21Helped
Add the N2N loss (ablation)DRACO-B · 70S ribosomeF1 score: 0.786 -> 0.810Helped
Add the N2N loss (ablation)DRACO-B · 70S ribosomeSNR: -4.94 -> -2.86Helped
Add the reconstruction loss (ablation)DRACO-B · 70S ribosomeF1 score: 0.761 -> 0.810Helped
Add the reconstruction loss (ablation)DRACO-B · 70S ribosomeSNR: -4.22 -> -2.86Helped

Surprising findings

Limitations

Experimental setup

Datasets: EMPIAR curated pre-training set (529 datasets) particle picking annotated set (80k micrographs) Human Apoferritin (EMPIAR-10421) HA Trimer (EMPIAR-10096) Phage MS2 (EMPIAR-10075) RNA polymerase (EMPIAR-11521) HCN1 (EMPIAR-10081) LetB (EMPIAR-10350) 70S ribosome (EMPIAR-10407) HIV tilt series

Benchmarks: HCN1 particle picking 70S ribosome particle picking LetB particle picking denoising SNR on four EMPIAR datasets micrograph curation on in-house 1,194-micrograph set

Metrics: precision recall F1 score resolution (A) SNR (dB) accuracy

Baselines: Topaz crYOLO CryoTransformer Detectron2 MAE Topaz-Denoise Low-pass filtering Miffi ResNet18

Builds on: masked autoencoder Noise2Noise Topaz-Denoise Detectron2

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy