AI Paper Atlas

Research map / Vision-language and multimodal / Cross-modal learning

ProM3E: Probabilistic Masked MultiModal Embedding Model for Ecology

Srikumar Sastry, Subash Khanal, Aayush Dhakal, Jiayu Lin, Dan Cher, Phoenix Jarosz, Nathan Jacobs

CVPR 2026 · Vision-language and multimodal › Cross-modal learning · approach: Unimodal-to-multimodal representation transfer · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
train probabilistic masked embedding model on top of TaxaBind encodersTaxaBind · TaxaBench-8k zero-shot classificationaccuracy: 34.45 -> 39.45Improved
sameTaxaBind · iNat-2021 zero-shot classificationaccuracy: 70.09 -> 75.83Improved
sameBioTroveCLIP · CUB-200-2011accuracy: 82.41 -> 82.85Improved
sameTaxaBind · BirdCLEF'23 audio linear probetop-1 accuracy: 42.19 -> 52.30Improved
same with multimodal inputTaxaBind · BirdCLEF'23 audio linear probe (multimodal)top-1 accuracy: 46.97 -> 59.06Improved
replace contrastive reconstruction loss with MSE (ablation)ProM3E · TaxaBench-8k classificationaccuracy: 39.45 -> 33.92Hurt
use contrastive instead of MSE loss (ablation)ProM3E · EcoRegions linear probingaccuracy: 80.27 -> 81.35Improved
use 1 encoder layer instead of 4 (ablation)ProM3E · TaxaBench-8k classificationaccuracy: 38.36 -> 39.45Improved
raise encoder dim from 256 to 1024 (ablation)ProM3E · EcoRegions linear probingaccuracy: 74.24 -> 81.35Improved
raise encoder dim from 1024 to 2048 (ablation)ProM3E · TaxaBench-8k classificationaccuracy: 39.45 -> 39.23 cls; 81.35 -> 82.52 linMixed
use 4 register tokens instead of 0 (ablation)ProM3E · EcoRegions linear probingaccuracy: 78.51 -> 81.35Improved
use 4 register tokens instead of 0 (ablation)ProM3E · TaxaBench-8k classificationaccuracy: 39.21 -> 39.45No clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy