AI Paper Atlas

Research map / Vision-language and multimodal / Human and embodied modeling

One-Shot Recognition of Any Material Anywhere Using Contrastive Learning with Physics-Based Rendering

Manuel S. Drehwald, Sagi Eppel, Jolina Li, Han Hao, Alan Aspuru-Guzik

ICCV 2023 · Vision-language and multimodal › Human and embodied modeling · approach: Scientific domain vision datasets · 11 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add data augmentation during MatSim training (ablation)MatSim+M · MatSim Set2top-1 accuracy: 0.61 -> 0.91Improved
add transparent-vessel scenes to training data (ablation)MatSim+M · MatSim Set1 Subclasstop-1 accuracy: 0.72 -> 0.78Improved
add gradual material mixtures to training data (ablation)MatSim+M · MatSim Set2top-1 accuracy: 0.72 -> 0.91Improved
use semi-hard loss instead of hard loss (ablation)MatSim training · MatSim benchmarktop-1 accuracyImproved
crop material region as input to CLIP (ablation)Open CLIP H14 · MatSim Set2top-1 accuracy: 0.47 -> 0.77Improved
mask background to black for CLIP (ablation)Open CLIP H14 · MatSim Set1 Alltop-1 accuracy: 0.44 -> 0.40Hurt
add cropping and masking to MatSim net (ablation)MatSim · MatSim Set2top-1 accuracy: 0.73 -> 0.91Improved
train on MatSim instead of using CLIP on semantic matchingMatSim+M vs Open CLIP H14+C · FMDmatching accuracy: 0.82 -> 0.66Hurt
train on MatSim instead of human-similarity netHuman Similarity+C · MatSim Set1 Subclasstop-1 accuracy: 0.60 -> 0.78Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy