atlas

Research map / Vision-language and multimodal / Human and embodied modeling

Unveiling the Potential of AI for Nanomaterial Morphology Prediction

ICML 2024 · Vision-language and multimodal › Human and embodied modeling · approach: Scientific domain vision datasets · 3 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Builds a 215-synthesis calcium carbonate nanoparticle SEM dataset and benchmarks random forest/XGBoost, few-shot LLMs (GPT-4, GPT-3.5, Mistral), and a VAE+BERT text-to-image prototype for morphology prediction.

Problem

Predicting nanomaterial morphology (shape and size) from synthesis parameters is hard because experimental data is scarce and SEM characterization is costly; existing prediction work is mostly limited to single shapes and about 100 syntheses.

Approach

Creates a multi-shape, multimodal dataset of 215 CaCO3 syntheses with SEM images and expert labels, then systematically compares classical tree ensembles, few-shot LLM classification, and a prototype text-to-image generator that maps synthesis text to nanoparticle images.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use GPT-4 few-shot classification rather than the Random Forest shape classifierNanoparticle shape prediction · Nanoparticle shapes (test set)average accuracy: 0.80 -> 0.81Helped
Use GPT-4 few-shot classification rather than the XGB shape-and-size classifierNanoparticle morphology prediction · Shapes and sizes versus shapes (test set)accuracy: 0.77 -> 0.81Mixed
Include more examples from the same target class in the prompt (target-class-only rather than at-least-one-target sampling) (ablation)GPT-4 few-shot classification · Nanoparticle shapes (test set; N=4)average accuracy: 0.59±0.12 -> 0.66±0.09 (textual); 0.55±0.11 -> 0.62±0.09 (tabular)Helped
Present synthesis features textually rather than in tabular format (ablation)GPT-4 few-shot classification · Nanoparticle shapes (test set; N=4; target-class-only sampling)average accuracy: +4%Helped
Increase prompt examples from N=2 to N=8 (ablation)GPT-4 few-shot classification · Nanoparticle shapes (test set; 33% test split)average accuracy: 0.48±0.07 -> 0.78±0.10Helped
Increase prompt examples from N=8 to N=10 (ablation)GPT-4 few-shot classification · Nanoparticle shapes (test set; 33% test split)average accuracy: 0.78±0.10 -> 0.78±0.09No clear effect
Use larger prompt-example counts rather than fewer examples (ablation)GPT-4 few-shot classification · Cube shape (test set)accuracyMixed
Use a 33% rather than 15% test split (ablation)Tree-based ensemble models · Nanoparticle shapes and sizesaverage accuracy: 0.65 -> 0.74Helped
Replace the custom VAE architecture with ResNet backbones (ablation)Text-to-image model · Nanoparticle image reconstructionperformanceHurt
Generate images from synthesis descriptions with the text-to-image prototypeText-to-image system · Nanoparticle morphology generationimage qualityHurt

Surprising findings

Limitations

Experimental setup

Datasets: CaCO3 SEM image dataset (215 syntheses) 46,800 augmented single-particle images

Benchmarks: CaCO3 nanomaterial morphology dataset (held-out test split)

Metrics: accuracy F1 score SSIM PSNR MSE

Baselines: Random Forest XGBoost GPT-3.5-turbo GPT-4-turbo Mistral-medium Mistral-small Mistral-tiny

Builds on: variational autoencoder BERT scikit-learn

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy