AI Paper Atlas

Research map / Vision-language and multimodal / Human and embodied modeling

A Neurobiological Evaluation Metric for Neural Network Model Search

CVPR 2019 · Vision-language and multimodal › Human and embodied modeling · approach: fMRI visual decoding · 15 citations (OpenAlex)

Check your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use HMS to rank hyperparameterized PredNetsPredNet · KITTI next-frame prediction and Gazoobian object matchingPixel MSE and object matching accuracy: Pixel MSE: 0.092 (0.148) -> 0.009 (0.003); object matching accuracy: 0.367 (0.134) -> 0.459 (0.049)Helped
Increase HMS across sampled networksPredNet · 95 randomly hyperparameterized PredNetsPixel MSE: -0.646**Helped
Increase HMS across sampled networksPredNet · 95 randomly hyperparameterized PredNetsObject matching accuracy: 0.575**Helped
Select networks with the lowest HMSPredNet · Ten lowest-HMS modelsPixel MSE and object matching accuracy: Pixel MSE: 0.314 ($\mathrm{SD} = 0.138$); object matching accuracy: 0.13 ($0.15$)Hurt
Use HMS as an early-stopping signalPredNet training · 95 PredNets, post hoc analysisTraining time: 67%Helped
Use the HMS threshold of 0.161 to screen modelsPredNet · 95 randomly hyperparameterized PredNetsObject matching accuracy and pixel MSE: 0.161; 13 of the 95 models (13.7%)Mixed
Control for learning rate in the HMS-performance relationshipPredNet · 1811-model partial-correlation sampleCorrelation of HMS with computer vision performance: $p < 0.001$No clear effect
Evaluate HMS early during training rather than waiting for task metrics to stabilizePredNet training · 74 four-layer PredNetsEpochs until metric stabilizes: HMS: 33 epochs; accuracy: 66.5 epochs ($\mathrm{SD} = 36$)Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy