Research map / Vision-language and multimodal / Human and embodied modeling
Towards Interpretable Visual Decoding with Attention to Brain Representations
Pinyuan Feng, Hossein Adeli, Wenxuan Guo, Fan L. Cheng, Ethan Hwang, Nikolaus Kriegeskorte
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| add parcel-wise fMRI token dropout (ablation) | NeuroAdapter · NSD Subject 1 | CLIP/Incep/PixCorr: Incep 61.2% -> 92.15%; CLIP 64.8% -> 92.03%; PixCorr .038 -> .133 | Improved |
| add parcel-wise linear mapper (ablation) | NeuroAdapter · NSD Subject 1 | CLIP/Incep/PixCorr: CLIP 78.11% -> 92.03%; PixCorr .073 -> .133 | Improved |
| keep 200 highest-SNR parcels rather than 500 (ablation) | NeuroAdapter · NSD Subject 1 | CLIP: 88.66% -> 92.03% | Improved |
| keep 200 highest-SNR parcels rather than 1000 (ablation) | NeuroAdapter · NSD Subject 1 | CLIP: 84.89% -> 92.03% | Improved |
| use 200 parcels rather than 100 (ablation) | NeuroAdapter · NSD Subject 1 | CLIP: 90.41% -> 92.03% | Improved |
| rank 8 decoded candidates with brain encoder vs single prediction (ablation) | NeuroAdapter · NSD Subject 1 | CLIP: 90.8% -> 92.03% | Improved |
| pick highest-correlation candidate vs lowest (ablation) | NeuroAdapter · NSD Subject 1 | AlexNet(2) 2WC: 80.88% -> 88.02% | Improved |
| pick highest-correlation candidate vs random (ablation) | NeuroAdapter · NSD Subject 1 | Inception 2WC: 92.05% -> 91.91% | No clear effect |
| vary condition dimension 192 to 1024 (ablation) | NeuroAdapter · NSD Subject 1 | CLIP: 1024: 90.33%; 768: 92.03%; 192: 90.78% | Mixed |
| vary denoising steps 20-80 (ablation) | NeuroAdapter · NSD | metrics | No clear effect |
| remove VDVAE low-level pathway from Brain Diffuser (ablation) | Brain Diffuser · NSD Subject 1 | PixCorr: PixCorr .305 -> .143 | Hurt |
| NeuroAdapter without embedding alignment vs MindEye1 | NeuroAdapter · NSD | CLIP 2WC: 94.1% -> 90.97% | Hurt |
Closest papers by meaning
- Neuro-Vision to Language: Enhancing Brain Recording-based Visual Reconstruction and Language Interaction (NeurIPS 2024 · similarity 0.90)
- See Through Their Minds: Learning Transferable Brain Decoding Models from Cross-Subject fMRI (AAAI 2025 · similarity 0.90)
- MoRE-Brain: Routed Mixture of Experts for Interpretable and Generalizable Cross-Subject fMRI Visual Decoding (NeurIPS 2025 · similarity 0.89)
- Multigranular Evaluation for Brain Visual Decoding (AAAI 2026 · similarity 0.88)
- Toward Generalizing Visual Brain Decoding to Unseen Subjects (ICLR 2025 · similarity 0.88)
- Brain decoding: toward real-time reconstruction of visual perception (ICLR 2024 · similarity 0.88)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
