Research map / Large language models / Language, safety and interpretability
Incorporating Context into Language Encoding Models for fMRI
Shailee Jain, Alexander Huth
Read the paperCheck your idea against 137,217 papers
AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.
Measured effects reported in the paper
| What was changed | Where | Measured | Effect |
|---|---|---|---|
| use LSTM LM contextual representations instead of word embeddings | 985-d word embedding encoding model · Moth Radio Hour fMRI (6 subjects) | summed voxel r^2 (encoding performance) | Improved |
| increase context length (0 to 19 words) (ablation) | LSTM contextual encoding model · Moth Radio Hour fMRI (6 subjects) | summed voxel r^2 (encoding performance) | Improved |
| replace true context with random words (ablation) | LSTM contextual encoding model · Moth Radio Hour fMRI (6 subjects) | summed voxel r^2 (encoding performance) | Hurt |
| swap context with another occurrence of the same word (ablation) | LSTM contextual encoding model · Moth Radio Hour fMRI (6 subjects) | summed voxel r^2 (encoding performance) | Hurt |
| use LSTM layer 2 instead of layers 1 or 3 (ablation) | LSTM contextual encoding model · Moth Radio Hour fMRI (6 subjects) | summed voxel r^2 (encoding performance) | Improved |
| use layer 1 with zero context instead of input embedding (ablation) | embedding encoding model · Moth Radio Hour fMRI (6 subjects) | summed voxel r^2 (encoding performance) | Improved |
Closest papers by meaning
- Interpretable multi-timescale models for predicting fMRI responses to continuous natural speech (NeurIPS 2020 · similarity 0.90)
- fMRI-LM: Towards a Universal Foundation Model for Language-Aligned fMRI Understanding (CVPR 2026 · similarity 0.90)
- Far from the Shallow: Brain-Predictive Reasoning Embedding through Residual Disentanglement (NeurIPS 2025 · similarity 0.88)
- Crafting Interpretable Embeddings for Language Neuroscience by Asking LLMs Questions (NeurIPS 2024 · similarity 0.88)
- fMRI predictors based on language models of increasing complexity recover brain left lateralization (NeurIPS 2024 · similarity 0.88)
- Neuro-Vision to Language: Enhancing Brain Recording-based Visual Reconstruction and Language Interaction (NeurIPS 2024 · similarity 0.87)
Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.
