atlas

Research map / Architectures and efficiency / Attention and transformers

$\textit{NeuroPath}$: A Neural Pathway Transformer for Joining the Dots of Human Connectomes

NeurIPS 2024 · Architectures and efficiency › Attention and transformers · approach: Transformer neural operators for PDEs · 1 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes NeuroPath, a graph Transformer whose multi-head self-attention is masked by structural-connectivity multi-hop detour adjacency (plus FC masks) to model how SC pathways support FC links, evaluated on HCPA, UKB, ADNI, and OASIS.

Problem

Predicting cognitive tasks and disease status from paired structural and functional brain connectivity while capturing how SC pathways physically support FC links, which existing deep models do not model well.

Approach

Introduces the 'topological detour' concept: multi-hop SC paths that support a direct FC link, implemented as a twin-branch multi-head self-attention where one branch is masked by h-hop detour adjacency and the other by FC adjacency, with a consistency loss aligning the two branches.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add both TD-MHSA and FC-MHSA branches (twin branch) instead of no branch (ablation)NeuroPath · ADNI static BOLDaccuracy: 82.42 -> 85.56Helped
Add both TD-MHSA and FC-MHSA branches instead of using TD-MHSA only (ablation)NeuroPath · HCPA static BOLDaccuracy: 97.33 -> 98.23Helped
Add both TD-MHSA and FC-MHSA branches instead of using FC-MHSA only (ablation)NeuroPath · UKB static BOLDaccuracy: 99.25 -> 99.59Helped
Add both branches instead of FC-MHSA only (ablation)NeuroPath · OASIS static BOLDF1 score: 86.58 -> 86.37Hurt
Increase pathway head number to H=7 (ablation)NeuroPath · HCPA and UKBF1 scoreHelped
Increase pathway head number from 1 to 8 (ablation)NeuroPath · ADNI and OASISF1 scoreNo clear effect
Use deeper model (16 layers rather than 4 or 8) (ablation)NeuroPath · HCPA, UKB, ADNI, and OASISF1 score: HCPA: 97.76, 97.72, 96.60; UKB: 99.59, 99.61, 99.44; ADNI: 78.93, 78.42, 78.32; OASIS: 86.16, 86.77, 85.78Mixed
Change FC threshold among 0.3, 0.5, and 0.7 (ablation)NeuroPath · HCPA, UKB, ADNI, and OASISF1 score: HCPA: 97.57, 95.09, 97.32; UKB: 99.27, 99.59, 99.15; ADNI: 78.36, 77.35, 79.49; OASIS: 86.59, 87.02, 86.13Mixed
Train on HCPA and test on UKB rather than using a same-dataset settingNeuroPath · HCPA→UKB static BOLD zero-shotF1 score: 91.29 vs 74.49Helped
Use NeuroPath instead of the strongest baseline for ADNI→OASIS dynamic zero-shotNeuroPath · ADNI→OASIS dynamic BOLD zero-shotF1 score: 79.65 vs 83.55Hurt

Surprising findings

Limitations

Experimental setup

Datasets: HCPA UK Biobank ADNI OASIS

Benchmarks: HCPA UK Biobank ADNI OASIS

Metrics: accuracy F1 score

Baselines: MLP GCN BrainGNN BNT BolT Graphormer NAGphormer

Builds on: Graphormer Transformer NAGphormer

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy