AI Paper Atlas

Research map / Label-efficient and robust learning / Self-supervised and contrastive

Animal behavioral analysis and neural encoding with transformer-based self-supervised pretraining

Yanchen Wang, Han Yu, Ari Blau, Yizi Zhang, International Brain Laboratory, Liam Paninski, Cole Lincoln Hurwitz, Matthew R Whiteway

ICLR 2026 · Label-efficient and robust learning › Self-supervised and contrastive · approach: Invariance-based self-supervised learning · 0 citations (OpenAlex)

This paper tried a common change: Add a contrastive loss

add temporal contrastive loss to MAE pretraining (zero-shot) · IBL neural encoding (TCN) · BPS: 0.331 -> 0.292 (IBL); 0.311 -> 0.309 (IBL-whisker) Mixed

What 1,317 accepted papers report for this change

See this change in detailMatched by the wording of each paper's own result, read by AI from the full text. Papers report gains more often than failures, so this shows what gets published, not the chance a change works.

Read the paper

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add domain-specific MAE pretraining on IBL sessions to ImageNet MAE (ablation)ViT-M · IBL neural encoding (TCN)BPS: 0.321 -> 0.331Improved
add temporal contrastive loss to MAE pretraining (zero-shot) (ablation)BEAST (IN+PT) · IBL neural encoding (TCN)BPS: 0.331 -> 0.292 (IBL); 0.311 -> 0.309 (IBL-whisker)Mixed
add session-specific fine-tuning to BEAST (ablation)BEAST (IN+PT) · IBL neural encoding (TCN)BPS: 0.292 -> 0.347Improved
combine MAE with contrastive loss rather than contrastive only (ablation)BEAST · IBL-whisker neural encoding (TCN)BPS: 0.283 -> 0.309Improved
use BEAST temporal-window positive sampling instead of ViC-MAE sampling (ablation)BEAST pretraining · IBL-whisker neural encoding (TCN)BPS: 0.289 -> 0.317Improved
use motion-filtered k-means frame selection instead of random (ablation)BEAST pretraining · IBL neural encoding (TCN)BPS: 0.319 -> 0.337 (IBL); 0.319 -> 0.317 (IBL-whisker)Mixed
use extended augmentation (rotation, color jitter) instead of default (ablation)BEAST pretraining · IBL neural encoding (TCN)BPS: 0.337 -> 0.328No clear effect
use CLS token pooling instead of mean or attention pooling for contrastive loss (ablation)BEAST pretraining · IBL neural encoding (TCN)BPS: 0.321 -> 0.337 (mean); 0.323 -> 0.337 (attention)Improved
use patch embeddings with attention pooling instead of CLS token (ablation)BEAST (IN+PT) · CalMS21 action segmentationF1: 0.63 -> 0.81Improved
add domain-specific pretraining with contrastive loss to ImageNet MAE backbone (ablation)ViT-M patch · CalMS21 action segmentationF1: 0.74 -> 0.81Improved
add domain-specific pretraining with contrastive loss to ImageNet MAE backbone (ablation)ViT-M patch · IBL action segmentationF1: 0.84 -> 0.87Improved
pretrain with contrastive loss only for pose estimation (ablation)ViT-C · pose estimation (100 labels)pixel errorHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy