AI Paper Atlas

Research map / Detection and segmentation / CNN features

You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detection

NeurIPS 2021 · Detection and segmentation › CNN features · approach: Plain and high-resolution ViTs · 192 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Pre-train on ImageNet-1k instead of training from random initializationYOLOS-Ti on COCO · COCO valAP: 19.7 -> 28.7Helped
Increase supervised pre-training from 200 to 300 epochs (ablation)YOLOS-Ti · COCO valAP: 26.9 -> 28.7Helped
Increase supervised pre-training from 200 to 300 epochs (ablation)YOLOS-S · COCO valAP: 36.1 -> 36.1No clear effect
Add transformer-specific distillation during ImageNet pre-training (ablation)YOLOS-Ti and YOLOS-S · COCO valAP: 28.7 -> 29.7; 36.1 -> 37.2Helped
Use DINO rather than MoCo-v3 self-supervised pre-training (ablation)YOLOS-S · COCO valAP: 33.6 -> 36.2Helped
Apply uniform compound scaling rather than width scaling (ablation)YOLOS-Ti scaled to about 4.5 GFLOPs · COCO valAP: 36.1 -> 36.2No clear effect
Apply fast scaling rather than width scaling (ablation)YOLOS-Ti scaled to about 4.5 GFLOPs · COCO valAP: 36.1 -> 37.6Helped
Freeze the detection tokens instead of learning them (ablation)YOLOS-Ti · COCO valAP: 28.7 -> 28.3Hurt
Freeze the detection tokens instead of learning them (ablation)YOLOS-S · COCO valAP: 36.1 -> 36.4Helped
Use one large first-layer positional embedding and omit intermediate positional embeddings (ablation)YOLOS-Ti · COCO valAP: 28.3 -> 28.7Helped
Use one large first-layer positional embedding and omit intermediate positional embeddings (ablation)YOLOS-S · COCO valAP: 36.1 -> 36.6Helped
Apply dropout or stochastic depth during COCO fine-tuning (ablation)YOLOS · COCO object detectionAPHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy