AI Paper Atlas

Research map / Detection and segmentation / CNN features

Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction Without Convolutions

Wenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan, Kaitao Song, Ding Liang, Tong Lu, Ping Luo, Ling Shao

ICCV 2021 · Detection and segmentation › CNN features · approach: Plain and high-resolution ViTs · 5,494 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add progressive shrinking pyramid structure instead of columnar ViT-Small/32 (ablation)RetinaNet · COCO val2017AP: 31.7 -> 40.4Improved
use fine-grained 4x4 patches in a columnar ViT (ablation)ViT-Small/4 RetinaNet · COCO val2017APHurt
go deeper (PVT-Medium) instead of wider (x1.4 hidden dims) (ablation)PVT-Small · COCO val2017 RetinaNet 1xAP: 40.8 -> 41.9Improved
go deeper instead of wider (ablation)PVT-Small · ImageNet-1k valtop-1 error (%): 19.3 -> 18.8Improved
add ImageNet pre-trained weights (ablation)RetinaNet-PVT-Small · COCO val2017AP: gap of 13.8 (1x) and 8.4 (3x + MS)Improved
replace CNN with non-local (ResNet50+GC r4) by PVT-Small (ablation)Mask R-CNN 1x · COCO val2017mask AP: 36.2 -> 37.8Improved
reduce input shorter side from 800 to 640RetinaNet PVT-Small · COCO val2017AP: 40.4 -> 38.7; 76.9ms -> 51.7msMixed
replace ResNet50 with PVT-Small backboneRetinaNet 1x · COCO val2017AP: 36.3 -> 40.4Improved
replace ResNet50 with PVT-Small backboneDETR 50 epochs · COCO val2017AP: 32.3 -> 34.7Improved
replace ResNet50-d16 with PVT-Small in Trans2SegTrans2Seg · ADE20K valmIoU (%): 39.7 -> 42.6Improved
replace ResNet18/50/101 with PVT-Tiny/Small/MediumSemantic FPN · ADE20K valmIoU (%): 32.9 -> 35.7; 36.7 -> 39.8Improved
replace ResNet50 with PVT-Smallclassification · ImageNet-1k valtop-1 error (%): 21.5 -> 20.2Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy