AI Paper Atlas

Research map / Architectures and efficiency / Attention and transformers

DeMT: Deformable Mixer Transformer for Multi-Task Learning of Dense Prediction

Yangyang Xu, Yibo Yang, Lefei Zhang

AAAI 2023 · Architectures and efficiency › Attention and transformers · approach: Attention head and block redesign · 69 citations (OpenAlex)

Read the paper

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use DeMT instead of MQTransformerSwin-T multi-task model · NYUD-v2SemSeg IoU: 43.61 -> 46.36Improved
Use DeMT instead of MQTransformerSwin-T multi-task model · PASCAL-ContextSemSeg IoU: 68.24 -> 69.71Improved
Add the deformable mixer (ablation)DeMT baseline · NYUD-v2SemSeg IoU: 38.78 -> 42.40Improved
Add the task interaction block (ablation)DeMT with deformable mixer · NYUD-v2SemSeg IoU: 42.40 -> 44.44Improved
Add the task query block (ablation)DeMT with deformable mixer and task interaction · NYUD-v2SemSeg IoU: 44.44 -> 46.36Improved
Increase deformable mixer depth from 1 to 2 (ablation)DeMT · NYUD-v2SemSeg IoU: 46.36 -> 46.90Improved
Increase deformable mixer depth from 2 to 4 (ablation)DeMT · NYUD-v2SemSeg IoU: 46.90 -> 47.71Improved
Increase deformable mixer depth from 4 to 8 (ablation)DeMT · NYUD-v2SemSeg IoU: 47.71 -> 47.16Hurt
Add 1/8-scale features to the 1/4-scale input (ablation)DeMT · NYUD-v2SemSeg IoU: 7.51 -> 12.85Improved
Add 1/16-scale features (ablation)DeMT using 1/4- and 1/8-scale features · NYUD-v2SemSeg IoU: 12.85 -> 40.32Improved
Add 1/32-scale features (ablation)DeMT using three feature scales · NYUD-v2SemSeg IoU: 40.32 -> 46.36Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy