AI Paper Atlas

Research map / Video / Video segmentation and tracking

Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement

Xin Liu, Josh Fromm, Shwetak Patel, Daniel McDuff

NeurIPS 2020 · Video › Video segmentation and tracking · approach: Sign language and physiological video analysis · 147 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add temporal modeling with temporal shift, hybrid 2D/3D, or 3D convolutions to 2D-CAN (ablation)CAN · AFRL (All Tasks)heart rate MAE: 2.32 -> 1.12Improved
Add temporal modeling with temporal shift, hybrid 2D/3D, or 3D convolutions to 2D-CAN (ablation)CAN · AFRL (All Tasks)respiration rate MAE: 2.86 -> 2.06Improved
Replace hybrid 2D/3D convolutions with temporal shift (ablation)Hybrid-CAN · AFRL (All Tasks)inference time (ms): 26 -> 12Improved
Replace hybrid 2D/3D convolutions with temporal shift (ablation)Hybrid-CAN · AFRL (All Tasks)heart rate MAE: 1.12 -> 1.32Hurt
Share the temporal-shift network between pulse and respiration tasks (ablation)TS-CAN · AFRL (All Tasks)heart rate MAE: 1.32 -> 1.45No clear effect
Share the temporal-shift network between pulse and respiration tasks (ablation)TS-CAN · AFRL (All Tasks)inference time (ms): 12 -> 6Improved
Use temporal shift instead of 2D-CAN temporal modeling (ablation)2D-CAN · AFRL (All Tasks)heart rate MAE: 2.32 -> 1.32Improved
Use temporal shift instead of 2D-CAN temporal modeling (ablation)2D-CAN · AFRL (All Tasks)inference time (ms): 20 -> 12Improved
Use the multi-task temporal-shift model rather than separate task models (ablation)TS-CAN · AFRL (All Tasks)heart rate MAE: 1.32 -> 1.45Hurt
Use 3D convolutions rather than temporal shift (ablation)TS-CAN · AFRL (All Tasks)inference time (ms): 12 -> 48Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy