AI Paper Atlas

Research map / Vision-language and multimodal / Cross-modal learning

Multi-modal RGB–Depth–Thermal Human Body Segmentation

Cristina Palmero, Albert Clapés, Chris Bahnsen, Andreas Møgelmose, Thomas Baltzer Moeslund, Sérgio Escalera

IJCV 2016 · Vision-language and multimodal › Cross-modal learning · approach: Multi-modality image fusion · 86 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
fuse color, depth, thermal and motion descriptions with a Random Forest (ablation)best single description (HON) · RGB-D-T human body segmentation (leave-one-sequence-out)overlap: 67.5 -> 78.6Improved
use learned (stacked) fusion instead of naive confidence averaging (ablation)fusion of descriptions · RGB-D-T human body segmentation (leave-one-sequence-out)overlap: 63.9 -> 78.6Improved
use Random Forest instead of MLP with gaussian activation for fusion (ablation)learning-based fusion · RGB-D-T human body segmentation (leave-one-sequence-out)overlap improvement over HON: 5% -> 10%Improved
use Random Forest instead of linear SVM for fusion (ablation)learning-based fusion · RGB-D-T human body segmentation (leave-one-sequence-out)overlap: +2.5% on averageImproved
use depth HON descriptor instead of motion HOF descriptor (ablation)single-modality description · RGB-D-T human body segmentation (leave-one-sequence-out)overlap: 14% better on averageImproved
use depth HON descriptor instead of color HOG (ablation)single-modality description · RGB-D-T human body segmentation (leave-one-sequence-out)overlap: 65 -> 67.5Improved
add all four modalities via RF fusion versus worst description (HOF) (ablation)single descriptions · RGB-D-T human body segmentation (leave-one-sequence-out)overlap: +25% on averageImproved
evaluate on thermal ground-truth masks instead of color/depth masksRF fusion · RGB-D-T human body segmentation (leave-one-sequence-out)overlap: relatively small decreaseHurt
use RF fusion instead of Buys et al 2014 depth body-part methodsegmentation method · RGB-D-T human body segmentation (leave-one-sequence-out)overlap: 67.1 -> 78.6Improved
exclude sequence 10 from mean (poor-performing sequence)RF fusion · RGB-D-T human body segmentation (leave-one-sequence-out)mean overlap across sequences: almost 5% reduction due to Seq. 10Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy