atlas

Research map / Label-efficient and robust learning / Recognition and long-tail

Fine-grained Control of Generative Data Augmentation in IoT Sensing

NeurIPS 2024 · Label-efficient and robust learning › Recognition and long-tail · approach: Data augmentation and generalization bias · 2 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes fine-grained controllable generative data augmentation for IoT sensing by conditioning diffusion and VAE generators on interpretable STFT spectrogram statistical metrics and augmenting within that metric space.

Problem

IoT sensing models overfit under domain shift, and existing augmentation is either hand-crafted transformations with artifacts or label-only conditional generative models that offer no fine-grained control.

Approach

Define a metric space of spectrogram statistics (temporal amplitude range, F0 amplitude, contrast, flatness, entropy), condition a generative model on these metrics with an added metric loss, and augment by interpolating, disturbing, or domain-knowledge-guided editing of metric values.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use fine-grained metric disturbance instead of label-only conditional generationDiffusion augmentation with DeepSense · Human Activity Recognitionaccuracy: 0.8034 -> 0.8307Helped
use fine-grained metric disturbance instead of label-only conditional generationDiffusion augmentation with Transformer · Human Activity Recognitionaccuracy: 0.8155 -> 0.8205Helped
use fine-grained metric disturbance instead of transformation augmentationDiffusion augmentation with DeepSense · Vehicle Detectionaccuracy: 0.8024 -> 0.8200Helped
use fine-grained metric disturbance instead of label-only conditional VAEDiffusion augmentation with Transformer · Vehicle Detectionaccuracy: 0.7720 -> 0.8008Helped
use fine-grained metric disturbance instead of label-only conditional diffusionDiffusion augmentation with DeepSense · Harmful Brain Activity Recognitionaccuracy: 0.7374 -> 0.7511Helped
use fine-grained metric disturbance instead of label-only conditional diffusionDiffusion augmentation with Transformer · Harmful Brain Activity Recognitionaccuracy: 0.7225 -> 0.7335Helped
add time-domain metric (ablation)Diff-disturb with DeepSense · Human Activity Recognitionaccuracy: 0.8290±0.0202 -> 0.8307±0.0171Helped
add frequency-domain metric (ablation)Diff-disturb with DeepSense · Human Activity Recognitionaccuracy: 0.8177±0.0155 -> 0.8307±0.0171Helped
add time-frequency-domain metrics (ablation)Diff-disturb with DeepSense · Human Activity Recognitionaccuracy: 0.8112±0.0166 -> 0.8307±0.0171Helped
add time-domain metric (ablation)Diff-disturb with DeepSense · Vehicle Detectionaccuracy: 0.7745±0.0122 -> 0.7925±0.0053Helped
add frequency-domain metric (ablation)Diff-disturb with DeepSense · Vehicle Detectionaccuracy: 0.7910±0.0068 -> 0.7925±0.0053Helped
add time-frequency-domain metrics (ablation)Diff-disturb with DeepSense · Vehicle Detectionaccuracy: 0.7880±0.0173 -> 0.7925±0.0053Helped

Surprising findings

Limitations

Experimental setup

Datasets: RealWorld-HAR Vehicle detection (self-collected seismic and acoustic) Harmful Brain Activity Classification (EEG)

Benchmarks: RealWorld-HAR Vehicle detection dataset Harmful Brain Activity Classification

Metrics: accuracy F1 score

Baselines: mixup (data space interpolation) feature space interpolation time and frequency domain transformation cDiff cVAE cGAN

Builds on: mixup NVAE conditional diffusion model harmonic product spectrum

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy