atlas

Research map / Detection and segmentation / Weakly supervised detection and segmentation

A New Multi-Source Light Detection Benchmark and Semi-Supervised Focal Light Detection

NeurIPS 2024 · Detection and segmentation › Weakly supervised detection and segmentation · approach: Pseudo-labeling for semi-supervised detection · 0 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Introduces YDLD, a 3.5k-image, 116k-box multi-source light detection dataset from YouTube driving videos, and a semi-supervised focal light detector (SS-FLD) using a lightness focal loss and a lightness spatial attention prior.

Problem

Multi-source light detection (vehicle lights, traffic signal lights, streetlights) in driving scenes is understudied, mainly due to the lack of public multi-class benchmark datasets; existing detectors give low mAP on tiny, similar-looking lights.

Approach

A lightness focal loss that adds a false-positive term 1/(q+eps) and a geometry-based lightness spatial attention prior (learned from GT box density relative to vanishing points), embedded into a semi-supervised object detection (mean-teacher) framework.

Key results

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Pretrain DINO on YDLD before fine-tuning on BDD100kDINO · BDD100kmAPHelped
Add LF loss to RFLA (ablation)RFLA · YDLDmAP: 21.6 -> 24.3Helped
Add SSOD to RFLA with LF loss (ablation)RFLA · YDLDmAP: 24.3 -> 26.0Helped
Add LF loss to PAA (ablation)PAA · YDLDmAP: 21.6 -> 24.5Helped
Add SSOD to PAA with LF loss (ablation)PAA · YDLDmAP: 24.5 -> 25.6Helped
Add the FP focal loss term (ablation)Original focal loss in M1 · YDLDmAP: 21.6 -> 24.4Helped
Add the lightness spatial attention prior (ablation)Original focal loss in M1 · YDLDmAP: 21.6 -> 24.5Helped
Add both the FP focal loss and lightness spatial attention prior (ablation)Original focal loss in M1 · YDLDmAP: 21.6 -> 25.6Helped
Use SS-FLD with RFLA instead of the RFLA baselineRFLA · YDLD testmAP: 21.6 -> 26.0Helped
Use SS-FLD with DINO instead of DINODINO · YDLD testmAP: 22.6 -> 25.6Helped

Surprising findings

Limitations

Experimental setup

Datasets: YDLD BDD100k KITTI SODA10M ImageNet MS-COCO

Benchmarks: YDLD BDD100k

Metrics: box AP (mAP at IoU 0.5:0.95) APvt APt APs AP50 AP75

Baselines: Libra R-CNN Faster R-CNN Cascade R-CNN YOLOF RetinaNet ATSS YOLOX PAA Deformable DETR DINO SoftTeacher MeanTeacher

Builds on: focal loss DINO PAA RFLA ConsistentTeacher

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy