AI Paper Atlas

Research map / Detection and segmentation / Open-set and few-shot detection

KaLOS finds Consensus: A Meta-Algorithm for Evaluating Inter-Annotator Agreement in Complex Vision Tasks

David Tschirschwitz, Volker Rodehorst

CVPR 2026 · Detection and segmentation › Open-set and few-shot detection · approach: Open-set and unknown object detection

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use Greedy correspondence solver instead of MGM or SHM (ablation)KalOS · synthetic noise testbed (LVIS, TexBiG, VinDr-CXR)filtered Rand Index / F1Improved
use Greedy solver instead of MGM and SHM for permutation stability (ablation)KalOS · NuCLSmean ARI: 0.9327 (SHM) / 0.9606 (MGM) -> 0.99998Improved
use Agglomerative Hierarchical Clustering as solver (ablation)KalOS · synthetic noise testbedfiltered Rand IndexHurt
use globally optimal MGM solver instead of Greedy (ablation)KalOS · synthetic noise testbedrecall / F1Hurt
use class-aware cost psi_soft instead of localization-only cost psi_neg (ablation)KalOS · synthetic noise testbedfiltered Rand Index / F1Improved
increase number of raters from 2 to 18 (ablation)KalOS score · synthetic noise at fixed magnitudemean KalOS score: diminishing returns beyond roughly 6-8 ratersImproved
split raters into two opposing collaboration clusters (e.g. 3-3 instead of 5-1) (ablation)KalOS score · synthetic LVIS ratersKalOS scoreHurt
raise synthetic noise magnitude lambda from 1.0 to 5.0 (ablation)noise generator · LVISsignal-loss ratio: 4.2% -> 28.3%Hurt
use three raters instead of one synthetic rater for solver recovery (ablation)correspondence solvers · synthetic noise testbedfiltered Rand IndexHurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy