AI Paper Atlas

Research map / Reinforcement learning / Visual and representation RL

A Partially-Supervised Reinforcement Learning Framework for Visual Active Search

Anindya Sarkar, Nathan Jacobs, Yevgeniy Vorobeychik

NeurIPS 2023 · Reinforcement learning › Visual and representation RL · approach: RL with tree search for discovery · 1 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
decompose the policy into prediction and search modules and update predictions from observed labelsVAS on xView · Helicopter target, C=25, single queryANT: 0.54 -> 0.87Improved
meta-learn the prediction initialization jointly with the search policyPSVAS on xView · Helicopter target, C=25, single queryANT: 0.87 -> 0.92Improved
meta-learn the prediction initialization jointly with the search policyPSVAS on DOTA · Ship target, C=25, single queryANT: 2.46 -> 3.08Improved
learn interdependencies between sequential query choices instead of selecting the top-k grids greedilyMPS-VAS-topk · xView, Helicopter target, C=25, multi-queryANT: 0.55 -> 0.63Improved
set supervised-loss weight λ to 0.1 rather than 0.001 (ablation)PSVAS on xView · Small Car target, C=25ANT: 4.96 -> 5.51Improved
set supervised-loss weight λ to 0.1 rather than 0.001 (ablation)MPS-VAS on xView · Small Car target, C=25ANT: 4.99 -> 5.55Improved
remove supervised prediction loss by setting λ=0 (ablation)MPS-VAS on xView · Small Car target, C=25ANT: 5.55 -> 4.77Hurt
update prediction parameters from observed labels during searchVAS on DOTA · Ship target, C=25, single queryANT: 2.46 -> 3.60Improved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy