AI Paper Atlas

Research map / Large language models / Alignment and preferences

Coactive Critiquing: Elicitation of Preferences and Features

AAAI 2017 · Large language models › Alignment and preferences · approach: Reward model design and preference models · 19 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Dynamically acquire critique features using NeedCritiqueCoactive Critiquing · Synthetic preference taskmedian utility lossHelped
Use Coactive Critiquing instead of CL^100Synthetic preference task · Synthetic preference taskiterations to zero median utility loss: 11 iterations; 41 iterationsHurt
Dynamically acquire critique features using NeedCritiqueCoactive Critiquing · Trip planningutility lossHelped
Use Coactive Critiquing instead of CL^60Trip planning · Trip planningutility lossNo clear effect
Use Coactive Critiquing instead of CL^40Trip planning · Trip planningutility lossHelped
Replace NeedCritique with random critique querying at θ=1 (ablation)Coactive Critiquing · Synthetic preference taskmedian utility lossMixed
Replace NeedCritique with random critique querying at θ=0.75 (ablation)Coactive Critiquing · Synthetic preference taskmedian utility lossMixed
Replace NeedCritique with random critique querying at θ=0.5 or θ=0.25 (ablation)Coactive Critiquing · Synthetic preference taskmedian utility lossHurt
Start with 2 features and acquire additional features through critiques rather than having a fixed feature subsetCoactive Critiquing · Synthetic preference taskmedian utility loss: 41 iterations; 18 iterationsMixed
Acquire features dynamically rather than start with a fixed 20% feature subsetCoactive Critiquing · Trip planningutility lossHelped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy