AI Paper Atlas

Research map / Learning theory and algorithms / Combinatorial and search optimization

Synthesizing Tasks for Block-based Programming

Umair Ahmed, Maria Christakis, Aleksandr Efremov, Nigel Fernandez, Ahana Ghosh, Abhik Roychoudhury, Adish Singla

NeurIPS 2020 · Learning theory and algorithms › Combinatorial and search optimization · approach: Search for program synthesis · 2 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Ours vs direct grid mutation (TaskMut)task synthesis · HOC user studymean task-solving success: 0.89 vs 0.68Improved
Ours vs expert-designed Tutor taskstask synthesis · HOC user studymean task-solving success: 0.89 vs 0.90No clear effect
Ours vs TaskMuttask synthesis · HOC user studymean visual dissimilarity: 2.63 vs 2.17Improved
Ours vs Tutortask synthesis · HOC user studymean visual dissimilarity: 2.63 vs 2.90Hurt
Ours vs Tutor excluding H2task synthesis · HOC user studymean visual dissimilarity: 2.72 vs 2.93No clear effect
Ours vs Tutor on nested-conditional tasks H5,H6task synthesis · HOC user studymean visual dissimilarity: 2.94 vs 3.03No clear effect
Ours vs TaskMut on H5,H6task synthesis · HOC user studymean visual dissimilarity: 1.97 -> 2.94Improved
Use Z3 jointly with all constraints instead of enumeration plus post-checking (ablation)mutation stage · HOC/Karel tasksrun-time: 10 to 100Improved
Use MCTS instead of random search in symbolic execution (ablation)symbolic execution · H5 taskunique symbolic executions needed: at least 10 timesImproved
Increase MCTS iterations (200, 20K, 2M) (ablation)MCTS · H5 taskF score and generated task qualityImproved

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy