AI Paper Atlas

Research map / Large language models / Agents, code and math

pyKT: A Python Library to Benchmark Deep Learning based Knowledge Tracing Models

NeurIPS 2022 · Large language models › Agents, code and math · approach: LLM-driven embodied and driving agents · 30 citations (OpenAlex)

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use AKT (monotonic attention + Rasch embeddings) instead of DKTDLKT model · AS2009 question levelAUC: 0.7541 -> 0.7853Helped
use AKT instead of DKTDLKT model · POJAUC: 0.6089 -> 0.6281Helped
use DKT+ instead of vanilla DKTDLKT model · AL2005 question levelAUC: 0.8149 -> 0.8156No clear effect
use SAKT self-attention instead of DKTDLKT model · AS2009 question levelAUC: 0.7541 -> 0.7246Hurt
evaluate with leaky one-by-one KC prediction instead of all-in-oneDKT · AL2005 KC levelAUC: 0.8146 -> 0.9218Helped
evaluate with leaky one-by-one KC prediction instead of all-in-oneDKT · AS2009 KC levelAUC: 0.7419 -> 0.8262Helped
evaluate with leaky one-by-one KC prediction instead of all-in-oneDKT · BD2006 KC levelAUC: 0.8013 -> 0.8028No clear effect
use early fusion instead of late fusion average (ablation)AKT · AL2005AUC: 0.8306 -> 0.8177Hurt
use majority-vote instead of average for KC fusion (ablation)DKT · AS2009AUC: 0.7541 -> 0.7526Hurt
fuse KC predictions by average (ablation)DKT · BD2006AUC: 0.8015 -> 0.8015No clear effect
evaluate on long (>200) instead of short sequencesAKT · POJAUC: 0.6949 -> 0.6137Hurt
evaluate on long instead of short sequencesDKT · Statics2011AUC: 0.8314 -> 0.8219No clear effect

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy