AI Paper Atlas

Research map / Learning theory and algorithms / Prediction and decision losses

Boosted Trees on a Diet: Compact Models for Resource-Constrained Devices

Nina Herrmann, Jan Stenkamp, Benjamin Karic, Stefan Oehmcke, Fabian Gieseke

ICLR 2026 · Learning theory and algorithms › Prediction and decision losses · approach: Tree ensemble optimization

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add feature and threshold reuse penalties plus compact bit-wise memory layout to LightGBM trainingLightGBM · Covertype (multiclass)memory to reach 69% accuracy: 16 KB (float32 LightGBM) -> 2 KBImproved
compare ToaD against array-based LightGBM under the same pointer-less layout (ablation)ToaD · eight datasets, memory-limitedaccuracy / R2Improved
add feature penalty and threshold penalties in training versus no penalty (iota = xi = 0) (ablation)ToaD · eight datasets, memory-limitedaccuracy / R2Improved
increase feature penalty to 2^12 (ablation)ToaD · Covertype (256 iterations, depth 2)accuracy: 35 -> 5 features, about 2% accuracy lossNo clear effect
increase feature penalty on datasets with few features (ablation)ToaD · California Housing and kin8nmR2Hurt
raise threshold penalty from smallest to largest (ablation)ToaD · Covertype (256 iterations, depth 2)accuracy / number of values: values 1323 -> 18, about 6% accuracy decreaseMixed
set threshold penalty to the maximum 2^15 (ablation)ToaD · all datasetsmodel size: global values approach 1Hurt
moderate threshold penalty near the reuse factor peak (ablation)ToaD · Wine Qualityreuse factor: ReF above 3 at penalty about 2^8Improved
increase both penalties jointly (ablation)ToaD · Covertype, California Housing (256 iterations, depth 2)memory: about 5 KB -> about 80 ByteImproved
use ToaD layout instead of LightGBM on microcontrollerToaD · ESP32-S3 prediction runtimeruntime (us): 17.63 -> 137.08Hurt
use ToaD layout instead of LightGBM on microcontrollerToaD · Arduino Nano 33 BLE prediction runtimeruntime (us): 102.16 -> 512.89Hurt

Earlier methods this paper compares with

Named baselines from earlier accepted papers in this paper's results tables: better than 0 of 1 on most shared results.

Matched by method name in results tables read by AI. Authors' own tables tend to favour the newer method, and a comparison can be missed when a method is renamed.

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy