AI Paper Atlas

Research map / Architectures and efficiency / RNNs and normalization

System Identification with Time-Aware Neural Sequence Models

Thomas Demeester

AAAI 2020 · Architectures and efficiency › RNNs and normalization · approach: RNN training dynamics and gradients · 12 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add normalized step size δ_n as an inputStandard GRU · CSTR (missing data)RRSE (%): 10.8±0.6 -> 9.2±1.4Improved
Add normalized step size δ_n as an inputStandard GRU · Winding (missing data)RRSE (%): 30.2 ± 0.4 -> 28.9 ± 1.7Improved
Use an incremental update without unit-root compensation instead of the stationary update (ablation)Time-aware GRU · CSTR (missing data)RRSE (%): 12.1±1.3 -> 79.7±8.0Hurt
Use an incremental update without unit-root compensation instead of the stationary update (ablation)Time-aware GRU · Winding (missing data)RRSE (%): 33.1±0.6 -> 64.8 ± 10.2Hurt
Increase Runge-Kutta order from Euler to RK4 (ablation)Stationary time-aware GRU with constant input interpolation · CSTR (missing data)RRSE (%): 12.1±1.3 -> 8.0±0.4Improved
Use linear rather than constant input interpolation (ablation)Stationary time-aware GRU with Midpoint scheme · Winding (missing data)RRSE (%): 35.3±2.1 -> 28.2±1.8Improved
Use linear rather than constant input interpolation (ablation)Stationary time-aware GRU with Kutta3 scheme · Winding (missing data)RRSE (%): 34.7±4.3 -> 27.1±1.0Improved
Use linear rather than constant input interpolation (ablation)Stationary time-aware GRU with RK4 scheme · Winding (missing data)RRSE (%): 32.2±6.6 -> 25.6±1.4Improved
Increase Runge-Kutta order from Euler to RK4 while using constant input interpolation (ablation)Stationary time-aware GRU · Winding (missing data)RRSE (%): 33.1±0.6 -> 32.2±6.6No clear effect
Use a time-aware Euler update rather than a standard GRU that ignores missing timesGRU · CSTR (missing data)RRSE (%): 10.8±0.6 -> 12.1±1.3Hurt
Use a time-aware Euler update rather than a standard GRU that ignores missing timesGRU · Winding (missing data)RRSE (%): 30.2 ± 0.4 -> 33.1±0.6Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy