atlas

Research map / Architectures and efficiency / RNNs and normalization

COLA: Orchestrating Error Coding and Learning for Robust Neural Network Inference Against Hardware Defects

ICML 2023 · Architectures and efficiency › RNNs and normalization · approach: Theory of depth and width

Read the paperCheck your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Add COLA components (separation, AAWO, TC regularization) to ECOCAlexNet with ECOC · CIFAR10 state errorclean accuracy (γ=0): 68.04 -> 79.04Helped
Add COLA components to ECOCVGG-16 CIFAR100 under bit-flip errors · bit-flip α=0.05accuracy (%): 01.47 -> 41.51Helped
Add separation architecture plus AAWO and TC regularization to ECOCLeNet-5 MNIST · state error γ=0.4accuracy (%): 81.09 -> 93.12Helped
Conventional ECOC replacing one-hot softmaxAlexNet CIFAR10 · clean accuracy (γ=0)accuracy (%): 72.33 -> 68.04Hurt
Add separation architecture to ECOC (ECOC+Sep, prior work)AlexNet CIFAR10 · state error γ=0accuracy (%): 68.04 -> 71.67Helped
Add TC output regularizer to ECOC (ablation)AlexNet CIFAR10 · state error γ=0accuracy (%): 68.04 -> 78.35 (bit-flip α=0) / 77.08 is COLA-onlyHelped
Add AAWO orthogonalization to separation architecture (ECOC+Sep+orth) (ablation)AlexNet CIFAR10 · state error γ=0.5accuracy (%): 54.48 -> 56.34 (vs ECOC+Sep)Helped
Relax weight orthogonalization to AAWO (diagonal Dm constraint) instead of strict WO (ablation)VGG-16 CIFAR100 · state error γ=0.3accuracy (%): Strict WO 25.11-ish range; AAWO 66.12 vs WO 60.51 at 0.2Helped
Use stronger code (Hadamard-15) without COLA (ablation)AlexNet CIFAR10 ECOC · state error across variation levelsaccuracy (%): ECOC-15 performs worse than ECOC-10 at all variation levelsHurt
Apply COLA to a stronger code (Hadamard-15 vs one-hot code length 10) (ablation)AlexNet CIFAR10 ECOC · state erroraccuracy (%): ECOC+TC+Sep+orth-15 outperforms ECOC+TC+Sep+orth-10Helped
Apply COLA to original softmax one-hot DNN (Original-COLA) (ablation)AlexNet CIFAR10 · state error γ=0 and γ=0.5accuracy (%): 72.33 -> 76.68 (clean); 36.11 -> 66.74 (γ=0.5)Helped
Apply COLA to original DNN and use ECOC codes (ECOC-COLA) rather than one-hot (ablation)AlexNet CIFAR10 · state error γ=0.5accuracy (%): 66.74 -> 68.55 (Original-COLA vs ECOC-COLA)Helped

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy