AI Paper Atlas

Research map / Optimization / Optimizers

Demystifying and Generalizing BinaryConnect

Tim Dockhorn, Yaoliang Yu, Eyyub Sari, Mahdi Zolnouri, Vahid Partovi Nia

NeurIPS 2021 · Optimization › Optimizers · approach: Constrained and non-backprop training · 0 citations (OpenAlex)

Read the paperCheck your idea against 137,217 papers

AI-extracted. The measured effects below were read by AI from the paper's full text (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
use ProxConnect instead of BinaryConnectResNet20 ternary · CIFAR-10 end-to-endtest accuracy: 27.10 -> 84.09Improved
use ProxConnect instead of BinaryConnectResNet56 ternary · CIFAR-10 end-to-endtest accuracy: 30.31 -> 84.36Improved
use ProxConnect instead of ProxQuantResNet20 binary · CIFAR-10 end-to-endtest accuracy: 81.59 -> 89.92Improved
use ProxConnect instead of BinaryConnectResNet20 binary · CIFAR-10 end-to-endtest accuracy: 87.51 -> 89.92Improved
use ProxConnect instead of BinaryConnectResNet56 quaternary · CIFAR-10 fine-tuningtest accuracy: 93.20 -> 93.42Improved
use ProxConnect instead of BinaryConnectResNet20 binary · CIFAR-10 fine-tuningtest accuracy: 90.31 -> 90.31No clear effect
use ProxConnect instead of BinaryConnectResNet18 ternary-free binary quantization · ImageNet fine-tuningtest accuracy: 65.84 -> 65.70Hurt
use ProxConnect instead of BinaryConnectResNet18 · ImageNet end-to-endtest accuracy: 63.79 -> 63.89No clear effect
train from random init instead of fine-tuning pretrainedProxQuant · CIFAR-10 ResNet20 binarytest accuracy: 89.94 -> 81.59Hurt
train from random init instead of fine-tuning pretrainedBinaryConnect · CIFAR-10 ResNet20 ternarytest accuracy: 74.95 -> 27.10Hurt
train from random init instead of fine-tuning pretrainedProxConnect · CIFAR-10 ResNet20 ternarytest accuracy: 91.37 -> 84.09Hurt
use BinaryConnect for ternary quantization instead of ProxQuantResNet20 · CIFAR-10 fine-tuningtest accuracy: 91.46 -> 74.95Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy