atlas

Research map / Architectures and efficiency / RNNs and normalization

Linking Image and Text With 2-Way Nets

CVPR 2017 · Architectures and efficiency › RNNs and normalization · approach: Weight normalization and decay interplay · 191 citations (OpenAlex)

Check your idea against 108,967 papers

AI-extracted summary. Written by AI from the paper's title only (no summary yet). Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
Use the tied 2-way network with Euclidean loss and variance-preserving components2WayNet · XRMBsum correlation: 110.18 vs 107.9Helped
Remove batch normalization (ablation)2WayNet · MNISTcorrelation: 49.15 -> 13.14Hurt
Remove batch normalization (ablation)2WayNet · Flickr8krecall@1 image search: 29.3 -> 21.1Hurt
Apply BN after ReLU rather than before ReLU (ablation)2WayNet · Flickr8kcorrelation: 1313 -> 1758Helped
Add inverse-scale variance regularization Rγ (ablation)2WayNet · Flickr8kcorrelation: 1598 -> 1758Helped
Use tied dropout instead of conventional dropout (ablation)2WayNet · Flickr8kcorrelation: 1557 -> 1758Helped
Remove dropout (ablation)2WayNet · Flickr8kcorrelation: 1758 -> 1091Hurt
Replace leaky ReLU with conventional ReLU (ablation)2WayNet · Flickr8kcorrelation: about 33% (1192 total correlation)Hurt
Remove the mid-network matching loss Lh (ablation)2WayNet · Flickr8kcorrelation: 31% (1230) decreaseHurt
Remove both reconstruction losses Lx and Ly (ablation)2WayNet · Flickr8kcorrelation: increases by 56% (2752)Helped
Remove both reconstruction losses Lx and Ly (ablation)2WayNet · Flickr8k image searchrecall@1: 29.3 to 4.0; decrease of 87%Hurt
Remove decorrelation regularization Rdecov (ablation)2WayNet · Flickr8k image searchrecall@1: decrease by 14%Hurt

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy