← Proof Notes
Counterexample / Optimization & generalization

A negative upper bound on the squared BatchNorm weight gradient

How Does Batch Normalization Help Optimization?

1,763 citations ↗Semantic Scholar · 2026-09-09

2018 · arXiv:1805.11604v5, 15 April 2019; NeurIPS 2018 main and supplement · Reviewed 09 September 2026

An explicit example contradicts the selected statement as written.

Paper context

Overview

This paper investigates why batch normalization helps neural-network training. It challenges the explanation based solely on stabilizing intermediate activation distributions and argues, through experiments and mathematical analysis, that normalization can make the optimization landscape and gradients better behaved.

Role of the theoretical result

The selected theorem tries to translate an effect on activation gradients into a worst-case bound on weight gradients. That translation matters because training updates the weights; it complements the paper's other theoretical statements and experiments.

Original paper ↗

01 / Summary

Summary of the result

Theorem 4.4 subtracts an activation-correlation term without the normalization required by the BatchNorm Jacobian. For a batch of size two, the centered and normalized activation directions span the batch space, so the idealized BatchNorm projector is zero at every nondegenerate batch. The construction below nevertheless gives a negative right-hand side for the stated squared-gradient bound. The fixed-batch projection identity retains factors of 1/m in both subtracted terms.

02 / Statement

Statement under review

Theorem 4.4, p8; Appendix C.2, pp20–21, especially the final step after equation (17). · paraphrased

Theorem 4.4 gives a worst-case squared weight-gradient bound for BatchNorm by subtracting mean-gradient and activation-correlation terms from the corresponding ordinary-network quantity.

gj=maxXλWL2,g^j=maxXλWL^2,g^jγ2σj2(gj2mμgj2λ2yjL,y^j2)g_j=\max_{\|X\|\le\lambda}\|\nabla_W L\|^2,\quad \widehat g_j=\max_{\|X\|\le\lambda}\|\nabla_W\widehat L\|^2,\quad \widehat g_j\le\frac{\gamma^2}{\sigma_j^2}\left(g_j^2-m\mu_{g_j}^2-\lambda^2\langle\nabla_{y_j}L,\widehat y_j\rangle^2\right)
Relevant assumptions
  • Batch size m=2, two input coordinates, W=(1,−1), operator-norm bound λ=1, fixed BN scale γ=1 and shift 0.
  • Use the same nonnegative differentiable downstream mean Huber loss in both networks: L(y)=[Huber1(y1+3)+Huber1(y2−3)]/2.
  • BN is the paper's idealized formula without numerical epsilon; restrict to batches with positive variance.
  • The downstream gradient is a=(1/2,−1/2) on every ordinary activation with ||X||≤1 and on both possible normalized BN outputs.

03 / Derivation

Counterexample and derivation

6 steps · complete derivation
  1. 01

    For ||X||op≤1, ordinary activations y=XW have norm at most √2. Both Huber residuals stay in their linear regions, so the downstream gradient is always a=(1/2,−1/2).

  2. 02

    The ordinary squared weight-gradient maximum is ||a||²=1/2, attained at X=I.

  3. 03

    Every nonconstant two-example batch normalizes to yhat=±(1,−1). The BN derivative contains P=I−11ᵀ/2−yhat yhatᵀ/2, which is the zero matrix.

  4. 04

    Hence the BN weight-gradient maximum is zero. At X=I, variance σ²=1, mean(a)=0 and <a,yhat>²=1.

  5. 05

    Using the printed definition g_j=max||∇WL||², its right side is (1/2)²−1=−3/4. Even reading g_j as an unsquared norm gives 1/2−1=−1/2.

  6. 06

    The fixed-activation projection calculation needs the factor 1/m on the squared correlation. That normalization appears earlier in the appendix but disappears in the final weight-space expression.

Counterexample

For m=d=2, X=I, W=(1,−1), γ=1 and the specified Huber loss, the BatchNorm weight gradient is zero. The printed right-hand side is −3/4 under its squared-norm notation, yielding the contradiction 0≤−3/4.

g^=0,g=12,a,y^2=1,0≰34(or 12 under the alternate norm convention)\widehat g=0,\quad g=\frac12,\quad \langle a,\widehat y\rangle^2=1,\qquad 0\not\le-\frac34\quad(\text{or }-\tfrac12\text{ under the alternate norm convention})

04 / Implications

Implications and proposed correction

Theoretical implications

Affected result

Refutes the quantitative weight-space bound as printed, under either natural reading of its extra squared notation.

Empirical scope

Relation to reported experiments

Does not refute the empirical BN observations, every smoothing result, or the separate activation-space projection identity.

Proposed correction

Sufficient conditions and revised bound

Use the exact fixed-batch chain rule ∇W LBN=Xᵀ(γ/σ)Pa, with a evaluated at the BN output. It implies ||∇W LBN||²≤λ²γ²/σ²[||a||²−<1,a>²/m−<yhat,a>²/m]. The vectors 1/√m and yhat/√m are orthonormal. P projects away their two directions, so the Pythagorean identity supplies both factors 1/m.

Implementation implications

Standard BN backpropagation need not be changed because of this theorem error. Any certificate or learning-rate argument based on the printed worst-case formula must use the normalized Jacobian and track how a and σ vary with the batch.

Limits of this review

  • The example uses m=2, which is not excluded by the printed theorem.
  • Zero-variance batches are outside the paper's epsilon-free BN definition.
  • Real implementations usually add epsilon; this is a counterexample to the idealized theorem, not a claim that practical BN has an exactly zero gradient at batch size two.
  • Restoring 1/m is not a complete proof of a corrected minimax theorem: the downstream gradient, normalized activation and variance all depend on X. The stated repair is a fixed-batch bound.

05 / References

Sources and correction history

  1. 01
    Current primary paper

    Theorem 4.4 p8; Appendix C.2 pp20–21

  2. 02
    Distinct published criticism

    Dannemann–Junike, Sections 1 and 3: counterexample to initialization Lemma 4.5, not weight-space Theorem 4.4

Download the arithmetic witnesses · Python, no dependencies ↓
Correction search · 09 September 2026

2026-09-09 Rechecked current v5, the printed theorem and the derivation; inspected the theorem image. Revisited the NeurIPS supplement, public reviews and the 2025 initialization counterexample. Repeated exact-title, Theorem 4.4, minimax, normalization, correction and error searches. The located 2025 criticism addresses Lemma 4.5. No retrieved source corrects this specific Theorem 4.4 bound. The same paper already contains the valid activation-space normalization; that does not by itself supply a corrected weight-space maximization theorem. No claim of exhaustive absence of later discussion or of priority.

A bounded search is not evidence of priority or proof that no correction exists.

Entirely AI-generated analysis, including cross-checks by separate AI agents; no independent human verification. Authors have not been contacted. Review standard.

Suggest a correction with a source ↗
Next analysisCalibration is insufficient for the TRADES surrogate bound