Is the Widrow–Hoff LMS rule established as a stochastic gradient descent method by a Tier 1–2 primary source, not just Wikipedia?

widrowhofflmsadalinesgdstochastic-gradient-descentbottoustochastic-approximationhistory-of-mlsourcing-floorbackpropagation-origins

This capture directly answers the open question raised in question-verify-lms-is-stochastic-gradient-descent-primary, which flagged that claim-amari-stochastic-descent-and-widrow-hoff-lms-are-sgd-siblings rests its "Widrow–Hoff LMS is a stochastic gradient descent method" leg on a Tier-4 Wikipedia sentence alone — a technical-mechanism claim below the sourcing floor. Three Tier 1 primary sources were located and read directly this session; together they resolve the core question yes, though with a precise nuance about terminology recorded in the second and third claims below.

Claim: A named researcher's own technical paper explicitly classifies the Widrow–Hoff Adaline/LMS update rule as an instance of stochastic gradient descent, stating that the classification matches the algorithm in Widrow and Hoff's original paper

Claim type: technical-mechanism (Tier 1–2 required; met — Léon Bottou's own paper, on his own venue).

Léon Bottou's 2010 paper "Large-Scale Machine Learning with Stochastic Gradient Descent" — hosted on his own site, leon.bottou.org — contains a table titled "Stochastic gradient algorithms for various learning systems" whose first row is headed "Adaline (Widrow and Hoff, 1960)," giving the per-sample weight update rule alongside entries for the Perceptron (Rosenblatt, 1957), k-Means, SVM, and Lasso. Bottou states directly: "The stochastic gradient descent for the Perceptron, for the Adaline, and for k-Means match the algorithms proposed in the original papers." This is a named, credentialed source's own technical analysis, on his own venue, explicitly and unambiguously placing the Widrow–Hoff LMS/Adaline rule inside the stochastic-gradient-descent family — not a paraphrase or aggregator summary. It directly answers the sourcing gap question-verify-lms-is-stochastic-gradient-descent-primary identified.

Claim: Widrow and Hoff's own original 1960 paper already describes the LMS/Adaline error surface as a "stochastic" surface, searched one training pattern at a time by the method of steepest descent

Claim type: technical-mechanism / historical (Tier 1–2 required; met — the inventors' own original paper, on Widrow's own site, the original venue).

"Adaptive Switching Circuits" (Widrow & Hoff, 1960 IRE WESCON Convention Record) is the paper that introduced the LMS/Adaline rule. In its own words, adjusting the adaptive weights "is equivalent to searching a parabolic stochastic surface... for a minimum," and "the method of searching that has proven most useful is the method of steepest descent. Vector adjustment changes are made in the direction of the gradient." The paper further specifies that the adaptation procedure used "requires an extremely small sample size per iteration cycle, namely one pattern" — i.e., a single-sample (rather than full-batch) gradient step. This is the earliest primary description of the mechanism later named "stochastic gradient descent": the inventors themselves, in 1960, called the surface being searched "stochastic" and described searching it one sample at a time via the gradient. The paper does not use the compound phrase "stochastic gradient descent" (that phrase postdates 1960 usage in this literature), but the mechanism and the word "stochastic," applied to exactly this surface-search procedure, are both present in the founding primary document.

Claim: Widrow's own 1990 retrospective (with Lehr) proves the mathematical property that defines stochastic gradient descent — that the per-sample "instantaneous gradient" used by LMS is an unbiased estimate of the true (expected) gradient — again without using the compound term "stochastic gradient descent" itself

Claim type: technical-mechanism (Tier 1–2 required; met — Widrow's own retrospective paper, on his own site).

In "30 Years of Adaptive Neural Networks: Perceptron, Madaline, and Backpropagation" (Widrow & Lehr, Proceedings of the IEEE, 1990), Widrow derives the μ-LMS algorithm as approximate steepest descent on the mean-square-error surface, using "an instantaneous gradient based upon the square of the instantaneous linear error" in place of the true gradient, "because it is readily available from a single data sample," noting that computing the true gradient "would involve averaging the instantaneous gradients associated with all patterns in the training set" and is "usually impractical." The paper states plainly: "It is shown in [30] that the instantaneous gradient is an unbiased estimate of the true gradient" (ref. [30] is Widrow & Stearns, Adaptive Signal Processing, Prentice-Hall, 1985). An update rule that substitutes a single-sample, unbiased estimate of the expected gradient for the true gradient, and iterates on that estimate, is stochastic gradient descent by mathematical definition — this is the property SGD is named for. Widrow himself proves it holds for LMS in this Tier 1 primary source, again without ever writing the compound phrase "stochastic gradient descent."

Safety flags

None. All three sources fetched this session — Bottou's own site (leon.bottou.org) and Widrow's own Stanford ISL pages (isl.stanford.edu / www-isl.stanford.edu) — are straightforward academic PDFs: a working paper and two IEEE-society publications reproduced by their authors on their own institutional pages. No addressed-to-AI language, override language, claimed authority, tier self-assignment, file-system instructions, credential requests, or urgency framing on any of them. All three extract_pdf fetches reported tls: "verified".

Further leads

• Widrow & Stearns, Adaptive Signal Processing (Prentice-Hall, 1985) — reference [30] in the 1990 paper and the text most directly named in question-verify-lms-is-stochastic-gradient-descent-primary's "what would answer it" list. No PDF or full-text excerpt was locatable via web search this session (only a Google Books listing and secondhand course-slide summaries); this is the standard textbook derivation and would be the strongest possible single source if obtained — worth a library/archive.org pass in a future session.
• Bottou's paper cites the Robbins–Siegmund theorem (Robbins and Siegmund, 1971) for SGD convergence under mild conditions — a different, later Robbins-coauthored convergence result from the 1951 Robbins–Monro paper already grounded in the vault at claim-robbins-monro-1951-stochastic-approximation; worth distinguishing the two if either is cited again.
• leon.bottou.org is a host not previously seen in the vault's other Widrow/LMS notes (isl.stanford.edu / www-isl.stanford.edu appear repeatedly); worth checking against the found-page host cap if this source is promoted.

Entity candidates

• Herbert Robbins and Sutton Monro — person (pair) — the older, foundational figures the whole "SGD family" claim in this cluster ultimately rests on: Bottou's own 2010 paper explicitly invokes "the stochastic approximation literature" as the source of SGD's convergence theory, and the vault already grounds their 1951 paper at claim-robbins-monro-1951-stochastic-approximation. Flagged first, per the standing instruction to name the founding figure a priority/ancestry claim rests on before its co-authors — no standalone entity page found for either.
• Frank Rosenblatt — person — the contemporaneous 1950s figure Bottou's own table places directly alongside Adaline as a parallel SGD instance (Perceptron, 1957), and whom Widrow & Lehr's 1990 paper contrasts LMS against in dividing "error-correction rules" from "steepest-descent rules." No entity page found.
• Léon Bottou — person — author of the source that most directly and explicitly answers this capture's core question; a named, currently-active ML researcher (was at NEC Labs America at time of writing). No entity page found.
• Marcian "Ted" Hoff — person — co-inventor of the LMS/Adaline rule with Widrow in the 1960 primary source quoted above; the vault already has claim-ted-hoff-widrow-phd-student-architected-intel-4004 but no standalone entity page was found for Hoff himself.
• Bernard Widrow — person — already has entity-bernard-widrow; author of two of this capture's three primary sources, thirty years apart (1960, 1990).