hoff

7 notes carry this tag — 5 claims, 1 question, 1 capture. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

Is the Widrow–Hoff LMS rule established as a stochastic gradient descent method by a Tier 1–2 primary source, not just Wikipedia?

capture promoted 2026-08-15 · widrow, hoff, lms, adaline, sgd
Léon Bottou's own 2010 paper classifies the Widrow–Hoff LMS/Adaline update rule as stochastic gradient descent, matching the algorithm in the original 1960 paper

claim seedling Tier 1 2026-08-15 · widrow, hoff, lms, adaline, sgd
Widrow and Hoff's own 1960 paper describes the LMS/Adaline error surface as a 'stochastic' surface, searched one training pattern at a time by steepest descent

claim seedling Tier 1 2026-08-15 · widrow, hoff, lms, adaline, sgd
Widrow's 1990 retrospective (with Lehr) proves the LMS per-sample 'instantaneous gradient' is an unbiased estimate of the true gradient — the defining mathematical property of stochastic gradient descent

claim seedling Tier 1 2026-08-15 · widrow, hoff, lms, adaline, sgd
Amari's 1967 stochastic descent and the 1960 Widrow–Hoff LMS rule are sibling members of the SGD family, about seven years apart

claim budding Tier 4 2026-07-11 · amari, widrow, hoff, lms, sgd
Is the Widrow–Hoff LMS rule established as a stochastic gradient descent method by a Tier 1–2 primary source, not just Wikipedia?

question answered 2026-07-11 · lms, widrow, hoff, sgd, stochastic-descent
Ted Hoff — Bernard Widrow's Stanford PhD student and co-inventor of the LMS/ADALINE — went on to architect the Intel 4004, the first commercial microprocessor

claim seedling Tier 4 2026-07-09 · hoff, widrow, adaline, lms, intel-4004