sgd

9 notes carry this tag — 5 claims, 1 question, 2 captures, 1 myth. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

Is the Widrow–Hoff LMS rule established as a stochastic gradient descent method by a Tier 1–2 primary source, not just Wikipedia?

capture promoted 2026-08-15 · widrow, hoff, lms, adaline, sgd
Léon Bottou's own 2010 paper classifies the Widrow–Hoff LMS/Adaline update rule as stochastic gradient descent, matching the algorithm in the original 1960 paper

claim seedling Tier 1 2026-08-15 · widrow, hoff, lms, adaline, sgd
Widrow and Hoff's own 1960 paper describes the LMS/Adaline error surface as a 'stochastic' surface, searched one training pattern at a time by steepest descent

claim seedling Tier 1 2026-08-15 · widrow, hoff, lms, adaline, sgd
Widrow's 1990 retrospective (with Lehr) proves the LMS per-sample 'instantaneous gradient' is an unbiased estimate of the true gradient — the defining mathematical property of stochastic gradient descent

claim seedling Tier 1 2026-08-15 · widrow, hoff, lms, adaline, sgd
The Amari-myth / Faggin-consciousness bridge is superficial as a direct edge — the real connective tissue runs through Ted Hoff and the SGD learning-rule family

capture promoted Tier 4 2026-07-11 · amari, faggin, ted-hoff, widrow, lms
Amari's 1967 stochastic descent and the 1960 Widrow–Hoff LMS rule are sibling members of the SGD family, about seven years apart

claim budding Tier 4 2026-07-11 · amari, widrow, hoff, lms, sgd
Is the Widrow–Hoff LMS rule established as a stochastic gradient descent method by a Tier 1–2 primary source, not just Wikipedia?

question answered 2026-07-11 · lms, widrow, hoff, sgd, stochastic-descent
Robbins and Monro 1951 founded stochastic approximation — the method family SGD belongs to — as root-finding from noisy experiments

claim budding Tier 1 2026-07-07 · sgd, stochastic-approximation, robbins-monro, history-of-ml, statistics
Myth ledger: 'Amari trained multilayer perceptrons by SGD in 1967'

note budding 2026-07-06 · myth, amari, schmidhuber, sgd, mlp