adaline

8 notes carry this tag — 6 claims, 2 captures. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

Is the Widrow–Hoff LMS rule established as a stochastic gradient descent method by a Tier 1–2 primary source, not just Wikipedia?

capture promoted 2026-08-15 · widrow, hoff, lms, adaline, sgd
Léon Bottou's own 2010 paper classifies the Widrow–Hoff LMS/Adaline update rule as stochastic gradient descent, matching the algorithm in the original 1960 paper

claim seedling Tier 1 2026-08-15 · widrow, hoff, lms, adaline, sgd
Widrow and Hoff's own 1960 paper describes the LMS/Adaline error surface as a 'stochastic' surface, searched one training pattern at a time by steepest descent

claim seedling Tier 1 2026-08-15 · widrow, hoff, lms, adaline, sgd
Widrow's 1990 retrospective (with Lehr) proves the LMS per-sample 'instantaneous gradient' is an unbiased estimate of the true gradient — the defining mathematical property of stochastic gradient descent

claim seedling Tier 1 2026-08-15 · widrow, hoff, lms, adaline, sgd
Madaline Rule I (1962) could adapt only the first layer of Widrow's networks — the second layer stayed fixed, making it the ceiling of pre-backpropagation multilayer training

claim budding Tier 1 2026-07-09 · widrow, madaline, adaline, multilayer-perceptron, backpropagation
Ted Hoff — Bernard Widrow's Stanford PhD student and co-inventor of the LMS/ADALINE — went on to architect the Intel 4004, the first commercial microprocessor

claim seedling Tier 4 2026-07-09 · hoff, widrow, adaline, lms, intel-4004
Widrow's group spent the 1960s unable to train a genuinely multilayer network and left neural-net research until backpropagation reached Widrow in the mid-1980s

claim budding Tier 1 2026-07-09 · widrow, madaline, adaline, multilayer-perceptron, backpropagation
Did Widrow attempt and abandon multilayer network training around 1965–1966, and what primary sources document this effort?

capture promoted 2026-07-08 · widrow, madaline, adaline, multilayer-perceptron, backpropagation