adaline

10 notes carry this tag — 7 claims, 3 captures. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

Kelley (1960) and Widrow–Hoff (1960) share a root — steepest descent on a scalar cost — but not the backward chain-rule mechanism: the LMS/SGD ↔ Kelley–Bryson resemblance is a shared ancestor, not a transmission line, and Kelley's own paper says which ancestors

capture promoted Tier 1 2026-09-25 · bipartite-bridge, kelley, widrow, hoff, lms
Widrow and Hoff's 1960 LMS gradient is a closed-form product of measured error and input for one pattern, with no backward sweep and no dynamics model

claim budding Tier 1 2026-09-25 · widrow, hoff, lms, adaline, gradient
Is the Widrow–Hoff LMS rule established as a stochastic gradient descent method by a Tier 1–2 primary source, not just Wikipedia?

capture promoted 2026-08-15 · widrow, hoff, lms, adaline, sgd
Léon Bottou's own 2010 paper classifies the Widrow–Hoff LMS/Adaline update rule as stochastic gradient descent, matching the algorithm in the original 1960 paper

claim seedling Tier 1 2026-08-15 · widrow, hoff, lms, adaline, sgd
Widrow and Hoff's own 1960 paper describes the LMS/Adaline error surface as a 'stochastic' surface, searched one training pattern at a time by steepest descent

claim seedling Tier 1 2026-08-15 · widrow, hoff, lms, adaline, sgd
Widrow's 1990 retrospective (with Lehr) proves the LMS per-sample 'instantaneous gradient' is an unbiased estimate of the true gradient — the defining mathematical property of stochastic gradient descent

claim seedling Tier 1 2026-08-15 · widrow, hoff, lms, adaline, sgd
Madaline Rule I (1962) could adapt only the first layer of Widrow's networks — the second layer stayed fixed, making it the ceiling of pre-backpropagation multilayer training

claim budding Tier 1 2026-07-09 · widrow, madaline, adaline, multilayer-perceptron, backpropagation
Ted Hoff — Bernard Widrow's Stanford PhD student and co-inventor of the LMS/ADALINE — went on to architect the Intel 4004, the first commercial microprocessor

claim seedling Tier 4 2026-07-09 · hoff, widrow, adaline, lms, intel-4004
Widrow's group spent the 1960s unable to train a genuinely multilayer network and left neural-net research until backpropagation reached Widrow in the mid-1980s

claim budding Tier 1 2026-07-09 · widrow, madaline, adaline, multilayer-perceptron, backpropagation
Did Widrow attempt and abandon multilayer network training around 1965–1966, and what primary sources document this effort?

capture promoted 2026-07-08 · widrow, madaline, adaline, multilayer-perceptron, backpropagation