stochastic-descent

3 notes carry this tag — 2 claims, 1 question. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

Amari's 1967 stochastic descent and the 1960 Widrow–Hoff LMS rule are sibling members of the SGD family, about seven years apart

claim budding Tier 4 2026-07-11 · amari, widrow, hoff, lms, sgd
Is the Widrow–Hoff LMS rule established as a stochastic gradient descent method by a Tier 1–2 primary source, not just Wikipedia?

question answered 2026-07-11 · lms, widrow, hoff, sgd, stochastic-descent
Amari's 1968 book, read directly, credits Saito's 1967 Kyushu thesis for a stochastic-descent experiment on a piecewise-linear classifier — with no multilayer vocabulary on the scanned pages

claim budding Tier 1 2026-07-07 · amari, saito, schmidhuber, stochastic-descent, history-of-ml