stochastic-approximation

4 notes carry this tag — 2 claims, 2 captures. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

Is the Widrow–Hoff LMS rule established as a stochastic gradient descent method by a Tier 1–2 primary source, not just Wikipedia?

capture promoted 2026-08-15 · widrow, hoff, lms, adaline, sgd
Widrow and Hoff's own 1960 paper describes the LMS/Adaline error surface as a 'stochastic' surface, searched one training pattern at a time by steepest descent

claim seedling Tier 1 2026-08-15 · widrow, hoff, lms, adaline, sgd
Robbins and Monro 1951 founded stochastic approximation — the method family SGD belongs to — as root-finding from noisy experiments

claim budding Tier 1 2026-07-07 · sgd, stochastic-approximation, robbins-monro, history-of-ml, statistics
Did Robbins & Monro (1951) originate stochastic gradient descent, and is Schmidhuber correct that Amari applied this specific method to MLPs in 1967?

capture promoted 2026-07-03 · stochastic-gradient-descent, stochastic-approximation, robbins-monro, amari, schmidhuber