all tags

backpropagation-origins

20 notes carry this tag — 6 claims, 6 observations, 1 question, 7 captures. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

• Is there a documented transmission line from Bell Labs classical control theory (Nyquist 1932, Bode) into 1950s–60s optimal control theory (Pontryagin, Bellman, Kelley, Bryson) — or only a periodization coincidence?
  capture promoted Tier 1 2026-08-24 · control-theory, nyquist, bode, optimal-control, pontryagin
• Kelley's 1960 "Gradient Theory of Optimal Flight Paths" cites no work by Nyquist, Bode, or classical control theory
  claim seedling Tier 1 2026-08-24 · control-theory, nyquist, bode, optimal-control, kelley
• Is the Widrow–Hoff LMS rule established as a stochastic gradient descent method by a Tier 1–2 primary source, not just Wikipedia?
  capture promoted 2026-08-15 · widrow, hoff, lms, adaline, sgd
• Léon Bottou's own 2010 paper classifies the Widrow–Hoff LMS/Adaline update rule as stochastic gradient descent, matching the algorithm in the original 1960 paper
  claim seedling Tier 1 2026-08-15 · widrow, hoff, lms, adaline, sgd
• Widrow and Hoff's own 1960 paper describes the LMS/Adaline error surface as a 'stochastic' surface, searched one training pattern at a time by steepest descent
  claim seedling Tier 1 2026-08-15 · widrow, hoff, lms, adaline, sgd
• Widrow's 1990 retrospective (with Lehr) proves the LMS per-sample 'instantaneous gradient' is an unbiased estimate of the true gradient — the defining mathematical property of stochastic gradient descent
  claim seedling Tier 1 2026-08-15 · widrow, hoff, lms, adaline, sgd
• Do the vault's myth-ledger back-projection cases actually sort into Skinner's prolepsis vs. mythology of doctrines vs. coherence?
  capture promoted 2026-07-28 · historiography, quentin-skinner, prolepsis, mythology-of-doctrines, mythology-of-coherence
• The 'Perceptrons killed connectionism' myth only half-fits Skinner's taxonomy — its causal-attribution component falls outside all four mythologies
  observation seedling Tier 1 2026-07-28 · historiography, quentin-skinner, mythology-of-doctrines, myth-ledger, perceptrons
• Skinner's Machiavelli 'founder' example adds a causal-naivety charge to the vault's Schmidhuber prolepsis case
  observation seedling Tier 1 2026-07-28 · historiography, quentin-skinner, mythology-of-prolepsis, myth-ledger, schmidhuber
• Skinner's mythology of coherence finds no clean instance among the vault's myth-ledger cases
  observation seedling Tier 1 2026-07-28 · historiography, quentin-skinner, mythology-of-coherence, myth-ledger, backpropagation-origins
• Werbos's 'credit assignment' and Amari's 'five-layer MLP' are independent instances of Skinner's mythology of doctrines
  observation seedling Tier 1 2026-07-28 · historiography, quentin-skinner, mythology-of-doctrines, myth-ledger, werbos
• Skinner's prolepsis and mythology of doctrines name two distinct modes of the vault's back-projection pattern — significance-as-intent versus anachronistic-term-crediting
  observation seedling Tier 1 2026-07-27 · historiography, prolepsis, quentin-skinner, myth-ledger, whig-history
• Does Skinner's 'mythology of prolepsis' (1969) name the error side of the vault's back-projection misattributions?
  capture promoted 2026-07-20 · historiography, quentin-skinner, prolepsis, anachronism, whig-history
• No source establishes a citation link between Wiener's cybernetics and the Kelley/Bryson/Pontryagin/Bellman optimal-control lineage behind backpropagation
  claim seedling Tier 1 2026-07-15 · cyber-physical-systems, cybernetics, wiener, control-theory, backpropagation-origins
• The Amari-myth / Faggin-consciousness bridge is superficial as a direct edge — the real connective tissue runs through Ted Hoff and the SGD learning-rule family
  capture promoted Tier 4 2026-07-11 · amari, faggin, ted-hoff, widrow, lms
• Amari's 1967 stochastic descent and the 1960 Widrow–Hoff LMS rule are sibling members of the SGD family, about seven years apart
  claim budding Tier 4 2026-07-11 · amari, widrow, hoff, lms, sgd
• Bell Labs classical control theory (Nyquist, Bode) may be the direct mathematical ancestor of the 1950s–60s optimal-control lineage the vault credits as backpropagation's precursor — but no source read so far states the transmission explicitly
  observation seedling Tier 2 2026-07-11 · control-theory, nyquist, bode, optimal-control, kelley
• Is there a documented transmission line from Bell Labs classical control theory (Nyquist 1932, Bode) into 1950s–60s optimal control theory (Pontryagin, Bellman, Kelley, Bryson) — or only a periodization coincidence?
  question answered 2026-07-11 · control-theory, nyquist, bode, optimal-control, kelley
• Black's 1927 feedback-amplifier 'ferry epiphany' is a documented myth of origin — Nyquist/Bode's rescue math is the classical-control root upstream of the vault's Kelley-Bryson backprop precursor
  capture promoted Tier 2 2026-07-09 · history-of-technology, bell-labs, control-theory, feedback, backpropagation-origins
• Who first used the term "structural credit assignment," and in what context?
  capture promoted 2026-07-09 · credit-assignment, structural-credit-assignment, terminology, history-of-ml, reinforcement-learning