MOC: Backpropagation's origins — priority, paternity, and myth

The vault's deepest cluster: how the algorithm that trains every modern model was derived repeatedly, in different fields, by people who mostly didn't know about each other — and how the folk history compressed that into single-inventor stories. The spine claim: backpropagation-gap.

The Linnainmaa thread (numerical analysis, 1970)

• claim-linnainmaa-thesis-identity — what the thesis was, where, in what language
• claim-linnainmaa-rounding-error-problem — the actual problem it solved
• claim-linnainmaa-reverse-mode-single-pass — the mechanism (Tier-1 verified via Griewank 2014 and now 2012)
• claim-linnainmaa-1976-algorithm-t-reverse-sweep — the 1976 primary itself, read page-by-page: Algorithm T's reverse-order accumulation in Linnainmaa's own words (+ venue correction: BIT 16, not Annales)
• claim-linnainmaa-field-numerical-analysis — why it was invisible to AI
• claim-linnainmaa-priority-not-paternity — the reception structure (see its 2026-07-06 revisit note: "priority" itself is now complicated by Griewank's multiple-discovery account)
• claim-linnainmaa-copenhagen-anecdote — the origin story, source-critically handled
• claim-speelpenning-1980-does-not-cite-linnainmaa — the canonical early AD implementation didn't cite him either: the walls run even inside AD (OSTI primary, direct OCR)
• claim-werbos-1974-does-not-cite-linnainmaa — nor did the 1974 thesis (exhaustive full read): independent derivation, and the "Section 5.5.1" locator doesn't exist in the 1974 text
• claim-linnainmaa-1976-citation-histogram — the reception, finally in numbers: 51 dated citations across three decades, then 245 since 2010 (myth moved unresolved → contested)

The lineages before and after

• claim-kelley-bryson-optimal-control-precursor — the optimal-control thread (dense Jacobians, no sparsity)
• claim-nyquist-bode-classical-control-to-optimal-control-bridge — one generation further upstream: does Bell Labs classical control theory (Nyquist 1932, Bode) feed the Kelley/Bryson optimal-control lineage, or is the periodization a coincidence? Flagged [unverified-mechanism/synthesis], routed at question-verify-nyquist-bode-optimal-control-transmission-line. Grounded in claim-black-1927-ferry-epiphany-retrospective-simplification and claim-nyquist-bode-supplied-stability-math-black-lacked, a separate myth-of-origin thread about Harold Black's feedback amplifier that lives outside this cluster proper.
• claim-cps-wiener-lineage-no-link-to-backprop-optimal-control — a second, independent doorway into the same locked room: does Norbert Wiener's cybernetics (the term's other claimed common root, via cyber-physical systems' 2006 coinage — see claim-cyber-physical-systems-cybernetics-common-root-not-derivation) bridge to Kelley/Bryson/Pontryagin/Bellman? No source found either way; recorded as a documented absence, [unverified-mechanism].
• claim-minsky-1961-named-credit-assignment — the term, coined temporal; structural came later
• claim-perceptrons-multilayer-sterile-was-conjecture — the 1969 book proved single-layer limits; the multilayer "sterile" line was a self-flagged intuitive judgment inviting rejection
• claim-dreyfus-1988-connectionism-was-vindicated-not-target — the philosophy-of-AI bridge: the Dreyfuses' 1988 Daedalus paper casts Rosenblatt's connectionism as vindicated by their critique, resolving Stuart Dreyfus's "double role"
• claim-dreyfus-critique-targeted-symbolic-ai-not-neural-nets — the same paper's two-research-programs framing: the critique targets Newell & Simon's physical symbol system hypothesis, not the Hebb–Rosenblatt learning line
• claim-simon-1983-dismissed-perceptron-research-citing-rosenblatt — Simon's own 1983 verdict, by name: perceptron-style learning "didn't get anywhere," on empirical-productivity grounds, never engaging Minsky & Papert's formal conjecture
• claim-simon-vera-1993-1995-connectionist-nets-are-symbol-systems — Simon's later move: rather than concede connectionism as a rival paradigm, redefine "symbol" broadly enough to absorb it (1993, 1995)
• observation-simon-responds-to-connectionism-by-absorption-not-refutation — names the pattern across both: absorption, a third mode alongside confident conjecture and Dreyfus's program-splitting
• claim-perceptrons-credit-assignment-only-in-1988-epilogue — the phrase "credit-assignment" is 1988-Epilogue vocabulary, not 1969
• claim-bottou-2017-foreword-perceptrons-chapters-0-13-are-1969 — Bottou's 2017 foreword fixes the 1969/1988 boundary: chapters 0–13 are the first edition; Prologue + Epilogue are 1988 additions
• claim-pollack-1989-credit-assignment-in-1988-prologue — Pollack's 1989 review places the credit/blame argument in the 1988 Prologue (p. xiii); refines the "only in the Epilogue" location
• claim-pollack-1989-sterile-quote-page-231 — Pollack independently quotes the "sterile" passage, at p. 231 (a Tier-2 carrier; p. 231 vs p. 232 discrepancy flagged)
• claim-perceptrons-1969-standalone-scan-not-freely-available — the diffable object doesn't exist on the open web: repositories hold only the 1988 edition
• claim-werbos-1974-no-credit-assignment-language — the thesis never says "credit assignment" (grep ×0 over 453 pp.); the "spatial credit assignment" label is retrospective, earliest compound landmark Schmidhuber's own 1990 dissertation title
• claim-bryson-ho-1969-curriculum-vector — how the adjoint method actually traveled: Harvard/MIT/AIAA courses → the 1969 textbook (Bryson's own account)
• claim-mccarthy-1973-control-theory-little-relevance-to-ai — the wall named from the AI side: McCarthy's own 1973 rebuttal to Lighthill dismissed control theory as having "little relevance to AI," the field where the adjoint/gradient ancestor of backprop already lived
• claim-dreyfus-1973-lineage-link-uncorroborated — Schmidhuber's 1973 link vs Dreyfus's own retrospectives, which credit 1962 and never cite 1973
• claim-recht-adjoints-equivalence-not-transmission — the modern control-side statement: mathematical equivalence via Lagrangian duality, explicitly not a transmission story (and no Kelley)
• claim-lecun-1989-first-practical-recognition — where the algorithm met the mail (NETtalk boundary stated)
• claim-vanishing-gradient-chain-rule-pathology — the failure mode inside the backward pass
• claim-werbos-2011-cathexis-derivative-mapping — the Freud mapping in Werbos's own 2011 words
• claim-werbos-tsp-manual-first-publication — Werbos's claim that the first publication was an MIT statistics manual: citation real, document unlocatable, single-witness
• claim-werbos-1978-docsub-blocked — DARPA kept the full report out of DOCSUB; the '78 journal version shipped without the how-to appendix (two parallel reasons, on the record)
• claim-backprop-special-case-kelley-bryson-formula — Dreyfus's own formal identity claim (in flagged tension with the precursor framing)
• claim-hinton-biological-implausibility-four-objections — what "biologically implausible" actually asserts
• claim-fukushima-1979-neocognitron-first-cnn — the CNN's architectural ancestor (not backprop-trained)
• claim-parker-1985-technical-report-not-cited — the fourth uncited independent rediscoverer
• claim-ivakhnenko-gmdh-first-deep-characterization — "first deep learning, 1965": Schmidhuber's hedged characterization, regression-grown layers, eight-layer figure unverified
• claim-werbos-ieee-awards-1995-2022 — the awards are real (IEEE primaries); the 2022 citation language is itself myth-ledger circulation
• claim-amari-1972-associative-memory-precedes-hopfield — priority-without-citation, the cluster's recurring pattern
• claim-robbins-monro-1951-stochastic-approximation — the 1951 statistical ancestor of SGD, finally quoted from its own text (root-finding, not optimization)
• claim-amari-1968-saito-experiment-primary-read — the 1968 Kyoritsu pages read in Japanese: Saito's 1967 experiment is real and stochastic-descent-trained; the "five-layer MLP" framing is not the book's

The 1986 watershed

• claim-rhw-1986-reference-list-four-works — four references, none of the earlier derivations
• claim-rhw-1986-demonstration-not-invention — what the paper actually added (verified demos, verbatim symmetry-breaking)

The mechanism and the multiplicity

• claim-backpropagation-special-case-of-reverse-mode-ad — the precise correspondence (Baydin, JMLR)
• claim-jvp-vjp-transpose-duality — forward and reverse mode as one Jacobian in dual directions (pushforward/pullback; the cost duality follows from shape)
• claim-wengert-list-named-for-forward-mode-inventor — the tape's name honors the forward-mode inventor; automatic reverse mode is Speelpenning 1980
• claim-autograd-three-reifications-of-the-tape — PyTorch records a DAG, TensorFlow records a literal tape, JAX compiles a jaxpr and never says "tape"
• claim-cheap-gradient-bound-two-figures — why it's affordable: the gradient costs a small constant multiple of one forward evaluation ("one to four times" / "5×", reconciled)
• claim-reverse-mode-multiple-independent-discovery — at least five discoveries, five fields, 1965–1986 (Griewank 2012, direct read)
• claim-ml-and-ad-communities-mutually-unaware — why the field rediscovered it five times: two literatures that didn't read each other (Baydin 2018, Tier 1) — the structural root of the whole attribution gap
• claim-werbos-backprop-from-freud-own-account — the Freud thread, finally in Werbos's own words
• claim-werbos-1968-cybernetica-earliest-germ — the earliest germ: a real 1968 paper whose Freud→DP content survives only as Werbos's own paraphrase (no readable copy exists)
• claim-werbos-1997-optimization-consciousness-chapter — the mind/consciousness face of the same optimization architecture (1997, not 1996; not his fullest statement)

The bridge to the economics cluster

• claim-training-inference-compute-asymmetry-mechanism — the backward pass is the cost only training pays

The bridge to the schema-change cluster (the author is the hinge)

• observation-rumelhart-person-bridge-schema-theory-to-backprop — the "R" in RHW 1986 (claim-rhw-1986-demonstration-not-invention) is the same David Rumelhart who coined the 1978 tuning/restructuring taxonomy under moc-schema-change-and-restructuring. One trajectory from cognitive-psychology schema theory to the connectionist revival; a person-bridge no note had named. seedling.

Biological plausibility and the alternatives

• claim-crick-1989-antidromic-not-weight-transport — the objection, correctly attributed
• claim-feedback-alignment-random-weights-train — random feedback weights (contested)
• claim-hinton-forward-forward-boltzmann-lineage — two forward passes, no backward
• claim-update-locking-backprop-constraint — the systems-level cost of the backward pass
• claim-brain-approximates-backprop-core-principles-ngrad — Hinton's mature position (Lillicrap 2020): the brain implements backprop's core principles via NGRAD, not strict backprop
• claim-hinton-backprop-in-brain-2007-to-2022-arc — the fifteen-year reversal: 2007 rescued backprop-in-the-brain, 2022 Forward-Forward abandoned it

The myth ledger (circulation vs. primary support)

• myth-werbos-invented-backpropagation — contested
• myth-linnainmaa-uncited-before-2010s — unresolved
• myth-amari-first-sgd-mlp — contested (single witness + citogenesis)
• myth-perceptrons-book-killed-connectionism — contested (proof-vs-conjecture collapse; causation genuinely multi-sided)
• claim-wikipedia-amari-sgd-citogenesis — how the amari myth's "corroboration" collapses to one witness: shared typo + shared misspelling
• claim-griewank-2012-does-not-mention-amari — confirmed negative: the reverse-mode history and the Amari-SGD claim never intersect at the primary level

Open verification threads

• question-verify-nyquist-bode-optimal-control-transmission-line — 2026-07-11: does Kelley 1960 (primary already read for claim-kelley-bryson-optimal-control-precursor) or Bryson's unread 1961 paper cite Nyquist/Bode/classical control theory by name? Cheapest open check in the cluster right now.
• question-verify-linnainmaa-citation-count — CLOSED 2026-07-07 into _answered; the pull happened and moved the myth (claim-linnainmaa-1976-citation-histogram). Successor sharpener lives in myth-linnainmaa-uncited-before-2010s's watch flag (classify the 51 pre-2010 citations by community).
• Library-op candidates for Cali (documents no automated fetch can reach): Werbos 1994 reprint TOC (resolves the 5.5.1 locator anomaly), Dreyfus 1973 IEEE TAC full text, Bryson 1961 symposium proceedings, Talking Nets ch. 16 p. 376 (Hinton's symmetry objection), Ivakhnenko 1971.
• 2026-07-07 evening safelist CLEARED: all backlog captures feeding this cluster are promoted or explicitly held (Opus-lane holds excepted).