---
id: "20260913-0200-what-genuinely-connects-entity"
title: "What genuinely connects Hinton's 2007→2022 reversal on backprop-in-the-brain and the 1986 Nature paper's 'demonstration, not invention' contribution?"
type: "capture"
status: "seedling"
origin: "batch"
writer_model: "claude-sonnet-5"
date_created: "2026-09-13T00:00:00.000Z"
provenance: "Batch capture, 2026-09-13; direct extract_pdf reads of Hinton's 2007 'How to do backpropagation in a brain' talk and the 2022 Forward-Forward paper (arXiv:2212.13345), cross-checked against existing vault claims (bridge-check per proposal-seek-2026-w36 topic assignment, cosine 0.87 between claim-hinton-backprop-in-brain-2007-to-2022-arc and claim-rhw-1986-demonstration-not-invention)"
derived_from: ["claim-hinton-backprop-in-brain-2007-to-2022-arc","claim-rhw-1986-demonstration-not-invention","claim-brain-approximates-backprop-core-principles-ngrad","claim-hinton-biological-implausibility-four-objections","observation-rhw-1986-werbos-docsub-cosine-bridge-is-thematic-not-causal"]
tags: ["hinton","backpropagation","biological-plausibility","forward-forward","history-of-ml","cosine-bridge","epistemics","rumelhart"]
source_primary_url: "https://arxiv.org/pdf/2212.13345"
source_primary_title: "The Forward-Forward Algorithm: Some Preliminary Investigations"
source_primary_author: "Geoffrey Hinton"
source_primary_date: "2022-12-27"
source_primary_venue: "arXiv preprint 2212.13345 (also Google Brain)"
source_primary_tier: 1
source_primary_sha: "059f700a44f78227bfd8f6219b5460484502985808ff1e23874be4f53b468e4f"
source_secondary_url: "https://www.cs.toronto.edu/~hinton/backpropincortex2007.pdf"
source_secondary_title: "How to do backpropagation in a brain"
source_secondary_author: "Geoffrey Hinton"
source_secondary_date: "2007"
source_secondary_venue: "NIPS 2007 Deep Learning Workshop (slide deck, author-hosted, cs.toronto.edu)"
source_secondary_tier: 1
source_secondary_sha: "5386678c8da76cc5dffda04a611d5a79974a6793826d73d65262f0afa5e9facf"
seek_code_commit: "546fa57"
---


**Topic question:** the vault holds [[claim-hinton-backprop-in-brain-2007-to-2022-arc]] (Hinton's 2007 rescue → 2022 abandonment of backprop as a cortical model) and [[claim-rhw-1986-demonstration-not-invention]] ([[entity-backpropagation|backpropagation]]'s 1986 Nature paper contributed a demonstration of representation-learning, not the algorithm itself) at cosine 0.87, unlinked. Is there a real bridge, or is the resemblance driven by shared vocabulary (Hinton, backpropagation, "not what people assume") rather than a shared causal or evidentiary chain?

**Resolution: the bridge does not hold as a causal or evidentiary link.** Both primary Hinton texts were fetched directly and read in full. Neither engages the other claim's subject matter: the 2007 talk carries no reference list at all and never mentions Rumelhart, Williams, or 1986; the 2022 paper cites "Rumelhart et al., 1986" exactly once, as generic shorthand for "backpropagation," not as a discussion of what that paper specifically contributed. The two claims answer different kinds of question — one about Hinton's shifting *belief* regarding cortical mechanism, the other about *historical credit* for a mathematical technique — and nothing in either primary source treats them as related. The 0.87 cosine is a second instance, in the same cluster, of a pattern the vault has already diagnosed once: [[observation-rhw-1986-werbos-docsub-cosine-bridge-is-thematic-not-causal]] found the identical failure shape (same narrator/field/decade driving similarity, no shared mechanism) for a different pair. No wikilink is added directly between the two seed notes as though they were causally connected; they already sit two hops apart via [[claim-hinton-biological-implausibility-four-objections]] and [[moc-backpropagation-origins]], which is the honest distance.

---

## Claim: Neither Hinton primary text connects the two subjects — verified by direct, complete reads

**Claim type:** historical/documentary (an absence-claim about primary-source content). **Tier 1** — both texts fetched via `extract_pdf` and read to their last page.

The 2007 slide deck ("How to do backpropagation in a brain," 16 pages, Hinton's own site) has no bibliography or reference list of any kind; it ends with a technical derivation slide and a housekeeping note about a shuttle bus ("THE END / And if you reserved a place on a bus to whistler..."). It never mentions Rumelhart, Williams, or the year 1986. Its stated objections to backpropagation are three specific engineering problems — the need for labeled data, poor scaling of learning time across many hidden layers, and the requirement that a neuron carry "two different types of signal" — none of which engage the question of what the 1986 paper added relative to earlier derivations of the algorithm.

The 2022 Forward-Forward paper (arXiv:2212.13345) cites "Rumelhart et al., 1986" exactly once, in its opening paragraph:

> "The gradients are usually computed using backpropagation (Rumelhart et al., 1986), and this has led to a lot of interest in whether the brain implements backpropagation or whether it has some other way of getting the gradients needed to adjust the weights on connections."

*(quote_check confirmed verbatim against the extracted PDF text, sha256 059f700a44f78227bfd8f6219b5460484502985808ff1e23874be4f53b468e4f)*

This is the paper's only use of the citation. It treats "Rumelhart et al., 1986" as synonymous with the term "backpropagation" itself — standard field shorthand — and does not discuss the paper's content, its demonstrations, or its place relative to earlier derivations (Werbos, Linnainmaa) anywhere in the text.

---

## Claim: The 2022 citation is a live instance of the very "demonstration becomes memory anchor" pattern the 1986 claim describes — but as unreflective field convention, not a deliberate link

**Claim type:** historical/definitional (how a term is conventionally cited in the field). **Tier 3-4 acceptable** for this framing claim since it is uncontested field practice; the underlying quote grounding it is Tier 1 (same passage as above).

[[claim-rhw-1986-demonstration-not-invention]] observes that the 1986 paper became "the field's memory anchor" for the term "backpropagation" despite not inventing the algorithm, because of its demonstrated representation-learning results. Hinton's own 2022 citation practice — "backpropagation (Rumelhart et al., 1986)," offered with no further gloss — is a small, dated data point of exactly that anchoring effect, thirty-six years later, from one of the 1986 paper's own three co-authors. This is worth naming precisely because it could be mistaken for evidence of a deliberate connection between the two claims; it is not. It is Hinton doing what the entire field does when citing the term, in a paper about an unrelated question (whether cortex implements gradient-based credit assignment at all). The citation is boilerplate, not commentary.

---

## Claim: The vault's own prior analysis already treats these two notes as different motions within the same cluster

**Claim type:** historical/documentary (what an existing vault note asserts about itself). **Tier 1** for what the note says (it is being quoted directly, not re-derived).

[[claim-hinton-backprop-in-brain-2007-to-2022-arc]] carries its own commentary distinguishing itself from exactly the cluster that includes the 1986 demonstration claim:

> "Set this against the cluster next door: the priority myths are all about credit flowing *toward* a name (Werbos, Amari getting more than they claimed). This note is the rare opposite motion — a scientist arguing himself *out* of a position he once defended..."

This is internal evidence, written before this bridge-check was commissioned, that the note's own author already read the two claims as sitting in adjacent-but-distinct categories: one about credit-attribution for an algorithm (the "cluster next door"), the other about a single scientist's revised belief about neuroscience. The 0.87 cosine score is tracking shared surface vocabulary (Hinton, backpropagation, correcting a popular oversimplification) across that boundary, not a causal seam in it.

---

## Claim: One candidate substantive thread exists but is not source-confirmed — flagged, not asserted

**Claim type:** technical-mechanism / synthesis — **does not clear the Tier 1-2 floor as stated**, so it is recorded as `[unverified-synthesis]`, not as a claim.

The vault's existing note on Hinton's "mature position" ([[claim-brain-approximates-backprop-core-principles-ngrad]], sourced to Lillicrap et al. 2020, Tier 1) records that the case *for* believing cortex approximates backprop rests on a demonstrated-efficacy argument: "evolution would favor circuits that get 'as close as possible' to computing gradients, because gradient-following works so well in artificial nets" — an argument from backprop's empirical track record, not from direct neuroscientific observation. The 1986 paper is one origin point of that empirical track record (it is credited, per [[claim-rhw-1986-demonstration-not-invention]], with first demonstrating that the algorithm learns useful internal representations at all). It is tempting to read a through-line: 1986 demonstrates the technique works → the technique's success becomes, decades later, the reason to bet cortex approximates it → Hinton runs that bet from 2007 to 2022 and abandons it. No primary source draws this line explicitly — neither the 1986 paper, the 2007 talk, the 2020 NGRAD paper, nor the 2022 Forward-Forward paper states that 1986's representation-learning demonstration specifically is what underwrites the "gradient-following works so well" premise. This is this capture's own connective reading across three already-sourced vault claims, and per the sourcing floor for technical-mechanism claims it is recorded here as a lead, `[unverified-synthesis — no primary source states the connection]`, not written as a claim-note.

---

## Further leads

- Ronald J. Williams, the third RHW 1986 co-author, has no vault entity page while [[entity-david-rumelhart|Rumelhart]] and [[entity-geoffrey-hinton|Hinton]] both do — a gap worth closing given how central the paper is to this cluster.
- Timothy Lillicrap (lead author, Lillicrap et al. 2020 NGRAD paper) has no vault entity page; he is the actual bridge figure between Hinton's 2007 rescue attempt and the 2022 abandonment, cited in both directions inside [[claim-brain-approximates-backprop-core-principles-ngrad]] and [[claim-hinton-backprop-in-brain-2007-to-2022-arc]].
- Whether Lillicrap et al. 2020 itself ever frames "gradient-following works so well in artificial nets" with a citation back to the 1986 Nature paper specifically (rather than to deep learning's success generally) is unchecked this session — the primary PDF (https://www.cs.toronto.edu/~hinton/absps/backpropandbrain.pdf) was not re-read here; this would directly test the `[unverified-synthesis]` claim above.
- The 2007 talk's closing "bus to Whistler" line (internal textual evidence the workshop was co-located with NIPS 2007's Vancouver-area venue) is an unrelated dating curiosity already flagged in the earlier 20260706-1443 capture; not re-verified here.

---

## Entity candidates

- Ronald J. Williams — person — third co-author of the 1986 RHW Nature paper; the most-cited-but-least-individually-documented figure in this whole cluster, and the clearest instance of the "foundational co-author with no page" gap.
- Timothy Lillicrap — person — lead author of the 2020 "Backpropagation and the brain" paper that is Hinton's most careful published statement on cortical plausibility (NGRAD); sits at the literal midpoint of the 2007→2022 arc and is cited by name in both endpoints.
- Forward-Forward algorithm (arXiv:2212.13345) — concept — already covered via [[claim-hinton-forward-forward-boltzmann-lineage]]; flagging only to note the paper itself might eventually warrant a standalone entity/concept page separate from the claim notes about it, given how many other notes now point at it.

> [!note] Seek's commentary:
> The honest finding here is smaller than the topic question hoped for, and that's fine — it's the same lesson the DOCSUB pairing already taught once. High cosine between two well-sourced notes about the same person and the same technology is exactly what a retrieval index is built to surface, and exactly what it cannot tell apart from actual causation: "same narrator, same field, same rhetorical move (correcting a popular oversimplification)" reads as similarity whether or not the underlying facts touch. What's mildly interesting is *where* the two claims' author already knew this — the arc note's own commentary calls itself "the rare opposite motion" against the priority-crediting cluster, which is the note pre-emptively telling a future bridge-check not to force the connection. Worth noticing, for calibration, that the strongest signal against a tempting bridge sometimes already lives in the margin of one of the two notes being bridged.
> — Seek