---
id: "20260709-0200-who-first-used-the"
title: "Who first used the term \"structural credit assignment,\" and in what context?"
type: "capture"
status: "promoted"
promoted_to: ["30-notes/myth-structural-credit-assignment-from-minsky-1961.md"]
not_promoted: ["Claim 1 (Sutton 1984 introduced the temporal/structural distinction) — [unverified], dissertation PDF exceeds the 25MB extract cap + site TLS error; routed to [[question-verify-sutton-1984-structural-credit-assignment]].","Claim 3 (temporal/structural dichotomy standardized by 2004, Agogino & Tumer AAMAS) — folded into the myth note as a Tier-1 receipt rather than a standalone note (it dates the vocabulary, not the coinage)."]
promotion_note: "Promoted 2026-07-09 (Fable clean-lane marathon). Core question stays [unverified] (term coinage unpinned), but the capture's strongest finding — the PLOS-2024 retrospective relabel of Minsky-1961 as 'structural' — became a myth-ledger entry (Q5), joining the vault's existing 'spatial credit assignment (Werbos 1974)' relabel pattern."
origin: "batch"
model: "claude-sonnet-5"
date_created: "2026-07-09T00:00:00.000Z"
provenance: "batch web-research run, 2026-07-09"
derived_from: []
tags: ["credit-assignment","structural-credit-assignment","terminology","history-of-ml","reinforcement-learning","sutton","minsky","backpropagation-origins"]
source_urls: ["https://pmc.ncbi.nlm.nih.gov/articles/PMC11175464/","https://ntrs.nasa.gov/citations/20040068179","https://en.wikipedia.org/wiki/Richard_S._Sutton","https://web.mit.edu/dxh/www/marvin/web.media.mit.edu/~minsky/papers/steps.html"]
source_authors: ["Franz Wurm, Benjamin Ernst, Marco Steinhauser (PLOS Computational Biology, 2024)","Adrian K. Agogino, Kagan Tumer (NASA Ames Research Center; AAMAS 2004)","Wikipedia contributors, 'Richard S. Sutton'","Marvin Minsky, 'Steps Toward Artificial Intelligence' (1961) — via existing vault note [[claim-minsky-1961-named-credit-assignment]]"]
source_dates: ["2024-05-28","2004-07-19 (AAMAS conference)","accessed 2026-07-09","1961"]
source_tiers: ["Tier 1 — peer-reviewed journal article, own text quoted directly","Tier 1-2 — peer-reviewed conference paper, hosted on NASA's own technical report server, own text quoted directly","Tier 3-4 — Wikipedia, used only for an uncontested bibliographic fact (dissertation title/university/advisor), per sources.md's carve-out for definitional/uncontested-historical claims","Tier 1 — already verified in the vault at capture level against the MIT-hosted full primary text"]
---


**Topic question:** Who first used the term "structural credit assignment" in the literature, and in what context?

**Core question status: `[unverified — could not confirm or deny after search]`.** No source was found this session — primary or secondary — that pins down a single first documented use of the literal phrase "structural credit assignment" with a dated, quotable passage. The strongest lead (Richard Sutton's 1984 PhD dissertation, widely paraphrased in tertiary literature as introducing the temporal/structural distinction) could not be directly verified: the dissertation PDF hosted on Sutton's own site exceeded this session's PDF-extraction size cap (111MB against a 26MB limit), the site itself (`incompleteideas.net`) returned a TLS/certificate error on every fetch attempt (blocking both the dissertation and Sutton's own later talk materials), and no working PDF-to-text tool was available in this environment to read a locally-cached copy either. What follows is what *could* be established: the term's earliest confirmed peer-reviewed appearances, the field's inconsistent citation practice around its own history, and a clearly flagged gap where the actual coinage should be.

---

## Claim: The dominant tertiary characterization credits Richard Sutton's 1984 PhD dissertation with introducing the temporal/structural credit-assignment distinction, but this could not be verified against the primary text this session

**Claim type:** Historical/attributional. Because this is the load-bearing point of the entire capture (the literal answer to "who first used the term"), the sourcing floor requires Tier 1–2 — a claim this surprising/central cannot rest on Tier 3–4 alone.

Multiple independent web searches returned a consistent paraphrase, structured as a definition with an inline citation: temporal credit assignment is "the assignment of credit for outcomes to actions," while structural credit assignment is "the assignment of credit for actions to internal decisions... (Sutton, 1984)." This phrasing recurred across several unrelated search queries, which suggests it reflects real, settled field consensus rather than a one-off error — but every instance found was a WebSearch-engine synthesis paraphrase, not a named author's sentence with a locatable page or quote. That is a Tier 4 pattern (aggregator restating a claim), not a citable source for the attribution itself.

What is independently confirmed, at Tier 3–4 (acceptable here only for the plain bibliographic fact, not for the "structural" attribution): Sutton's dissertation, titled *"Temporal credit assignment in reinforcement learning,"* was completed in January 1984 at the University of Massachusetts Amherst under advisor Andrew Barto. Per Wikipedia: "His doctoral dissertation introduced actor-critic architectures and temporal credit assignment." Note that even this description names only *temporal* credit assignment — not "structural" — so it does not on its own confirm the word "structural" appears in the 1984 text at all.

**Sourcing floor check:** `[unverified-historical — needs primary]`. The dissertation itself (the only source that could settle this) was not readable this session:
- `http://incompleteideas.net/papers/Sutton-PhD-thesis.pdf` resolved as a real file (confirmed by a Content-Length response) but at 111,689,684 bytes exceeded the extraction tool's 26,214,400-byte cap.
- The extraction tool also failed on every other PDF attempted this session with `[Errno 2] No such file or directory: 'pdfinfo'` — a missing dependency in this environment, not a property of any specific source — so no PDF could be read to full text this session regardless of size.
- Direct WebFetch requests to `incompleteideas.net` (both `http://` and `https://`) failed with a self-signed-certificate error on every attempt, blocking an alternative route via Sutton's own publications/talks pages.

| Field | Value |
|---|---|
| source_url | https://en.wikipedia.org/wiki/Richard_S._Sutton |
| source_author | Wikipedia contributors |
| source_date | accessed 2026-07-09 |
| source_tier | 3-4 (acceptable only for the uncontested bibliographic fact: title, university, year, advisor) |
| exact_quote | "PhD (1984) in computer science from the University of Massachusetts Amherst supervised by Andrew Barto." / "His doctoral dissertation introduced actor-critic architectures and temporal credit assignment." |

---

## Claim: A 2024 peer-reviewed paper attributes "the structural credit assignment problem" directly to Minsky (1961) — which conflicts with the vault's own verified reading of Minsky's actual wording

**Claim type:** Historical / citation-practice. This is directly quotable at Tier 1, so it clears the floor cleanly — though what it establishes is narrower than "who coined the term": it shows how the term is *currently cited*, not who *first used* it.

Wurm, Ernst & Steinhauser, "Surprise-minimization as a solution to the structural credit assignment problem" (*PLOS Computational Biology*, 2024-05-28), write: "The structural credit assignment problem arises when the causal structure between actions and subsequent outcomes is hidden from direct observation." This sentence cites reference [4], which the paper's own reference list gives as: "Minsky M. Steps toward artificial intelligence. Proc IRE. 1961;49: 8–30."

This is notable set against [[claim-minsky-1961-named-credit-assignment]], already in the vault and independently verified against the MIT-hosted full primary text: Minsky's actual 1961 language is "If the run is successful, how can we assign credit for the success among the multitude of decisions?" — a **temporal**, sequential-decision framing, with no use of the word "structural" as a qualifier anywhere in that section. The 2024 paper's citation therefore appears to be a retrospective relabeling — attaching "structural" to Minsky's 1961 problem statement after the fact — the same pattern the vault's Werbos-1974 note ([[claim-werbos-1974-no-credit-assignment-language]]) documents for "spatial credit assignment (Werbos 1974)." It is evidence that **current literature is not internally consistent about where the "structural" qualifier comes from**, which is itself a finding relevant to the topic question, even though it does not resolve who coined the literal phrase.

| Field | Value |
|---|---|
| source_url | https://pmc.ncbi.nlm.nih.gov/articles/PMC11175464/ |
| source_author | Franz Wurm, Benjamin Ernst, Marco Steinhauser |
| source_date | 2024-05-28 |
| source_venue | PLOS Computational Biology, DOI 10.1371/journal.pcbi.1012175 |
| source_tier | 1 |
| exact_quote | "The structural credit assignment problem arises when the causal structure between actions and subsequent outcomes is hidden from direct observation." (citing "Minsky M. Steps toward artificial intelligence. Proc IRE. 1961;49: 8–30." as reference [4]) |

---

## Claim: The explicit temporal-vs-structural credit-assignment dichotomy, using both terms side by side, is confirmed as established field vocabulary in peer-reviewed literature by 2004

**Claim type:** Definitional (Tier 3-4 would be acceptable for this alone, but a Tier 1-2 source was directly obtained and quoted, so it is recorded at that strength).

Agogino & Tumer, "Unifying Temporal and Structural Credit Assignment Problems" (AAMAS 2004, NASA Ames Research Center), state directly: "Multi-agent systems have the structural credit assignment problem of determining the contributions of a particular agent to a common task," framed as the structural counterpart to the single-agent "temporal credit assignment problem of determining the contribution of a particular action to the quality of the full sequence of actions." This confirms the paired terminology was standardized, citable field vocabulary — with a dedicated paper title using both terms as an established dichotomy — no later than 2004. It is an anchor point for when the term was clearly in general use, though it is explicitly not a claim that this paper originated the term (the paper's own framing treats the distinction as already familiar to its audience).

| Field | Value |
|---|---|
| source_url | https://ntrs.nasa.gov/citations/20040068179 |
| source_author | Adrian K. Agogino, Kagan Tumer |
| source_date | 2004-07-19 (AAMAS conference, New York) |
| source_tier | 1-2 |
| exact_quote | "Multi-agent systems have the structural credit assignment problem of determining the contributions of a particular agent to a common task." |

---

> [!note] Seek's commentary:
> The honest shape of this capture is a gap, not an answer. The recurring "temporal vs. structural (Sutton, 1984)" framing shows up so consistently across independent searches that it's almost certainly correct as field lore — but "almost certainly correct as field lore" is exactly the epistemic state the sourcing floor exists to catch before it hardens into a clean-looking claim-note. The blocker this session was mechanical, not evidential: no working PDF text extraction (missing `pdfinfo`/`pdftotext` locally, and the extraction tool's size cap on the one primary document that could settle this), plus a TLS certificate error that blocked Sutton's own site outright. A follow-up with working PDF tooling — or simply a researcher with a browser who can open `incompleteideas.net/papers/Sutton-PhD-thesis.pdf` and search it for "structural" — would likely close this in one pass. Until then, the Minsky-misattribution finding (Claim 2) is arguably the more interesting result: it's evidence that even peer-reviewed venues are sloppy about this specific piece of etymology, retroactively bolting "structural" onto a 1961 text that never uses the word.

## Further leads

- Sutton's 1984 PhD dissertation full text, `http://incompleteideas.net/papers/Sutton-PhD-thesis.pdf` — confirmed to exist (111MB) but unread this session; would directly settle whether "structural credit assignment" appears in Sutton's own 1984 words.
- Richard Sutton's August 2023 talk, "Are You Ready to Embrace Structural Credit Assignment?" (per WebSearch paraphrase only, page at `incompleteideas.net/Talks/Talks.html` — could not be fetched this session due to a certificate error, so its actual wording is `[unsourced — needs verification]`).
- Schmidhuber's 1990 TU Munich dissertation coinage of "the fundamental spatio-temporal credit assignment problem" (already captured in [[claim-werbos-1974-no-credit-assignment-language]]) — a possibly-adjacent but distinct lineage for "structural"/"spatial" vocabulary, worth checking against Schmidhuber's own later English-language usage.
- A. G. Barto, "Learning by statistical cooperation of self-interested neuron-like computing elements," *Human Neurobiology* 4(4), 1985 — surfaces repeatedly in citation chains for structural credit assignment in connectionist networks; not checked directly this session for terminology or dating.
- The PLOS Computational Biology paper's reference list may cite additional sources for "structural credit assignment" beyond reference [4] (Minsky); only that one citation was checked this session.
- [[moc-backpropagation-origins]] and [[claim-rhw-1986-demonstration-not-invention]] — the "structural" sense of credit assignment (distributing error across network weights) is what backpropagation solves; that mechanism claim is already covered there and not re-litigated here.