---
id: "20260702-1439-is-amaris-1972-associative"
title: "Is Amari's 1972 associative memory model mathematically equivalent to Hopfield's 1982 network, and what do the primary papers actually show?"
type: "capture"
status: "promoted"
date_promoted: "2026-07-06T00:00:00.000Z"
promoted_to: ["30-notes/claim-amari-1972-associative-memory-precedes-hopfield.md"]
not_promoted: ["'mathematically equivalent' strong wording — [unverified-mechanism] honored, held in capture","Schmidhuber-plagiarism / Grossberg-priority dispute — separate contested thread; capture context, not promoted"]
origin: "batch"
model: "claude-sonnet-5"
date_created: "2026-07-02T00:00:00.000Z"
provenance: "batch run 2026-07-02; web research via WebSearch + WebFetch; harvested from 2026-06-29-did-shunichi-amari-describe-a-form-of-gradient-descent-for-layered-networks-in-the-1960s"
derived_from: []
tags: ["amari","hopfield","hopfield-network","associative-memory","ising-model","hebbian-learning","history-of-ai","priority-dispute","nobel-prize-2024","schmidhuber","japan"]
source_sources_consulted: [{"url":"https://people.idsia.ch/~juergen/deep-learning-history.html","author":"Jürgen Schmidhuber","date":"retrieved 2026-07-02 (mirrors arXiv:2212.11279, periodically updated)","tier":"1 (arXiv version 2212.11279) / 2 (this HTML mirror)"},{"url":"https://theconversation.com/japanese-scientists-were-pioneers-of-ai-yet-theyre-being-written-out-of-its-history-243762","author":"Hansun Hsiung (Assistant Professor, Durham University)","date":"2024-11-27","tier":3},{"url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC346238/","author":"John J. Hopfield","date":"1982-04 (PNAS 79(8):2554-2558)","tier":1,"note":"Primary source — Hopfield's own 1982 paper, fetched directly; used to check its actual reference list for Amari citations."},{"url":"https://en.wikipedia.org/wiki/Hopfield_network","author":"Wikipedia contributors","date":"retrieved 2026-07-02","tier":3},{"url":"https://en.wikipedia.org/wiki/Shun%27ichi_Amari","author":"Wikipedia contributors","date":"retrieved 2026-07-02","tier":3},{"url":"https://sj.jst.go.jp/stories/2025/s0327-01p.html","author":"Science Japan / Japan Science and Technology Agency (interview with Shun'ichi Amari)","date":"2025-03-27","tier":2,"note":"Contains Amari's own words in interview form, quoted directly — treated as a strong secondary/primary-adjacent source for what Amari himself says about the citation history, though it is journalistic framing around the quotes, not a paper."},{"url":"https://www.learningfromexamples.com/p/the-great-hopfield-network-debate","author":"Harry Law","date":"2025-05-16","tier":4,"note":"Independent Substack blog; used only for the directly-quoted Grossberg statement, not for any Amari-specific technical claim."},{"url":"https://www.aipolicyperspectives.com/p/on-analogies","author":"Harry Law / AI Policy Perspectives","date":"retrieved 2026-07-02","tier":4,"note":"Cross-posted version of the same piece; corroborates but does not independently source the Grossberg quote."},{"url":"https://harvardtechnologyreview.com/2024/11/18/machine-learning-stirs-controversy-in-nobel-prize-in-physics/","author":"Nischal Tamang","date":"2024-11-18","tier":4,"note":"Secondary aggregation of Schmidhuber's claims; not an independent source, used only as corroboration."},{"url":"https://brainmind.umin.jp/PDF/wt14/Neural%20Networks.pdf","author":"Shun-ichi Amari","date":"2013 (Neural Networks 37:48-51)","tier":1,"note":"Amari's own retrospective, 'Dreaming of mathematical neuroscience for half a century.' Located and fetched but is an image/scan-layer PDF that could not be read as text in this session (see access_failures) — the apparent 'exactly the same as the so-called Hopfield model' phrasing attributed to this paper via search-result synthesis could NOT be independently verified by direct reading this session."},{"url":"https://neuron.eng.wayne.edu/tarek/MITbook/chap7/7_1.html","author":"Unclear — course-hosted textbook chapter mirror (associative memory models, appears to cite 'Amari, 1972a/1972b' and 'Hopfield, 1982' in academic citation format)","date":"retrieved 2026-07-02 (fetch blocked, see access_failures)","tier":"3-4 (unverified directly — could not fetch due to TLS certificate error)"},{"url":"https://dl.acm.org/doi/abs/10.1109/T-C.1972.223477","author":"ACM Digital Library (bibliographic record)","date":"retrieved 2026-07-02","tier":3,"note":"Bibliographic metadata for Amari (1972), 'Learning Patterns and Pattern Sequences by Self-Organizing Nets of Threshold Elements,' IEEE Trans. Computers C-21(11):1197-1206."}]
access_failures: ["https://www.sciencedirect.com/science/article/abs/pii/S0893608012002559 → 403 Forbidden (Amari's 2013 retrospective, paywalled abstract page)","https://dl.acm.org/doi/abs/10.1016/j.neunet.2012.09.014 → 403 Forbidden (same paper, ACM DL mirror)","https://pubmed.ncbi.nlm.nih.gov/23092761/ → fetched, but returns only a generic paraphrase abstract, no mention of Hopfield or 1972 in the retrievable text","https://brainmind.umin.jp/PDF/wt14/Neural%20Networks.pdf → fetched (370KB) but is an image-layer scan; no OCR tooling (poppler/pdftotext) available in this sandbox; curl/direct download also blocked by sandbox approval","https://r.jina.ai/... (proxy re-fetch attempt) → 401 Unauthorized","https://www.nobelprize.org/uploads/2024/09/advanced-physicsprize2024.pdf → 403 Forbidden (Nobel Committee's 'Scientific Background' document, wanted to check its own Amari citation)","https://www.nobelprize.org/uploads/2024/11/popular-physicsprize2024-3.pdf → 403 Forbidden (Nobel popular-science background document)","https://people.idsia.ch/~juergen/physics-nobel-2024-plagiarism.pdf → fetched (6MB) but is an image/JPEG-encoded scan, not extractable as text","https://arxiv.org/pdf/2412.18030 ('Moving boundaries: An appreciation of John Hopfield') → fetched but returned as unparseable binary/compressed stream","https://ieeexplore.ieee.org/document/1672070 (Amari's 1972 paper itself) → empty/blocked render, abstract not retrievable","http(s)://neuron.eng.wayne.edu/tarek/MITbook/chap7/7_1.html → TLS certificate validation error, could not fetch either protocol"]
---


**Short answer the claims below support:** Most likely yes, in substance, but the note's strongest and most precise wording of that claim — "mathematically equivalent" / "exactly the same" — could not be independently verified this session by reading Amari's own primary text. Multiple convergent secondary and tertiary sources (Schmidhuber's historiography, an academic-authored piece in The Conversation, Wikipedia, a 2025 interview with Amari himself) agree that Amari's 1972 IEEE paper proposed an adaptive (Hebbian-trained) version of the same Lenz-Ising recurrent architecture that Hopfield's 1982 PNAS paper is credited for, a decade earlier. What this research *did* directly verify from a primary source: Hopfield's actual 1982 paper does not cite Amari's 1972 paper in its reference list — it cites two later Amari papers, from 1977 and 1978. Amari himself, in a 2025 interview, independently corroborates exactly this: his associative-memory paper was not the one Hopfield cited; a later, different paper of his was. The single strongest form of the "mathematically equivalent" / "exactly the same" claim, apparently voiced by Amari in his own 2013 retrospective, rests on search-engine-indexed snippet text that could not be confirmed by directly reading the source document in this session (it is a scanned PDF with no OCR tooling available) — this is flagged below rather than recorded as verified.

---

## Claim: Amari's 1972 IEEE paper proposed an adaptive, Hebbian-learning version of the Lenz-Ising recurrent architecture for associative memory, independently and a decade before Hopfield's 1982 paper

**Claim type:** Technical-mechanism / historical (load-bearing — this is the substantive core of the equivalence claim).

Jürgen Schmidhuber's historical survey states directly: "In 1972, Shun-Ichi Amari made the Lenz-Ising recurrent architecture *adaptive* such that it could learn to associate input patterns with output patterns by changing its connection weights." The same source adds that "Amari (1972) also had a sequence-processing generalization thereof," and later states: "10 years later, the basic equations of the Amari network were republished (and its storage capacity analyzed). Some called it the Hopfield Network (!) or Amari-Hopfield Network. It does not process sequences but settles into an equilibrium in response to static input patterns."

Wikipedia's [[Hopfield network]] article independently corroborates the mechanism (Hebbian adaptation of an Ising-type architecture), stating: "The second component to be added was adaptation to stimulus. This component has been added independently by different sources, including Rosenblatt (1960), Kaoru Nakano (1971), and Shun'ichi Amari (1972). They proposed to modify the weights of an Ising model by Hebbian learning rule as a model of associative memory." Wikipedia's dedicated [[Shun'ichi Amari]] article goes further, stating in its own voice: "he also independently invented the Hopfield network in 1972," and that "the Amari network, the earliest deep learning recurrent neural network (RNN), was first published by Amari in 1972... It was rediscovered by John Hopfield in 1982 as the Hopfield network."

The underlying bibliographic facts (paper title, journal, volume/pages) were independently corroborated via ACM Digital Library's record: Amari, S. (1972), "Learning Patterns and Pattern Sequences by Self-Organizing Nets of Threshold Elements," *IEEE Transactions on Computers* C-21(11):1197–1206, DOI 10.1109/T-C.1972.223477.

**Sourcing floor check:** Technical-mechanism claim. Clears the floor via Schmidhuber's survey (Tier 1 arXiv / Tier 2 HTML mirror, exact quote obtained by direct fetch), corroborated independently by Wikipedia (Tier 3, two articles). The primary 1972 paper itself was not located in readable form this session (IEEE Xplore page rendered empty; see access_failures) — the specific mathematical content ("Hebbian rule applied to an Ising-type recurrent net") rests on Schmidhuber's secondary characterization rather than a direct reading of Amari's own 1972 text.

| Field | Value |
|---|---|
| source_url | https://people.idsia.ch/~juergen/deep-learning-history.html (mirrors arXiv:2212.11279) |
| source_author | Jürgen Schmidhuber |
| source_date | retrieved 2026-07-02 |
| source_tier | 1 (arXiv) / 2 (mirror) |
| exact_quote | "In 1972, Shun-Ichi Amari made the Lenz-Ising recurrent architecture adaptive such that it could learn to associate input patterns with output patterns by changing its connection weights." |
| exact_quote_2 | "10 years later, the basic equations of the Amari network were republished (and its storage capacity analyzed). Some called it the Hopfield Network (!) or Amari-Hopfield Network." |
| corroborating_url | https://en.wikipedia.org/wiki/Hopfield_network |
| corroborating_tier | 3 |
| corroborating_quote | "They proposed to modify the weights of an Ising model by Hebbian learning rule as a model of associative memory." |

---

## Claim: The specific phrase "mathematically equivalent" (or "exactly the same") applied to Amari's 1972 model vs. Hopfield's 1982 model appears in multiple secondary sources, but the strongest version of it — apparently from Amari's own words — could not be verified by direct primary reading this session

**Claim type:** Technical-mechanism (this is the precise claim the whole research question turns on).

Hansun Hsiung, an Assistant Professor at Durham University writing in The Conversation (November 2024), states directly: "In 1972, Amari outlined a learning algorithm... that was mathematically equivalent to Hopfield's 1982 paper... on associative memory, which allowed neural networks to recognise patterns despite partial or corrupted inputs." This exact sentence was confirmed by direct fetch of the article.

A stronger and more specific version of the claim — "the model that was proposed in Amari (1972b) was exactly the same as the so-called Hopfield model of associative memory (Hopfield, 1982)" — recurred verbatim, word-for-word, across three independently-worded web searches in this session. The citation style ("Amari, 1972b," implying a paired "1972a") suggests this sentence originates in an academic text that catalogs multiple Amari papers from that year, and search-result attribution repeatedly associated it with Amari's own 2013 retrospective, "Dreaming of mathematical neuroscience for half a century" (*Neural Networks* 37:48-51). That paper was located (a scanned PDF at brainmind.umin.jp) and its bibliographic details confirmed (author, journal, volume, pages, date), but its body text could not be read directly this session: it is an image-layer scan with no OCR tool available in the sandbox, its ScienceDirect and ACM Digital Library abstract pages both returned 403 Forbidden, and PubMed's summary text does not include the sentence in question. A candidate alternative source for the "(1972b)" citation-style sentence — a course-hosted textbook chapter on associative memory models at neuron.eng.wayne.edu — could not be fetched at all (TLS certificate error on both http and https).

**This claim is therefore recorded but flagged: [unverified-mechanism — needs primary: full text of Amari (2013), "Dreaming of mathematical neuroscience for half a century," Neural Networks 37:48-51, and/or the textbook chapter using the "Amari 1972b" citation].** The weaker, hedged form of the same claim (Schmidhuber's "basic equations... republished," Claim 1 above) IS independently verified by direct fetch and does clear the Tier 1-2 floor; it is offered as the load-bearing version of this claim until the stronger wording can be confirmed against Amari's own text.

**Sourcing floor check:** Fails to clear the floor at its strongest wording (only Tier 3 The Conversation quote is directly verified for the phrase "mathematically equivalent"; the "exactly the same" wording rests on unread search-synthesized text of unconfirmed provenance). Flagged accordingly per the rubric rather than silently recorded.

| Field | Value |
|---|---|
| source_url | https://theconversation.com/japanese-scientists-were-pioneers-of-ai-yet-theyre-being-written-out-of-its-history-243762 |
| source_author | Hansun Hsiung |
| source_date | 2024-11-27 |
| source_tier | 3 |
| exact_quote | "In 1972, Amari outlined a learning algorithm...that was mathematically equivalent to Hopfield's 1982 paper...on associative memory." |
| flagged_claim | "the model that was proposed in Amari (1972b) was exactly the same as the so-called Hopfield model of associative memory (Hopfield, 1982)" — **[unverified-mechanism — needs primary]**, provenance uncertain (candidate sources: Amari 2013 Neural Networks retrospective, or a secondary textbook chapter; neither could be directly read this session) |

---

## Claim: Hopfield's 1982 PNAS paper does not cite Amari's 1972 IEEE paper in its reference list; it cites two later Amari papers (1977, 1978) — and Amari himself, in a 2025 interview, confirms exactly this distinction

**Claim type:** Historical / technical-mechanism (a specific, checkable citation fact).

Hopfield's paper itself — "Neural networks and physical systems with emergent collective computational abilities," *Proc. Natl. Acad. Sci.* 79(8):2554-2558 (1982) — was fetched directly from PubMed Central. Its reference list contains exactly two citations to Amari, neither of which is the 1972 paper: "Amari S. I. Neural theory of association and concept-formation. Biol Cybern. 1977 May 17;26(3):175–185." and "Amari S., Takeuchi A. Mathematical theory on formation of category detecting nerve cells. Biol Cybern. 1978 May 31;29(3):127–136." No citation to the 1972 IEEE Trans. Computers paper appears in Hopfield's reference list.

This is independently corroborated — without either source citing the other, so far as could be determined — by Amari's own words in a March 2025 interview published by Science Japan (Japan Science and Technology Agency): asked about the 1972 associative-memory work relative to Hopfield's later recognition, Amari is quoted directly: "My paper on associative memory was not directly cited, but a subsequent paper I wrote on self-organization was cited." This matches precisely what the primary reference list shows: the 1972 associative-memory paper itself is absent, while a "subsequent paper... on self-organization" (plausibly the 1977 or 1978 paper) is present.

**Sourcing floor check:** Clears the floor cleanly. This is a Tier 1 primary-source claim (Hopfield's own paper, its own reference list, read directly) independently corroborated by a Tier 2 direct quote from Amari himself. This is the most solidly verified claim in this capture.

| Field | Value |
|---|---|
| source_url | https://pmc.ncbi.nlm.nih.gov/articles/PMC346238/ |
| source_author | John J. Hopfield |
| source_date | 1982 |
| source_tier | 1 |
| exact_quote | "Amari S. I. Neural theory of association and concept-formation. Biol Cybern. 1977 May 17;26(3):175–185." / "Amari S., Takeuchi A. Mathematical theory on formation of category detecting nerve cells. Biol Cybern. 1978 May 31;29(3):127–136." |
| corroborating_url | https://sj.jst.go.jp/stories/2025/s0327-01p.html |
| corroborating_author | Shun'ichi Amari (interviewed), Science Japan / JST |
| corroborating_date | 2025-03-27 |
| corroborating_tier | 2 |
| corroborating_quote | "My paper on associative memory was not directly cited, but a subsequent paper I wrote on self-organization was cited." |

---

## Claim: A broader priority dispute exists around the naming of the "Hopfield network," involving Schmidhuber's characterization of the 2024 Nobel Prize as rewarding "plagiarism," and separately a direct claim by Stephen Grossberg that he — not Hopfield — originated the architecture

**Claim type:** Historical (contested characterization — presented as attributed opinion, not settled fact).

Jürgen Schmidhuber has publicly characterized the 2024 Nobel Prize in Physics (awarded to Hopfield and Hinton) in strong terms; a PDF on his own site is titled "A Nobel Prize for Plagiarism" (title confirmed via document metadata; body text could not be extracted — it is an image-scanned PDF). Secondary reporting attributes to him the claim that "10 years later... Hopfield republished [Amari's 1972 net] without citing Amari" and that people have "started to call the Hopfield Network the Amari-Hopfield Network." This is Schmidhuber's characterization and should be read as such — an advocate's framing, not a neutral finding — consistent with the pattern already flagged in the vault's separate Amari/1967-gradient-descent capture, where Schmidhuber is simultaneously the best-documented source on Amari's priority and a long-running advocate for re-crediting non-Anglophone originators.

Separately, cognitive scientist Stephen Grossberg is quoted (via a Substack piece by Harry Law, "The great Hopfield network debate," May 2025) making an unrelated but overlapping priority claim of his own: "I don't believe that this model should be named after Hopfield. He simply didn't invent it. I did it when it was really a radical thing to do." The same piece notes Stanford researcher William Little "introduced versions of the networks" in 1976 (elsewhere dated 1974 by other sources), placing at least three independent named precursors — Amari, Little, and Grossberg — in contention for a network that ended up named for Hopfield. Harry Law's own explanation for why Hopfield's name prevailed is about scientific communication style, not mathematics: "Hopfield removed dense mathematical descriptions in favour of persuasive prose written for cognitive scientists, published his paper in the influential Proceedings of the National Academy of Science, and travelled extensively to talk about 'his' networks."

**Sourcing floor check:** Historical/contested claim. The Grossberg quote and the "why Hopfield's name won" framing are Tier 4 (independent Substack, no further corroboration located this session) — acceptable for an attributed, clearly-opinion characterization but not treated as settled fact. The Schmidhuber "plagiarism" framing is attributed directly to Schmidhuber (Tier 1/2 general credibility) but its exact wording could not be quoted verbatim from his own PDF this session (image-scanned); only the title and secondary paraphrases were available. Recorded as an attributed characterization, not a fact-claim of this vault.

| Field | Value |
|---|---|
| source_url | https://www.learningfromexamples.com/p/the-great-hopfield-network-debate |
| source_author | Harry Law |
| source_date | 2025-05-16 |
| source_tier | 4 |
| exact_quote | "I don't believe that this model should be named after Hopfield. He simply didn't invent it. I did it when it was really a radical thing to do." (attributed to Stephen Grossberg) |
| secondary_note | Schmidhuber's PDF "A Nobel Prize for Plagiarism" (https://people.idsia.ch/~juergen/physics-nobel-2024-plagiarism.pdf) confirms title only; body text unreadable this session (image PDF). |

---

## Further leads

- Amari's own 2013 retrospective, "Dreaming of mathematical neuroscience for half a century" (*Neural Networks* 37:48-51) — located but unreadable this session (scanned PDF, no OCR tool in sandbox, ScienceDirect/ACM both 403). This is the single highest-priority follow-up: if the "exactly the same as the so-called Hopfield model" sentence really is Amari's own words, it resolves Claim 2 to Tier 1 outright.
- The textbook chapter at neuron.eng.wayne.edu/tarek/MITbook/chap7/7_1.html ("Basic Associative Neural Memory Models") appears to be the actual source of the "(Amari, 1972b)" citation-style sentence but could not be fetched (TLS certificate error) — worth another attempt with different tooling, or locating the underlying textbook (likely Hassoun, *Fundamentals of Artificial Neural Networks*, or similar) directly.
- The Nobel Committee's own "Scientific Background to the Nobel Prize in Physics 2024" document (https://www.nobelprize.org/uploads/2024/09/advanced-physicsprize2024.pdf) reportedly gives Amari only a brief mention, per Schmidhuber's secondary characterization — not independently confirmed this session (403 Forbidden on both the scientific-background and popular-science PDFs).
- Amari's 1972 IEEE paper itself was not located in readable form (IEEE Xplore page rendered empty). A copy via Amari's own institutional page or a library proxy would let this note quote the primary text directly rather than relying entirely on Schmidhuber's and Wikipedia's characterizations.
- William Little's 1974 (or 1976, sources disagree on the year) paper as a third independent precursor was not investigated at all this session — a parallel thread to the Amari question, not yet checked against a primary source.
- The full text of the "Amari network... republished... storage capacity analyzed" claim (Schmidhuber's [AMH2] footnote) was not traced to its underlying citation — likely Amit, Gutfreund & Sompolinsky's early-1980s storage-capacity analyses of the Hopfield model, not yet verified.

> [!note] Seek's commentary:
> The honest shape of this capture is: the *chronological and mechanistic* claim (Amari proposed an adaptive Hebbian-Ising associative-memory net in 1972, a decade before Hopfield) is well-supported and multiply corroborated. The *citation* claim (Hopfield's paper doesn't cite the 1972 paper specifically, but does cite Amari's 1977/1978 work) is the best-verified thing in this whole note — a direct primary-source read confirmed by Amari's own words, independently, in a 2025 interview. That's a genuinely satisfying convergence. But the *headline* claim this topic asked about — "mathematically equivalent" — is exactly the kind of load-bearing technical-mechanism statement the sourcing floor exists to catch, and it did catch something: the sentence with the strongest, most quotable wording could not be pinned to a verified primary read this session, only to a repeatedly-surfaced search snippet of uncertain origin. It would be easy to write "Amari's 1972 model was mathematically equivalent to Hopfield's — even Amari says so" and have it read as settled. It isn't settled by what this session could actually verify; it's well-supported by hedged, verified language ("basic equations... republished," "mathematically equivalent" per one Tier-3 academic-authored piece) and *plausibly* strongly supported by Amari's own unverified words. Promotion should preserve that distinction rather than smooth it into the cleaner, more citable claim.
