---
id: "20260703-0216-did-kunihiko-fukushimas-1979"
title: "Did Kunihiko Fukushima's 1979 Neocognitron constitute the first multilayer convolutional neural network, and what do primary sources actually claim?"
type: "capture"
status: "promoted"
date_promoted: "2026-07-06T00:00:00.000Z"
promoted_to: ["30-notes/claim-fukushima-1979-neocognitron-first-cnn.md"]
not_promoted: ["1969 predecessor hand-designed-kernel detail — [unverified-mechanism] honored (Wikipedia-only), stays in capture","Wikipedia-strength-disagreement observation — folded into the note"]
origin: "batch"
model: "claude-sonnet-5"
date_created: "2026-07-03T00:00:00.000Z"
provenance: "batch run 2026-07-03; web research via WebSearch + WebFetch"
derived_from: []
tags: ["fukushima","neocognitron","convolutional-neural-network","cnn","deep-learning","history-of-ai","history-of-computation","japan","backpropagation","schmidhuber"]
source_urls: ["https://pubmed.ncbi.nlm.nih.gov/7370364/","https://pubmed.ncbi.nlm.nih.gov/23098752/","https://pubmed.ncbi.nlm.nih.gov/1203338/","https://people.idsia.ch/~juergen/deep-learning-history.html","https://ar5iv.labs.arxiv.org/html/1404.7828","https://arxiv.org/abs/1404.7828","https://en.wikipedia.org/wiki/Neocognitron","https://en.wikipedia.org/wiki/Kunihiko_Fukushima","https://www.rctn.org/bruno/public/papers/Fukushima1980.pdf","https://link.springer.com/article/10.1007/BF00344251","https://link.springer.com/article/10.1007/BF00342633","https://historyofinformation.com/detail.php?id=4260"]
primary_sources_consulted: [{"url":"https://pubmed.ncbi.nlm.nih.gov/7370364/","author":"K. Fukushima (abstract mirrored by PubMed/NLM)","date":"1980 (record retrieved 2026-07-03)","tier":1,"note":"PMID 7370364. Reproduces the publisher-supplied abstract verbatim for Fukushima's original 1980 Biological Cybernetics 36(4):193-202 paper — treated as primary-source text (Fukushima's own words), not secondary characterization, since PubMed mirrors the publisher abstract exactly."},{"url":"https://pubmed.ncbi.nlm.nih.gov/23098752/","author":"K. Fukushima","date":"2013 (record retrieved 2026-07-03)","tier":1,"note":"PMID 23098752. Abstract of Fukushima's own 2013 retrospective review, 'Artificial vision by multi-layered neural networks: neocognitron and its advances,' Neural Networks 37:103-19 — his own later characterization of the 1980 work, in his own words."},{"url":"https://pubmed.ncbi.nlm.nih.gov/1203338/","author":"K. Fukushima","date":"1975 (record retrieved 2026-07-03)","tier":3,"note":"PMID 1203338. Bibliographic record only (no abstract available) for the 1975 'Cognitron' predecessor paper, Biol Cybern 20(3-4):121-36."},{"url":"https://people.idsia.ch/~juergen/deep-learning-history.html","author":"Jürgen Schmidhuber","date":"retrieved 2026-07-03 (mirrors arXiv:2212.11279, updated periodically)","tier":2,"note":"Mirror of Schmidhuber's 'Annotated History of Modern AI and Deep Learning.' Tier 2 as a personal-site mirror; the arXiv version of the same text is Tier 1."},{"url":"https://ar5iv.labs.arxiv.org/html/1404.7828","author":"Jürgen Schmidhuber","date":"2014/2015 (arXiv:1404.7828, published Neural Networks 61:85-117, 2015)","tier":1,"note":"'Deep Learning in Neural Networks: An Overview.' HTML rendering (ar5iv) of the arXiv preprint, fetched directly and quoted verbatim in Section 5.4 on convolutional NN history."},{"url":"https://en.wikipedia.org/wiki/Neocognitron","author":"Wikipedia contributors","date":"retrieved 2026-07-03","tier":3},{"url":"https://en.wikipedia.org/wiki/Kunihiko_Fukushima","author":"Wikipedia contributors","date":"retrieved 2026-07-03","tier":3},{"url":"https://www.rctn.org/bruno/public/papers/Fukushima1980.pdf","author":"Kunihiko Fukushima","date":"1980","tier":1,"note":"Primary source located and fetched (1.1MB PDF, redistributed copy of the Biological Cybernetics 1980 paper). Could NOT be read as text in this session — see access_failures. Only the PubMed-mirrored abstract of this same paper could be directly quoted."},{"url":"https://historyofinformation.com/detail.php?id=4260","author":"Jeremy Norman (History of Information)","date":"retrieved 2026-07-03","tier":3,"note":"Page title only confirmed ('The Neocognitron, Perhaps the Earliest Multilayered Artificial Neural Network'); body text could not be extracted (JS-rendered page, WebFetch returned only the page header both times attempted). Title reproduced identically in two independent search-result snippets, so treated as a genuine (if thin) data point: even a dedicated history-of-technology site hedges with 'Perhaps.'"}]
access_failures: ["https://www.rctn.org/bruno/public/papers/Fukushima1980.pdf → fetched successfully (1.1MB) but WebFetch could not render the embedded text (binary/FlateDecode PDF streams); no pdftotext/pdftoppm/poppler available in this sandbox, and local Python PDF-library scripts required bash approval that could not be granted in this session — the primary paper's full text (beyond its abstract) was not directly read","https://ar5iv.labs.arxiv.org/html/1404.7828 (arxiv.org/pdf/1404.7828 direct PDF fetch) → same binary-PDF problem; resolved instead via the ar5iv HTML mirror, which rendered cleanly","https://link.springer.com/article/10.1007/BF00344251 → 303 redirect to Springer login/paywall; abstract obtained instead via PubMed mirror of the same paper","https://link.springer.com/article/10.1007/BF00342633 → same Springer paywall redirect; bibliographic facts (not abstract, none available) obtained via PubMed instead","https://grokipedia.com/page/Neocognitron → 403 Forbidden","https://www.semanticscholar.org/paper/Neocognitron:-A-self-organizing-neural-network-for-Fukushima/69e68bfaadf2dccff800158749f5a50fe82d173b → WebFetch returned empty content"]
---


**Short answer the claims below support:** Partially yes, with real qualifications. The Neocognitron is widely credited by historians of deep learning — most authoritatively Jürgen Schmidhuber, a Tier 1 source on this exact question — as the origin of the architectural pattern later called the convolutional neural network (alternating layers of local, weight-shared feature detectors and spatial-pooling/downsampling units), and as "perhaps the first artificial NN that deserved the attribute deep." But every part of that sentence carries a hedge in the best-sourced version of the claim, and several complications surface on closer reading: (1) Fukushima's own 1980 primary-source abstract makes no "first" or "convolutional neural network" claim at all — those are retrospective labels applied by later researchers; (2) two Wikipedia articles about the same fact disagree in strength ("the original deep CNN architecture" vs. merely "served as the inspiration for" CNNs); (3) Fukushima's own earlier 1969 paper already described a multilayered network using convolution-like (but hand-designed, not learned) local feature detectors, a full decade before the Neocognitron, which complicates any unqualified "first" framing even restricted to Fukushima's own body of work; and (4) critically, the 1979/1980 Neocognitron was not trained by backpropagation or any supervised gradient method — Schmidhuber's Tier 1 account states plainly that Fukushima "did not set the weights by supervised backpropagation, but by local, WTA-based unsupervised learning rules, or by pre-wiring," a mechanism difference from the backprop-trained CNNs (Waibel 1987, Zhang et al. 1988, LeCun et al. 1989 onward) that the term "CNN" usually connotes today.

---

## Claim: The 1979/1980 Neocognitron papers exist as described, with a clear publication trail (Japanese 1979 → English 1980), preceded by two earlier Fukushima papers (1969, 1975) that anticipate parts of the architecture

**Claim type:** Historical / definitional (uncontested bibliographic facts).

Fukushima first described the Neocognitron in Japanese in October 1979: "Neural network model for a mechanism of pattern recognition unaffected by shift in position — Neocognitron —," *Trans. IECE* J62-A(10):658-665. The English-language version followed in April 1980: "Neocognitron: A Self-organizing Neural Network Model for a Mechanism of Pattern Recognition Unaffected by Shift in Position," *Biological Cybernetics* 36(4):193-202 (DOI 10.1007/BF00344251; PMID 7370364). This 1980 paper is the one almost universally cited as "the Neocognitron paper."

It was preceded by two earlier Fukushima papers that establish a longer trajectory toward the 1979/1980 result: "Visual Feature Extraction by a Multilayered Network of Analog Threshold Elements," *IEEE Trans. Systems Science and Cybernetics* 5(4):322-333 (1969) — a multilayered network using hand-designed, convolution-inspired local feature detectors, according to Wikipedia's characterization — and "Cognitron: A self-organizing multilayered neural network," *Biological Cybernetics* 20(3-4):121-136 (1975; PMID 1203338), Fukushima's direct predecessor model that added self-organized (learned) weights but lacked the shift-invariance the Neocognitron later added via alternating S-cell/C-cell layers.

**Sourcing floor check:** Historical/biographical claim, uncontested — Tier 3-4 is acceptable per the rubric, and this clears it with margin: the 1980 and 1975 paper citations are corroborated by PubMed records (Tier 1/2, publisher-mirrored bibliographic data) independent of Wikipedia, and the 1969 paper's existence and venue were independently corroborated across four separate listings (CoLab, Semantic Scholar, DBLP, IEEE Xplore) found via search, though none of these were directly fetched and quoted this session.

| Field | Value |
|---|---|
| source_url | https://pubmed.ncbi.nlm.nih.gov/7370364/ |
| source_author | K. Fukushima (PubMed/NLM record) |
| source_date | 1980 |
| source_tier | 1 |
| exact_quote | "Neocognitron: a self organizing neural network model for a mechanism of pattern recognition unaffected by shift in position" — Biol Cybern. 1980;36(4):193-202. |
| corroborating_url | https://pubmed.ncbi.nlm.nih.gov/1203338/ |
| corroborating_tier | 3 |
| corroborating_quote | "Cognitron: a self-organizing multilayered neural network" — Biol Cybern. 1975 Nov 5;20(3-4):121-36. |

---

## Claim: Fukushima's own 1980 abstract describes the Neocognitron in terms of unsupervised self-organization and shift-invariant pattern recognition — not in terms of "convolution" or "first," and not by claiming priority over any other network

**Claim type:** Technical-mechanism (what the primary source itself actually says, as distinct from later characterizations of it).

The verbatim abstract of Fukushima's 1980 paper, as mirrored by PubMed, opens: "A neural network model for a mechanism of visual pattern recognition is proposed in this paper. The network is self-organized by 'learning without a teacher', and acquires an ability to recognize stimulus patterns based on the geometrical similarity (Gestalt) of their shapes without affected by their positions." The abstract goes on to describe the hierarchical S-cell/C-cell structure and states that the response of the last layer's C-cells "is not affected by the pattern's position at all," nor by small changes in shape or size. Nowhere in this primary abstract does Fukushima use the terms "convolutional neural network" or "convolution," nor does he assert that the network is the first of its kind.

This matters directly for the question asked: the "first multilayer CNN" framing is not Fukushima's own claim about his 1979/1980 work — it is a retrospective label applied by later deep-learning historians (principally Schmidhuber, see next claim) once the term "convolutional neural network" had been coined and the shared-weight, locally-connected architecture pattern had been recognized as a recurring design.

**Sourcing floor check:** Technical-mechanism claim about what the primary text itself says, quoted directly rather than paraphrased. Clears the floor at Tier 1 — this is Fukushima's own abstract, reproduced verbatim via the publisher-mirrored PubMed record, not a secondary summary.

| Field | Value |
|---|---|
| source_url | https://pubmed.ncbi.nlm.nih.gov/7370364/ |
| source_author | Kunihiko Fukushima |
| source_date | 1980 |
| source_tier | 1 |
| exact_quote | "A neural network model for a mechanism of visual pattern recognition is proposed in this paper. The network is self-organized by 'learning without a teacher', and acquires an ability to recognize stimulus patterns based on the geometrical similarity (Gestalt) of their shapes without affected by their positions." |

---

## Claim: Schmidhuber's historical scholarship credits Fukushima's 1979 Neocognitron with introducing the core CNN architecture (weight-shared convolutional units + downsampling/pooling), and calls it "perhaps the first artificial NN that deserved the attribute deep" — but explicitly not trained by backpropagation

**Claim type:** Technical-mechanism / historical-priority (the load-bearing claim the whole question turns on).

Schmidhuber's arXiv survey "Deep Learning in Neural Networks: An Overview" states directly, in the section on convolutional NN history: "the Neocognitron (Fukushima, 1979, 1980) was perhaps the first artificial NN that deserved the attribute deep." The same section continues: "It introduced convolutional NNs (today often called CNNs or convnets), where the (typically rectangular) receptive field of a convolutional unit with given weight vector (a filter) is shifted step by step across a 2-dimensional array of input values," and notes the resulting parameter efficiency: "Due to massive weight replication, relatively few parameters may be necessary to describe the behavior of such a convolutional layer." It also describes the pooling/downsampling mechanism: "Subsampling units become active if at least one of their inputs is active; their responses are insensitive to certain small image shifts." Schmidhuber's mirrored history page states the same priority claim independently: "The basic CNN architecture with alternating convolutional and downsampling layers is due to Kunihiko Fukushima (1979). He called it Neocognitron. It was inspired by neurophysiological findings of Hubel and Wiesel, and trained by unsupervised learning rules."

Critically, Schmidhuber is explicit that this architectural priority does not extend to the training method that later became inseparable from the term "CNN" in modern usage: "Fukushima, however, did not set the weights by supervised backpropagation, but by local, WTA-based unsupervised learning rules, or by pre-wiring." Backpropagation-trained CNNs came later and from different researchers: Waibel (1987) applied backprop to supervised 1-D convolutional nets (TDNNs) for speech; Zhang et al. (1988) built, per Schmidhuber's characterization, "the first 'modern' 2-dimensional CNN trained by backpropagation"; LeCun et al.'s subsequent, more widely known papers (from 1989 onward) are described by Schmidhuber as coming after those. Schmidhuber also flags a historiographic pattern relevant to weighing this whole thread: "Most of the above was published in Japan 1979-1988. However, Fukushima and colleagues were outsiders back then" — echoing the same "written out of history" framing already documented in the vault for Amari (see [[claim-amari-1967-sgd-layered-networks]] if promoted, and the harvesting capture this note derives its lead from).

**Sourcing floor check:** Technical-mechanism claim about the architecture, and a hedged historical-priority claim ("perhaps the first"). Both clear the floor: quoted directly and verbatim from Schmidhuber's arXiv preprint (Tier 1) via its ar5iv HTML rendering, corroborated by the independently-phrased mirror on his personal site (Tier 2). The hedge word "perhaps" is Schmidhuber's own, not an editorial softening added here — it is preserved because it is load-bearing for how confidently this claim can be stated.

| Field | Value |
|---|---|
| source_url | https://ar5iv.labs.arxiv.org/html/1404.7828 (arXiv:1404.7828, published Neural Networks 61:85-117, 2015) |
| source_author | Jürgen Schmidhuber |
| source_date | 2014 (preprint) / 2015 (journal) |
| source_tier | 1 |
| exact_quote | "the Neocognitron (Fukushima, 1979, 1980) was perhaps the first artificial NN that deserved the attribute deep" |
| exact_quote_2 | "It introduced convolutional NNs (today often called CNNs or convnets), where the (typically rectangular) receptive field of a convolutional unit with given weight vector (a filter) is shifted step by step across a 2-dimensional array of input values." |
| exact_quote_3 | "Fukushima, however, did not set the weights by supervised backpropagation, but by local, WTA-based unsupervised learning rules, or by pre-wiring." |
| corroborating_url | https://people.idsia.ch/~juergen/deep-learning-history.html |
| corroborating_tier | 2 |
| corroborating_quote | "The basic CNN architecture with alternating convolutional and downsampling layers is due to Kunihiko Fukushima (1979). He called it Neocognitron. It was inspired by neurophysiological findings of Hubel and Wiesel, and trained by unsupervised learning rules." |

---

## Claim: Secondary sources disagree on how strongly to state the "first CNN" claim — even within Wikipedia, two articles use different strengths of language for the same fact

**Claim type:** Historical / definitional (a claim about the state of sourcing itself, not a new empirical fact).

Wikipedia's article on Kunihiko Fukushima states flatly: "In 1980, Fukushima published the neocognitron, the original deep convolutional neural network (CNN) architecture" — an unhedged priority claim. Wikipedia's separate article specifically about the Neocognitron does not make this claim at all; instead it describes the model as having "served as the inspiration for convolutional neural networks," and separately notes Fukushima's 1969 predecessor: "Previously in 1969, he published a similar architecture, but with hand-designed kernels inspired by convolutions in mammalian vision," improved into the Neocognitron in 1979 which "learns all convolutional kernels by unsupervised learning." A dedicated history-of-technology site (History of Information) titles its own entry on the topic "The Neocognitron, Perhaps the Earliest Multilayered Artificial Neural Network" — hedging with "Perhaps" in the title itself, echoing Schmidhuber's own hedge.

This pattern — one venue asserting flat priority, an adjacent venue on the same topic hedging or declining to assert it, and the most careful Tier 1 source ("perhaps") landing in between — is itself the honest state of the evidence on this question, and worth recording as such rather than silently picking the strongest-sounding phrasing.

**Sourcing floor check:** This is a claim about disagreement among sources, not a quantitative or mechanism claim in its own right — Tier 3 is acceptable for reporting what two Wikipedia articles say, since both are quoted directly rather than paraphrased into a stronger claim than either makes.

| Field | Value |
|---|---|
| source_url | https://en.wikipedia.org/wiki/Kunihiko_Fukushima |
| source_author | Wikipedia contributors |
| source_date | retrieved 2026-07-03 |
| source_tier | 3 |
| exact_quote | "In 1980, Fukushima published the neocognitron, the original deep convolutional neural network (CNN) architecture." |
| corroborating_url | https://en.wikipedia.org/wiki/Neocognitron |
| corroborating_tier | 3 |
| corroborating_quote | "[the Neocognitron] served as the inspiration for convolutional neural networks" |

**[unverified-mechanism — needs primary]**: The specific characterization of the 1969 predecessor paper as using "hand-designed kernels inspired by convolutions in mammalian vision" (as opposed to the Neocognitron's learned kernels) rests only on the Wikipedia Neocognitron article (Tier 3) in this session; the 1969 IEEE paper itself was not located or read, so this specific mechanism distinction has not been verified against a Tier 1-2 source.

---

## Further leads

- The primary full texts of both the 1980 Biological Cybernetics paper (located at https://www.rctn.org/bruno/public/papers/Fukushima1980.pdf) and Schmidhuber's arXiv:1404.7828 could not be read beyond their abstracts/HTML-rendered sections in this session, for a recurring, structural reason: this sandbox lacks `pdftotext`/`pdftoppm`/poppler for OCR or text extraction from binary PDF streams, and attempts to run a local Python-based extraction script (PyMuPDF/fitz) were blocked by the bash approval system rather than by any tooling failure. This is the same limitation that blocked direct reading of Amari's 1967 paper in the prior capture in this chain — worth flagging to Cali as a standing infrastructure gap if primary-PDF reading becomes a recurring need.
- Fukushima's own 1969 paper, "Visual Feature Extraction by a Multilayered Network of Analog Threshold Elements" (IEEE Trans. SSC 5(4):322-333), was not directly read — it would be the primary source to check both the "hand-designed kernels" characterization above and, more ambitiously, whether it should itself be considered a precursor "multilayer network with convolution-like structure" that predates the Neocognitron by a decade.
- The specific claim (surfaced via an unverified AI search-summary only, Tier 4, not corroborated further this session) that the 1969 paper's "analog threshold element" anticipated the ReLU activation function was noticed but deliberately not recorded as a claim here — it did not clear the floor for a technical-mechanism claim and was not independently verified.
- Not yet checked: whether Fukushima ever addressed the "first CNN" framing himself in an interview or retrospective beyond the 2013 Neural Networks review abstract read here (which itself makes no explicit priority claim).
- Griewank/Schmidhuber-style priority-dispute literature (already a recurring thread in this vault's backpropagation-history chain) has not been checked specifically for whether it discusses Fukushima/Neocognitron priority disputes with any dissenting voice — everything found this session converges on Schmidhuber as the dominant historian of this specific claim, which is itself worth noting as a single-point-of-failure risk (see commentary).

> [!note] Seek's commentary:
> The central finding here isn't a yes/no on the topic question — it's that the *shape* of the evidence is a hedge sandwiched between two overclaims. Wikipedia's Fukushima biography says "the original," Wikipedia's Neocognitron article says merely "inspiration for," and the one Tier 1 source that actually earns trust on this question (Schmidhuber) says "perhaps the first... that deserved the attribute deep" — a narrower and more careful claim than either Wikipedia sentence, and one that explicitly carves out training method (unsupervised, not backprop) as a place where the Neocognitron is *not* like what people usually mean by "CNN" today. That's worth holding onto if this gets promoted: "first CNN" as a bare claim papers over the fact that the primary source itself never uses the word "convolutional," that Fukushima had a decade-earlier multilayer precursor of his own, and that the mechanism (unsupervised WTA learning vs. backprop) is a real, not cosmetic, difference from the architectures the term usually evokes now. This is the same pattern as the Amari capture this note was harvested from: a genuinely real, well-evidenced Japanese-origin priority claim that gets flattened into a cleaner, stronger sound bite than the primary source or the best historian actually supports. Also worth flagging structurally: as with the Amari capture, nearly all of the Tier 1/2 weight here rests on one source (Schmidhuber) — a historian with a well-documented pattern of advocating for underrecognized non-Anglophone priority claims. That doesn't make the claims wrong, but a promoted note should say so rather than let Wikipedia's citations of Schmidhuber look like independent corroboration.