---
id: "20260708-0224-did-widrow-attempt-and"
title: "Did Widrow attempt and abandon multilayer network training around 1965–1966, and what primary sources document this effort?"
type: "capture"
status: "promoted"
promoted_to: ["30-notes/claim-widrow-abandoned-multilayer-training-until-1985-backprop.md","30-notes/claim-madaline-rule-i-first-layer-trainable-second-fixed.md"]
not_promoted: ["Claim 3 (the two 1965/66 papers ARE 'the' attempt) — skipped as a date-coincidence trap per the capture's own judgment; routed to [[question-verify-widrow-1965-66-papers-multilayer-attempt]] instead."]
promotion_note: "Promoted 2026-07-09 (Fable clean-lane marathon). Both [unverified-mechanism] flags were CLEARED by a direct read of Widrow & Lehr 1990 (Proc. IEEE 78(9)), now possible after the poppler/pdfinfo repair — pdftotext extracted it cleanly (the capture's 'scanned image, unreadable' assumption was wrong; the failure was purely the missing binary). Madaline Rule I architecture and the hard-limiter-vs-sigmoid obstacle are Tier-1 confirmed. Remaining verifications (1965-66 date-coincidence, 1985 Snowbird oral-history detail) routed to one question."
origin: "batch"
model: "claude-sonnet-5"
date_created: "2026-07-08T00:00:00.000Z"
provenance: "batch run 2026-07-08; web research via WebSearch + WebFetch; harvested from 2026-06-30-what-was-the-credit-assignment-problem-as-minsky-framed-it-and-how-does-backprop-address-it"
derived_from: []
tags: ["widrow","madaline","adaline","multilayer-perceptron","backpropagation","history-of-ai","credit-assignment"]
primary_sources_consulted: [{"url":"https://isl.stanford.edu/~widrow/papers/j199030years.pdf","author":"Bernard Widrow and Marcian A. Lehr","date":"1990-09 (Proceedings of the IEEE, 78(9):1415-1442)","tier":1,"note":"Widrow's own retrospective history of Adaline/Madaline/backprop, co-authored by Widrow. URL resolves and file downloads (confirmed), but the PDF is a scanned image with no text layer — could not be OCR'd or quoted verbatim this session (see access_failures)."},{"url":"https://isl.stanford.edu/~widrow/papers/j1965acritical.pdf","author":"Karl Steinbuch and Bernard Widrow","date":"1965-10 (IEEE Trans. Electronic Computers, EC-14(5):737-740; originally Stanford Electronics Labs Tech Report 6764-2, Dec. 1964)","tier":1,"note":"'A Critical Comparison of Two Kinds of Adaptive Classification Networks' — bibliographic existence and venue confirmed (URL resolves, IEEE Xplore record exists at https://ieeexplore.ieee.org/document/4038566/). Content reported by secondary summaries to compare the Learning Matrix and Madaline structures. Could not read the scanned PDF to confirm it documents a multilayer-training attempt specifically — flagged below."},{"url":"https://isl.stanford.edu/~widrow/papers/c1966bootstraplearning.pdf","author":"Bernard Widrow","date":"1966-06 (Proceedings of the 3rd International Congress of IFAC, London)","tier":1,"note":"'Bootstrap Learning in Threshold Logic Systems' — bibliographic existence and venue confirmed (URL resolves). Could not read the scanned PDF this session to confirm its relationship to multilayer-network training specifically — flagged below."},{"url":"https://yuxi.ml/essays/posts/backstory-of-backpropagation/","author":"Yuxi Liu","date":"2023-12-26 (modified 2024-11-22)","tier":2,"note":"Named independent researcher/blogger, own venue, heavily footnoted historical essay. URL resolves (after a 301 redirect from yuxi-liu-wired.github.io). Cites Widrow's own oral-history and autobiographical material directly."},{"url":"https://ethw.org/Oral-History:Bernard_Widrow","author":"Bernard Widrow, interviewed by Andrew Goldstein (IEEE History Center)","date":"interview conducted 1997-03-14","tier":1,"note":"Direct oral-history transcript, named interviewer and subject — would be Tier 1 if readable. Page exists and is indexed (confirmed via search results and via ethw.org's own site listing), but WebFetch returned HTTP 403 on every access path tried (direct URL, raw wikitext, printable view, Wayback Machine). Content NOT independently read this session — see access_failures."},{"url":"https://www.researchgate.net/publication/265789430_A_Nonrandom_Walk_Down_Memory_Lane_With_Bernard_Widrow_Scanning_our_Past","author":"Alexander B. Magoun (IEEE History Center), interviewing Bernard Widrow","date":"2014 (Proceedings of the IEEE, 102(10):1622-1629)","tier":1,"note":"Edited oral-history profile, 'Scanning Our Past' series. Existence and bibliographic details confirmed via IEEE Xplore listing (https://ieeexplore.ieee.org/document/6899790/) and academia.edu mirror. Full text NOT accessible this session — both researchgate.net and academia.edu returned HTTP 403."},{"url":"https://en.wikipedia.org/wiki/Bernard_Widrow","author":"Wikipedia contributors","date":"retrieved 2026-07-08","tier":4,"note":"Used only for the uncontested biographical/historical narrative shape (attempt → abandonment → 1985 Snowbird reconnection to backprop), not for the specific quote it reproduces (that quote is tracked instead to the Tier-1 paper Wikipedia cites for it, with the caveat that this session could not independently verify the citation against the primary text)."}]
access_failures: ["extract_pdf tool failed on every Stanford Widrow PDF tried (j199030years.pdf, j1965acritical.pdf, c1966bootstraplearning.pdf): 'No such file or directory: pdfinfo' — the tool's poppler-utils dependency appears missing in this environment. This is an environment/tooling gap, not a source-quality problem.","WebFetch on the same PDFs returned binary/garbled content — all three appear to be scanned-image PDFs with no OCR text layer, so even without the extract_pdf failure, verbatim quotation would likely not have been possible without dedicated OCR.","https://ethw.org/Oral-History:Bernard_Widrow → HTTP 403 (also tried raw wikitext and printable-view URL variants, both 403; Wayback Machine access to this URL is blocked in this environment)","https://www.academia.edu/20301480/A_Nonrandom_Walk_down_Memory_Lane_with_Bernard_Widrow → HTTP 403","https://www.researchgate.net/publication/265789430_... → HTTP 403","https://ccs.fau.edu/~bressler/EDU/CompNeuro/Resources/Widrow_HBTNN_Perceptrons.htm (Widrow's own HBTNN encyclopedia entry, 'Perceptrons, Adalines, and Backpropagation') → 'Too many redirects' on every attempt; could not be read despite being a promising Tier 1 candidate (author is Widrow himself).","Internet Archive copy of *Talking Nets: An Oral History of Neural Networks* (Anderson & Rosenfeld, eds., 1998/2000 MIT Press) is access-restricted (borrow-only); full-text search endpoint returned an error. The 'Ancient History' chapter (Widrow's interview) could not be read directly."]
---


**Short answer the claims below support:** Partially confirmed. Multiple convergent sources — one Tier 2 (a well-footnoted independent historical essay) and several Tier 3–4 aggregator syntheses — agree that Bernard Widrow and collaborators spent years in the 1960s trying and failing to find a systematic training algorithm for a genuinely multilayer (more-than-one-trainable-layer) network, that the furthest they reached was Madaline Rule I (1962, only the first of two layers trainable), and that Widrow did not return to neural-network research until he learned of backpropagation at a 1985 Snowbird, Utah conference. This general shape of the story is well-corroborated and, per the sourcing floor, counts as an uncontested historical claim (Tier 3–4 acceptable). **The specific 1965–1966 date window, however, is not independently confirmed by this session's research as the specific period of "the" abandoned attempt** — it is only circumstantially supported by the existence of two real Widrow papers from exactly that window (1965 and 1966) whose *content* could not be verified this session. The primary sources that would settle this precisely — Widrow's own 1990 retrospective, his 1997 and 2014 oral histories, and his 2023 memoir chapter — all exist, are named and locatable, and are documented below, but none could be read in full text this session due to a combination of a broken PDF-extraction tool and 403s on every relevant transcript host. This is recorded as a genuine, tooling-caused gap, not a claim that the underlying history is unsettled.

---

## Claim: Widrow and collaborators made repeated, unsuccessful attempts across the 1960s to find a training algorithm for a genuinely multilayer network, stopping only when Widrow encountered backpropagation in 1985

**Claim type:** Historical / technical-mechanism (load-bearing — this is the core of the question).

Yuxi Liu's essay states that after Widrow and Hoff successfully trained the single-layer Adaline with gradient descent in the early 1960s, "they spent years attempting to train a two-layered network (MADALINE) **without** gradient descent" and that the fundamental obstacle was that Madaline's hidden units used non-differentiable Heaviside step functions, so "[r]ather than adopting continuous activation functions to enable backpropagation, they pursued alternative heuristic approaches." The essay quotes Widrow reflecting on this directly in an oral history (attributed by Yuxi Liu to Widrow's own retrospective material): "Backprop would not work with the kind of neurons...sharp quantizers. You...have sigmoids; smooth nonlinearity...no one knew anything about it." Per the same essay, Widrow and Hoff subsequently left neural-network research — Hoff moved to Intel (co-inventing the microprocessor), Widrow moved to adaptive signal processing (adaptive antennas, noise filtering) — until a 1985 conference in Snowbird, Utah, where Widrow learned of the backpropagation algorithm and returned to neural-network research.

**Sourcing floor check:** This is a technical-mechanism/historical claim. The primary source that would clear the floor cleanly (Widrow's own words, direct from an oral history or his 1990 retrospective paper) exists and is named, but could not be read directly this session (see access_failures). The claim as recorded here rests on Yuxi Liu's essay — a named, own-venue, heavily-footnoted historical writer (Tier 2) who reproduces a verbatim Widrow quote with a citation to primary oral-history material. Per the rubric, a Tier 2 analyst's reproduction of a primary quote is "one layer removed from the underlying facts" — worth recording, but the underlying primary (the oral history itself) was not independently verified against Yuxi Liu's transcription this session. The broader shape of the claim (years of failed attempts, eventual abandonment, 1985 Snowbird reconnection) is corroborated independently by multiple search-engine-synthesized aggregator summaries and by Wikipedia's Bernard Widrow article (Tier 4) — as an uncontested historical/biographical claim this clears the Tier 3–4 floor on its own, even setting the Tier 2 essay aside.

| Field | Value |
|---|---|
| source_url | https://yuxi.ml/essays/posts/backstory-of-backpropagation/ |
| source_author | Yuxi Liu |
| source_date | 2023-12-26 (modified 2024-11-22) |
| source_tier | 2 |
| exact_quote | "Backprop would not work with the kind of neurons...sharp quantizers. You...have sigmoids; smooth nonlinearity...no one knew anything about it." (Yuxi Liu attributes this to Widrow's own oral-history/retrospective material; not independently verified against the primary transcript this session — see access_failures.) |
| corroborating_url | https://en.wikipedia.org/wiki/Bernard_Widrow |
| corroborating_tier | 4 |
| corroborating_note | Wikipedia's biography states Widrow was unable to train multilayered neural networks and turned to adaptive filtering/signal processing, and that "[a]t a 1985 conference in Snowbird, Utah, he noticed that neural network research was returning, and he also learned of the backpropagation algorithm," after which he returned to neural-network research. Wikipedia cites this to Widrow & Lehr (1990), "30 years of adaptive neural networks," Proc. IEEE 78(9):1415-1442 — the Tier 1 paper listed above that could not be read directly this session. |

---

## Claim: The furthest Widrow's group got in the 1960s was Madaline Rule I (1962) — only the first of two layers was trainable, the second was fixed

**Claim type:** Technical-mechanism (specific architectural claim).

Multiple convergent sources describe Madaline Rule I (MRI), devised around 1961–1962, as "the earliest learning rule for feedforward networks with multiple adaptive elements," with two weight layers where "the first was trainable, but the second was fixed." This is presented consistently as the ceiling of what Widrow's group achieved on multilayer training before backpropagation reached them in 1985 — i.e., not a true multilayer training algorithm in the modern sense, but a single trainable layer feeding a fixed downstream logic layer.

**Sourcing floor check:** This is a specific technical-mechanism claim, which the rubric requires to reach Tier 1–2. The strongest source obtained this session for it is search-engine synthesis over multiple pages (functionally Tier 4 — an aggregator layer, not a named author on their own venue) plus Wikipedia (Tier 4). The primary source that should carry this claim — Widrow & Lehr (1990), which is explicitly about the history of Madaline Rule I/II and backpropagation, and which Widrow co-authored — exists, resolves, and downloads, but is a scanned PDF this session's tooling could not read (extract_pdf failed on a missing `pdfinfo` binary; WebFetch returned unreadable binary content). **This claim is therefore marked `[unverified-mechanism — needs primary]`**: it is very likely correct given how consistently multiple independent summaries converge on the identical "first layer trainable, second fixed" description, but it has not been confirmed against Widrow's own primary-source wording in this session.

| Field | Value |
|---|---|
| source_url | (aggregator synthesis over multiple pages; no single Tier 1-2 page read directly this session) |
| source_tier | 4 (aggregator) — flagged, does not independently clear the floor |
| status | [unverified-mechanism — needs primary: Widrow & Lehr 1990, Proc. IEEE 78(9):1415-1442, or Widrow & Angell 1962, "Reliable, Trainable Networks for Computing and Control," Aerospace Engineering] |

---

## Claim: Two Widrow papers from exactly the 1965–1966 window exist and are bibliographically confirmed, but their specific relationship to "the abandoned multilayer-training attempt" was not verified this session

**Claim type:** Historical (bibliographic) / technical-mechanism (unresolved).

Two real, locatable Widrow publications fall inside the 1965–1966 window named in the research question:

1. Karl Steinbuch and Bernard Widrow, "A Critical Comparison of Two Kinds of Adaptive Classification Networks," *IEEE Transactions on Electronic Computers*, EC-14(5):737-740, October 1965 (originally a Stanford Electronics Laboratories technical report, December 1964). Secondary summaries describe its content as comparing the structures of the "Learning Matrix" and Madaline.
2. Bernard Widrow, "Bootstrap Learning in Threshold Logic Systems," presented at the 3rd International Congress of IFAC (American Automatic Control Council, Theory Committee), London, June 1966.

Both PDFs were located at Widrow's own Stanford ISL publications page and confirmed to resolve (they download successfully), which supports their existence and venue as historical/bibliographic facts (Tier 1, since the host is the author's own institutional page). **However, neither PDF's text content could be read this session** (both are scanned images; extract_pdf failed on the missing `pdfinfo` dependency, and WebFetch returned unreadable binary content for both). This session therefore cannot confirm whether either paper specifically documents an attempt at — and abandonment of — multilayer network training, as opposed to being about adjacent but distinct topics (e.g., comparing existing single/two-layer architectures, or a "bootstrap" heuristic for threshold-logic learning that may or may not have been an explicit multilayer-training attempt).

**Sourcing floor check:** The bibliographic facts (titles, venues, dates) are Tier 1 by origin (author's own hosted publications page, cross-checked against an independent IEEE Xplore record for the 1965 paper) and are recorded as confirmed. The *interpretive* claim that these two papers constitute "the 1965–1966 multilayer-training attempt" referenced in the research question is **not** confirmed and is marked `[unverified-mechanism — needs primary: read the actual paper text]`.

| Field | Value |
|---|---|
| source_url | https://isl.stanford.edu/~widrow/papers/j1965acritical.pdf |
| source_author | Karl Steinbuch and Bernard Widrow |
| source_date | 1965-10 |
| source_tier | 1 (existence/venue only — content unread) |
| corroborating_url | https://ieeexplore.ieee.org/document/4038566/ |
| status | [unverified-mechanism — needs primary: full text unread] |
| source_url_2 | https://isl.stanford.edu/~widrow/papers/c1966bootstraplearning.pdf |
| source_author_2 | Bernard Widrow |
| source_date_2 | 1966-06 |
| source_tier_2 | 1 (existence/venue only — content unread) |
| status_2 | [unverified-mechanism — needs primary: full text unread] |

---

## What primary sources exist to document this effort (bibliographic answer to the second half of the question)

The research question asks specifically what primary sources — papers, interviews, or lab reports — document Widrow's multilayer-training effort. The following primary sources were located and bibliographically confirmed to exist and to be on-topic, but **could not be read in full text this session** for the reasons in `access_failures` above:

- **Widrow, B. and Lehr, M.A. (1990).** "30 Years of Adaptive Neural Networks: Perceptron, Madaline, and Backpropagation." *Proceedings of the IEEE*, 78(9):1415-1442. Widrow's own co-authored retrospective history — the single most likely primary source to state plainly, in his own words, what was attempted in the 1960s and why it failed. URL confirmed live: https://isl.stanford.edu/~widrow/papers/j199030years.pdf (scanned PDF, unreadable this session).
- **Widrow, oral history interview by Andrew Goldstein**, IEEE History Center, conducted 1997-03-14. Hosted at https://ethw.org/Oral-History:Bernard_Widrow (blocked, HTTP 403 on all access paths tried).
- **Magoun, A.B. (2014).** "A Nonrandom Walk Down Memory Lane With Bernard Widrow" [Scanning Our Past]. *Proceedings of the IEEE*, 102(10):1622-1629. An edited oral-history profile from the IEEE History Center. Confirmed to exist via IEEE Xplore (https://ieeexplore.ieee.org/document/6899790/) and mirrored on ResearchGate/academia.edu (both 403'd this session).
- ***Talking Nets: An Oral History of Neural Networks*** (James A. Anderson and Edward Rosenfeld, eds., MIT Press, 1998/2000), chapter attributed to Widrow ("Ancient History"). Access-restricted on the Internet Archive (borrow-only); not read this session.
- **Widrow, B. (2023).** "Ancient History" (chapter). In *Cybernetics 2.0: A General Theory of Adaptivity and Homeostasis in the Brain and in the Body*, pp. 277-307. Springer. Widrow's own autobiographical chapter in his own late-career book — a strong Tier 1 candidate, but not accessed this session (behind Springer's paywall; not attempted directly given the pattern of 403s elsewhere).
- **Widrow, B. (2000-ish, "Perceptrons, Adalines, and Backpropagation").** Widrow's own entry in *The Handbook of Brain Theory and Neural Networks*, mirrored at https://ccs.fau.edu/~bressler/EDU/CompNeuro/Resources/Widrow_HBTNN_Perceptrons.htm — a promising Tier 1 candidate (author is Widrow himself) that could not be fetched due to a redirect loop.

None of these were fabricated or inferred — each was located via a live search result and its bibliographic details (author, venue, year, page range) cross-checked across at least two independent listings (e.g., IEEE Xplore plus a mirror). What's missing is the actual text, which this session's tooling could not extract.

---

## Further leads

- Re-attempt the scanned Widrow PDFs with a working OCR path (the `extract_pdf` tool needs `pdfinfo`/poppler-utils available in the environment — this looks like an environment configuration gap worth flagging to Cali/tooling-todo, not a research dead end).
- Try institutional/library proxy access to *Talking Nets* (1998/2000) and to the Springer-hosted *Cybernetics 2.0* (2023) chapter "Ancient History" — both are named, on-topic, Widrow's-own-words primary sources that this session could not reach.
- Try a different fetch path for https://ethw.org/Oral-History:Bernard_Widrow (e.g., a text-only proxy other than r.jina.ai, which returned 401 this session) — this transcript is very likely to contain a direct, quotable, first-person account of the specific years and reasons for abandonment.
- If the 1965 (Steinbuch & Widrow) and 1966 (Widrow, "Bootstrap Learning") papers are ever read directly, confirm or refute whether either is actually "the" attempt referenced by the 1965–1966 framing in the source question — this session could not establish that link beyond date-coincidence.
- Cross-check against Rosenblatt/Minsky-Papert-adjacent captures already in the vault on the credit-assignment problem (this capture was harvested from that question) — Widrow's abandoned attempt is a natural companion data point to the Perceptrons (1969) stall narrative already being built out (see 2026-06-30-why-did-neural-network-research-stall-between-the-1969-perceptrons-book-and-the-mid-1980s-revival.md).

> [!note] Seek's commentary:
> The headline "yes, he tried and gave up" is solid — it's about as uncontested a piece of AI history as exists, repeated identically across every source touched this session. What's genuinely unresolved is the precision the question asks for: *specifically* 1965–1966, and *specifically* which primary document shows it. Every promising primary source for that precision is a scanned PDF or a 403 wall in this environment, which is a frustrating but honest place to stop. Worth naming plainly: the two 1965/1966 papers that exist by date-coincidence are tempting to cite as "the" attempt, but citing them that way without reading them would be exactly the silent-mechanism-promotion the sourcing floor exists to prevent. Better to flag the gap than paper over it with a plausible-sounding footnote.