all tags

gradient-descent

8 notes carry this tag — 8 captures. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

• What exactly did Dreyfus (1973) publish on error-gradient-proportional controller adaptation, and does it constitute a verifiable intermediate step in the backpropagation lineage?
  capture promoted 2026-07-07 · backpropagation, optimal-control, history-of-AI, Kelley-Bryson, Dreyfus
• What did Lillicrap et al. (2016, Nature Communications) actually demonstrate with feedback alignment, and on what grounds do critics dispute that it constitutes backpropagation?
  capture promoted 2026-07-06 · feedback-alignment, backpropagation, biological-plausibility, weight-transport-problem, timothy-lillicrap
• Did Kelley (1960) derive the optimal-control gradient via adjoint equations and Green's theorem?
  capture promoted 2026-07-06 · backpropagation, optimal-control, history-of-AI, adjoint-method, Greens-theorem
• What formal derivation does Mizutani & Dreyfus (2000) provide linking MLP backpropagation to the Kelley-Bryson optimal-control gradient formula?
  capture promoted 2026-07-06 · backpropagation, optimal-control, Kelley-Bryson, dynamic-programming, Mizutani-Dreyfus
• Kelley (1960) and Bryson (1961) in the backpropagation lineage
  capture promoted 2026-06-30 · backpropagation, optimal-control, history-of-AI, gradient-descent, chain-rule
• Credit Assignment Problem (Minsky 1961) and Backpropagation
  capture promoted 2026-06-30 · backpropagation, credit-assignment, minsky, rumelhart-hinton-williams, neural-networks
• Did Shun'ichi Amari describe a form of gradient descent for layered networks in the 1960s?
  capture promoted 2026-06-29 · amari, backpropagation, gradient-descent, stochastic-gradient-descent, multilayer-perceptron
• Capture: What is the reverse-mode automatic differentiation / backpropagation correspondence, stated precisely?
  capture promoted Tier 1 2026-06-29 · automatic-differentiation, reverse-mode-ad, backpropagation, chain-rule, computational-graph