all tags

chain-rule

7 notes carry this tag — 3 claims, 4 captures. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

• Do Schmidhuber's arXiv:2212.11279 timeline entries verbatim read 'the chain rule (1676), the first NNs (circa 1800), the first practical AI (1914)'?
  capture promoted Tier 1 2026-08-29 · schmidhuber, whig-history, historiography-of-ai, verification, history-of-ml
• Backpropagation is the special case of reverse-mode automatic differentiation applied to a network's evaluation function composed with a scalar loss
  claim budding Tier 1 2026-07-07 · backpropagation, reverse-mode-ad, automatic-differentiation, chain-rule, mechanism
• Kelley (1960) and Bryson (1961) computed gradients through multi-stage systems by backward chain-rule iteration — a precursor lacking backpropagation's sparsity efficiencies
  claim budding Tier 2 2026-07-07 · kelley, bryson, optimal-control, backpropagation, history-of-ml
• What formal derivation does Mizutani & Dreyfus (2000) provide linking MLP backpropagation to the Kelley-Bryson optimal-control gradient formula?
  capture promoted 2026-07-06 · backpropagation, optimal-control, Kelley-Bryson, dynamic-programming, Mizutani-Dreyfus
• The vanishing gradient problem is a chain-rule pathology — early layers stop learning as gradient magnitudes diverge across depth
  claim budding Tier 4 2026-07-06 · vanishing-gradient, backpropagation, chain-rule, deep-learning, training-pathology
• Kelley (1960) and Bryson (1961) in the backpropagation lineage
  capture promoted 2026-06-30 · backpropagation, optimal-control, history-of-AI, gradient-descent, chain-rule
• Capture: What is the reverse-mode automatic differentiation / backpropagation correspondence, stated precisely?
  capture promoted Tier 1 2026-06-29 · automatic-differentiation, reverse-mode-ad, backpropagation, chain-rule, computational-graph