dual-control-theory

6 notes carry this tag — 4 claims, 2 captures. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

What do A.A. Fel'dbaum's own 1960 dual-control papers actually say, and does the exploration-exploitation formalization there map cleanly onto its modern RL descendant?

capture promoted 2026-09-15 · feldbaum, dual-control-theory, reinforcement-learning, exploration-exploitation, bayesian-reinforcement-learning
Fel'dbaum's own exact Bayesian dynamic-programming solution to dual control is one he himself flagged as impractical beyond small examples, confirmed by two independent later sources

claim seedling Tier 1 2026-09-15 · feldbaum, dual-control-theory, dynamic-programming, bayesian-reinforcement-learning, control-theory
Fel'dbaum's own 1960 dual control papers decompose control risk into an additive "risk of action" and "risk of study"

claim seedling Tier 1 2026-09-15 · feldbaum, dual-control-theory, exploration-exploitation, control-theory, history-of-science
Mainstream RL's exploration algorithms trace to an independent 1933 bandit lineage, not to Fel'dbaum's dual control theory; his formalism maps cleanly only onto Bayesian reinforcement learning

claim seedling Tier 1 2026-09-15 · feldbaum, dual-control-theory, reinforcement-learning, bayesian-reinforcement-learning, multi-armed-bandit
A.A. Fel'dbaum — Song Jian's Soviet control-theory teacher — originated the mathematical ancestor of reinforcement learning's exploration-exploitation tradeoff

capture promoted Tier 1 2026-08-30 · cybernetics, control-theory, dual-control-theory, reinforcement-learning, exploration-exploitation
A.A. Fel'dbaum's early-1960s dual control theory was the first mathematical formalization of the exploration-exploitation tradeoff

claim seedling Tier 1 2026-08-30 · feldbaum, dual-control-theory, reinforcement-learning, exploration-exploitation, control-theory