Did Kelley (1960) derive the optimal-control gradient via adjoint equations and Green's theorem?
Topic question (harvested from): 2026-06-30-what-role-did-kelley-1960-and-bryson-1961-optimal-control-work-play-in-the-backprop-lineage — that capture flagged the Kelley-adjoint/Green's-theorem vs. Bryson-Lagrange-multiplier distinction as [unverified-mechanism — needs primary] because the primary AIAA text wasn't directly readable in that session. This capture chases that lead down and resolves it.
Related notes: claim-kelley-bryson-optimal-control-precursor · adjoint-method · Greens-theorem · backpropagation-gap · chain-rule
Access note on the primary source
The literal URL given in the topic, https://arc.aiaa.org/doi/10.2514/8.5282, is the correct DOI landing page for Kelley's paper — confirmed by web search indexing it under the exact title "Gradient Theory of Optimal Flight Paths | ARS Journal." Direct automated fetch of that AIAA-hosted page returned HTTP 403 (publisher anti-bot gate), so the full text was retrieved via a mirror: https://gwern.net/doc/statistics/decision/1960-kelley.pdf. Every page of that PDF carries the footer stamp "Downloaded by UNIVERSITY OF CALIFORNIA – DAVIS ... http://arc.aiaa.org | DOI: 10.2514/8.5282" — i.e. it is a direct download of the AIAA-hosted article itself, not a paraphrase or reconstruction, and its DOI matches the topic's target URL exactly. Treated as Tier 1 primary source on that basis.
Claim: Kelley (1960) derives the gradient of the flight-path performance functional by relating influence (Green's) functions of the linearized system to solutions of an adjoint system of equations, via an explicit application of Green's theorem
Claim type: Specific technical-mechanism claim → floor Tier 1–2 required.
Kelley, H. J., "Gradient Theory of Optimal Flight Paths," ARS Journal, Vol. 30, No. 10 (October 1960), pp. 947–954 (presented at the ARS Semi-Annual Meeting, May 9–12, 1960, Los Angeles; author affiliation Grumman Aircraft Engineering Corp., Bethpage, N.Y.).
The paper's section "Computation of the Functions μm" states directly (exact quote, p. 948):
"The following development relates the functions μm(τ, tf − τ) to solutions of a system of equations adjoint to the system [3] through an application of Green's theorem. The scheme employed is due to Bliss, as reported by Goodman and Lance (22)."
Kelley writes the linearized variational equations [3] in subscript form as Equations [6], then constructs "the system of equations adjoint to this system" (labeled [7], using symbol λ), and states explicitly why he chose that notation (exact quote):
"In the preceding development the choice of symbols λ for the variables of the adjoint system is deliberate, for Equations [7] are precisely those governing the Lagrange multiplier functions of the 'indirect' theory. We note the important distinction, however, that the coefficients of [7] employed in the 'indirect' theory are evaluated along a minimal solution of Equations [1], whereas in gradient computations they correspond to nonminimal paths."
He then integrates the product of the adjoint-system and original-system variations between the two boundary times and states (exact quote, deriving Equation [9]):
"This is the one-dimensional form of Green's theorem (22)."
— reference (22) being Goodman, T. R. and Lance, G. N., "The Numerical Integration of Two-Point Boundary Value Problems," Mathematical Tables and Other Aids to Computation, Vol. 10, No. 54, April 1956.
Finally, in the section "Gradient of P," Kelley identifies the gradient of the performance functional P explicitly in terms of these same influence/Green's functions μm (Equation [30], exact quote):
"[P]φ = Σ(m=1 to n) Cmμm(τ, tf − τ) ... is the gradient of P."
Taken together, the primary text confirms the full mechanism named in the topic question: Kelley computes the gradient needed for his "method of gradients" / steepest-descent flight-path optimization by (1) linearizing the system equations into a variational system, (2) constructing the system adjoint to it, (3) relating the original system's Green's/influence functions to solutions of that adjoint system through an explicit, named application of Green's theorem, and (4) expressing the final gradient of P directly in terms of those adjoint-derived Green's functions.
Sourcing: Tier 1 (primary source, direct-quoted text from the actual published paper). ✓ clears floor for technical-mechanism claim.
Corroborating claim: Dreyfus (1990), in his own historical/technical account, independently confirms Kelley's method was adjoint equations + Green's theorem (contrasted with Bryson's Lagrange multipliers)
Claim type: Historical / technical-mechanism claim → floor Tier 1–2 required (mechanism); source is a named author's own peer-reviewed account.
Dreyfus, S., "Artificial Neural Networks, Back Propagation, and the Kelley-Bryson Gradient Procedure," Journal of Guidance, Control, and Dynamics, 13(5):926–928, 1990 (DOI 10.2514/3.25422). Full text retrieved via mirror https://gwern.net/doc/ai/nn/1990-dreyfus.pdf (each page stamped with the matching AIAA DOI, same verification logic as above).
Exact quote (p. 927, section "Solution by Back Propagation — Kelley-Bryson Gradient Method"):
"Kelley used adjoint equations and Green's theorem in his derivation, and Bryson used Lagrange multipliers."
This independently corroborates, in a different author's own words and in a peer-reviewed venue, the same mechanism directly demonstrated in Kelley's own 1960 text above. Dreyfus's account also situates the paper in the backprop lineage:
"The gradient-solution procedure for optimal control problems was developed by Kelley in 1960 and, independently, by Bryson at about the same time... Though neural-net researchers have come to recognize that multistage feedforward nets fit into the optimal control theory mold and that BP is a gradient procedure, proper credit for the BP method of solution has not been accorded to Kelley and Bryson."
Sourcing: Tier 1 (named author, own published account, peer-reviewed venue, direct quote). ✓ clears floor.
Note — resolves prior flag: The 2026-06-30 capture (harvested-from note) recorded this same Dreyfus PDF as inaccessible for direct quotation ("PDF compressed, text not directly quotable" / "compressed-image and not directly quotable from this run") and left the Kelley-adjoint/Bryson-Lagrange distinction marked [unverified-mechanism — needs primary]. This run's extract_pdf fetch of the identical URL produced clean, directly quotable text (pdftotext method, 3 pages). The flag is resolved: both the Kelley mechanism and the Kelley-vs-Bryson contrast are now Tier-1 verified against primary/named-author text.
Overall verdict on the core question
Core question — "Did Kelley (1960) derive the optimal-control gradient via adjoint equations and Green's theorem?" — Confirmed against the primary source. The mechanism is stated explicitly, in those terms (adjoint system, Green's theorem), in Kelley's own 1960 paper, and independently corroborated by Dreyfus's 1990 first-person historical/technical account in a peer-reviewed journal.
One point of precision: Kelley's own text does not use the exact phrase "adjoint equations" as a fixed term — he writes of "a system of equations adjoint to the system [3]" and "the variables of the adjoint system" — but this is the same concept, and Dreyfus's 1990 paper does use the exact phrase "adjoint equations" to characterize it. No tension between the two sources; noted only for phrasing precision.
Further leads
- Bryson's own 1961 paper ("A Gradient Method for Optimizing Multi-Stage Allocation Processes," Harvard University Symposium on Digital Computers and Their Applications, April 1961) has not yet been retrieved in full text in this run; the Lagrange-multiplier characterization currently rests on Dreyfus's (1990) secondary description of Bryson's method, not on Bryson's primary text. Worth a follow-up capture parallel to this one.
- Mizutani and Dreyfus, "On derivation of MLP backpropagation from the Kelley-Bryson optimal-control gradient formula," IJCNN 2000 (https://ieor.berkeley.edu/wp-content/uploads/2019/03/ijcnn2k.pdf) gives a formal modern re-derivation explicitly bridging Kelley's adjoint/Green's-theorem apparatus to MLP backpropagation notation — worth extracting for a synthesis note once this claim and the Bryson-side claim are both promoted.
- Goodman, T. R. and Lance, G. N. (1956), "The Numerical Integration of Two-Point Boundary Value Problems" — the reference (22) Kelley cites for the specific "one-dimensional form of Green's theorem" and for the adjoint-system computational scheme (attributed by Kelley to Bliss). Not retrieved in this run; would be the ultimate primary source for the Green's-theorem mechanism itself, one level behind Kelley's paper.