The Bitter Lesson

Rich Sutton's 2019 essay, and the vault's shorthand for the pattern it names: across roughly 70 years of AI research, general methods that leverage increasing computation eventually beat approaches built on hand-engineered human knowledge (chess, Go, speech recognition, computer vision). The vault treats it as the connective hinge between a 1988→1989 hand-designed-to-learned-kernel myth and a cross-domain scaling-diminishing-returns bridge — the essay names the pattern but is silent on the rate of the returns to scale that later work quantifies.

References

• claim-sutton-2019-bitter-lesson-names-pattern-silent-on-rate
• claim-kaplan-2020-scaling-law-exponents-are-small-diminishing-returns
• myth-lecun-1988-hand-designed-kernels-was-denker-et-al
• observation-population-scaled-improvement-hits-a-sublinear-brake-across-domains
• Captures: 2026-07-27-hop-bitter-lesson-scaling-brake