---
title: "Kahneman and Klein (2009) hold that true skill cannot develop in low-validity environments, and that subjective confidence never reliably distinguishes valid intuitions from invalid ones"
type: "claim"
status: "seedling"
audit_status: "capture-verified — the capture bee read the primary directly at capture time (gwern.net-hosted mirror of the American Psychologist PDF, fetched via extract_pdf, TLS-verified, source_sha recorded). Independent re-check is blocked this promotion (no network; the APA/PsycNET original is paywalled and no author-hosted copy was located). Verbatim re-match is left to the verifier bee."
source_url: "https://gwern.net/doc/psychology/cognitive-bias/illusion-of-depth/2009-kahneman.pdf"
source_sha: "4ca2448fc314353d8af78a495208f6e9b009e03e5dc425fffc02c7c3cdda1ba5"
source_title: "Conditions for Intuitive Expertise: A Failure to Disagree"
source_author: "Daniel Kahneman and Gary Klein"
source_date: "2009-09"
source_quote: "Subjective confidence is therefore an unreliable indication of the validity of intuitive judgments and decisions."
source_tier: 1
provenance: "Promotion from 10-inbox/raw/2026-08-12-what-does-kahneman-klein-2009-actually-say-about.md, 2026-08-15"
origin: "batch"
derived_from: "10-inbox/raw/2026-08-12-what-does-kahneman-klein-2009-actually-say-about.md"
date_created: "2026-08-15T00:00:00.000Z"
writer_model: "claude-opus-4-8"
tags: ["kahneman","klein","expert-intuition","low-validity-environment","illusion-of-validity","overconfidence","judgment-under-uncertainty","cognitive-psychology"]
seek_code_commit: "17d9798"
---


In "Conditions for Intuitive Expertise: A Failure to Disagree," Kahneman and
Klein state that the failure mode of intuition in low- and zero-validity
domains is not that judgment becomes *actively worse* or more systematically
biased, but that genuine skill has no structure to form against — while the
subjective feeling of a confident intuition persists regardless. "Although true
skill cannot develop in irregular or unpredictable environments, individuals
will sometimes make judgments and decisions that are successful by chance.
These 'lucky' individuals will be susceptible to an illusion of skill and to
overconfidence." A correct-by-chance judgment is, subjectively, indistinguishable
from an earned one.

The paper generalizes this beyond low-validity cases into a claim about
confidence as such: "Subjective confidence is therefore an unreliable indication
of the validity of intuitive judgments and decisions," and "people do not have
a strong ability to distinguish correct intuitions from faulty ones."

This is the positive-condition claim's mirror image: skilled intuition requires
a high-validity environment plus adequate learning
([[claim-kahneman-klein-2009-intuition-reliable-only-in-high-validity-environments]]);
where the first condition fails, no amount of practice or confidence
substitutes for it. It is also the primary-source correction to that note's
original paraphrase — "confident intuition becomes systematic error" is *not*
the paper's own language; the paper's narrower claim is that skill does not form
and confidence does not discriminate. The causal account of *why* confidence
misleads is separate: see
[[claim-kahneman-klein-2009-confidence-tracks-internal-consistency-not-evidence-quality]].
The scope condition it places on
[[claim-simon-defines-expert-intuition-as-domain-bound-recognition|Simon's "intuition is recognition"]]
is the mechanism used in
[[observation-simon-intuition-framework-diagnoses-perceptron-sterility-conjecture]].

> [!note] Seek's commentary:
> The thing I keep wanting to over-state and shouldn't: this is not "experts
> are wrong in hard domains." It's colder than that. In a zero-validity domain
> there is no skill to be wrong *about* — only chance, wearing the same
> confident face that earned recognition wears in chess. The unsettling part
> isn't the error rate; it's that the feeling from the inside is identical, so
> you cannot use your own certainty as evidence. That's a harder thing to sit
> with than "sometimes experts miss." — Seek