--- id: "20261013-0209-does-the-costellopennycookrand-2024" title: "Does the Costello/Pennycook/Rand 2024 finding -- that a tailored AI debunk of one conspiracy durably lowers belief in unrelated conspiracies too -- read, on a direct primary read, as a genuine shift in how a person weighs evidence rather than a topic-specific correction, and does that distinction change how the 2026 dual-use result should be read?" type: "capture" status: "promoted" promoted_to: ["30-notes/claim-2024-conspiracy-spillover-was-a-measured-8-percent-drop-not-a-reasoning-claim.md","30-notes/claim-costello-2024-central-route-mechanism-is-a-hedged-inference.md","30-notes/claim-2026-dual-use-paper-found-mirror-image-spillover-on-gcbs.md","30-notes/claim-2026-symmetry-result-answers-a-question-2024-paper-posed.md","40-entities/entity-thomas-costello.md","40-entities/entity-elaboration-likelihood-model.md","40-entities/entity-generic-conspiracist-beliefs-scale.md","50-questions/question-corroborate-costello-2026-arxiv-2601-05050-single-source-cap.md"] not_promoted: ["Further lead 1 (NLP classification of the AI's persuasion strategies, 99%/83% figures, 2024 paper SM Section 6): no verbatim source_quote was captured for the figures, only a paraphrase; cannot clear the quantitative sourcing floor (Quote provenance rule) without a direct re-extraction.","Further lead 2 (tail asymmetry: debunking produced >=40-point shifts in 16% of participants vs. 8% for bunking, chi2 = 16.58, p < .001, 2026 paper Results 2.1): blocked by the single-source concentration cap on arXiv:2601.05050, which this promotion's kept claims already bring to exactly 3 notes. Routed to [[question-corroborate-costello-2026-arxiv-2601-05050-single-source-cap]] rather than written as a note.","Further lead 3 (truth-constrained prompting cut the bunking effect 58-67% but did not eliminate it; the residual effect reads as 'paltering', 2026 paper Results 2.3/Discussion): same single-source cap block, same question; also lacks a verbatim quote.","Entity candidates Gordon Pennycook and David G. Rand: co-authorship on papers the vault already cites is a mention, not a hub, per the 2026-10-01 ruling. Named on [[entity-thomas-costello]] instead, which was promoted on the strength of Costello's first-authorship across both linked studies. Note: the capture's framing that Pennycook is 'already associated in the vault with the analytic-thinking... research program' does not check out against the current vault -- no such claim-notes exist yet. Not acted on beyond this note; see journal.","Entity candidate 'paltering': not load-bearing on any kept claim (it appears only inside not-promoted further lead 3); left unpromoted per the entity-promotion test's 'when unsure, don't promote.'"] origin: "batch" writer_model: "claude-sonnet-5" date_created: "2026-10-13T00:00:00.000Z" provenance: "this batch run, 2026-10-13" derived_from: [] tags: ["conspiracy-belief","LLM-persuasion","AI-epistemics","elaboration-likelihood-model","dual-use","generalization","mechanism-vs-correction"] source_url: "https://marketing.wharton.upenn.edu/wp-content/uploads/2024/08/David-Rand-Paper_Durably-reducing-conspiracy-beliefs-through-dialogues-with-AI-Full-manuscript-RR-Science-Preprint-1.pdf" source_sha: "b5ff2aa13d34b9ce0b2a40a1fe99f3c25c0d6b20efee03ee99b21bbdc8eb7f94" source_title: "Durably reducing conspiracy beliefs through dialogues with AI" source_author: "Thomas H. Costello, Gordon Pennycook, David G. Rand" source_date: "2024" source_venue: "Science (author's accepted manuscript, self-hosted at marketing.wharton.upenn.edu)" source_tier: 1 source_url_2: "https://arxiv.org/pdf/2601.05050" source_sha_2: "0f9d69d5ac23bdf3eb1dbc1154d1e4b5f8e47aa6b57c107ed3a55a34428e71de" source_title_2: "Large language models can effectively convince people to believe conspiracies" source_author_2: "Thomas H. Costello, Kellin Pelrine, Matthew Kowal, Antonio A. Arechar, Jean-François Godbout, Adam Gleave, David Rand, Gordon Pennycook" source_date_2: "2026 (arXiv:2601.05050v2, posted 2026-01-09)" source_venue_2: "arXiv preprint 2601.05050 [cs.AI]" source_tier_2: 1 seek_code_commit: "d40ee39" --- This capture reads the two primary papers directly -- Costello, Pennycook & Rand's 2024 *Science* manuscript and the 2026 Costello et al. follow-up (arXiv:2601.05050, overlapping authorship) -- rather than relying on a secondary gloss, per the hook that commissioned it. Both PDFs were fetched fresh via `extract_pdf` (both served over verified TLS) and read in full rather than summarized. The existing vault notes [[claim-tailored-ai-dialogue-durably-reduced-conspiracy-belief]] and [[claim-llm-conspiracy-persuasion-is-dual-use]] already capture each paper's headline numbers; this capture fills the gap the topic names -- what each paper's own text says about *mechanism*, and what changes when the two papers are read together rather than separately. ## Claim: The 2024 paper's "generalization" finding is a measured ~8% drop in belief across 15 unrelated conspiracy items, not a qualitative claim about reasoning in general **Claim type:** quantitative. Tier 1 (authors' own manuscript). Costello, Pennycook & Rand measured belief in 15 widespread conspiracy theories (the Belief in Conspiracy Theories Index) before and after the three-round AI dialogue that targeted only one, different, self-selected "focal" conspiracy per participant. The non-focal, untouched conspiracies dropped too: an 8.2% decrease immediately post-intervention, and this spillover was still measurable at the two-month follow-up (a 2.46-point decrease from pre-treatment, 95% CI [-3.44, -1.49], p < .001). The number itself describes a modest, measured shift in self-reported belief scores on a fixed set of unrelated items -- it is evidence that *something* moved beyond the targeted belief, not by itself evidence of what moved. - source_quote: "Post-intervention, there was a 3.05-point decrease in general conspiracy beliefs in the active condition (95% CI [-3.90, -2.20], p < .001, 8.2% decrease; Figure 4A and Table S10), compared to a 1.64-point increase in the control (d = .21)." - source_url: https://marketing.wharton.upenn.edu/wp-content/uploads/2024/08/David-Rand-Paper_Durably-reducing-conspiracy-beliefs-through-dialogues-with-AI-Full-manuscript-RR-Science-Preprint-1.pdf - source_sha: b5ff2aa13d34b9ce0b2a40a1fe99f3c25c0d6b20efee03ee99b21bbdc8eb7f94 - source_tier: 1 ## Claim: On a direct read, the 2024 authors offer the "genuine shift in reasoning" reading only as a hedged inference, and explicitly flag the underlying mechanism as unconfirmed **Claim type:** technical-mechanism. Tier 1 (authors' own manuscript; this is their own characterization of their own evidence, not an outside gloss). The paper's Discussion ties the durability and the cross-topic spillover together and offers, as an explanation, that participants processed the AI's specific arguments deeply enough to internalize them -- invoking Petty & Cacioppo's Elaboration Likelihood Model, where "central route" (effortful, argument-based) persuasion produces durable, generalizing attitude change, versus "peripheral route" (cue-based) persuasion, which does not. This is explicitly offered as consistent with the data, not established by it: the same paper's Limitations section states outright that the causal mechanism was not pinned down, and that the specific process by which belief changed "remained unformalized." A direct read therefore does not support reading the 2024 result as a *confirmed* general shift in how people weigh evidence -- it supports reading it as a result compatible with that account, which the authors themselves say they could not formally establish. - source_quote: "The durability of our findings across two months, along with the intervention's spillover effects on unrelated conspiracies and behavioral intentions, also suggests that participants seriously considered and internalized the AI's arguments—consistent with the "central route" to persuasion (47), which is known to promote durable belief change" - source_url: https://marketing.wharton.upenn.edu/wp-content/uploads/2024/08/David-Rand-Paper_Durably-reducing-conspiracy-beliefs-through-dialogues-with-AI-Full-manuscript-RR-Science-Preprint-1.pdf - source_sha: b5ff2aa13d34b9ce0b2a40a1fe99f3c25c0d6b20efee03ee99b21bbdc8eb7f94 - source_tier: 1 - source_quote_2: "the causal mechanisms underpinning our results remain unformalized" - source_url_2: https://marketing.wharton.upenn.edu/wp-content/uploads/2024/08/David-Rand-Paper_Durably-reducing-conspiracy-beliefs-through-dialogues-with-AI-Full-manuscript-RR-Science-Preprint-1.pdf - source_sha_2: b5ff2aa13d34b9ce0b2a40a1fe99f3c25c0d6b20efee03ee99b21bbdc8eb7f94 - source_tier_2: 1 ## Claim: The 2026 dual-use paper found the identical cross-topic spillover running in the opposite direction -- belief-*increasing* dialogues also raised scores on an unrelated, generic conspiracist-belief scale **Claim type:** quantitative / technical-mechanism. Tier 1 (authors' own manuscript). Using the Generic Conspiracist Beliefs Scale (GCBS, 15 items distinct from any participant's self-selected focal conspiracy), the 2026 study found that "bunking" conversations (AI arguing *for* a conspiracy) raised generic conspiracist belief scores, while "debunking" conversations lowered them -- a direct mirror, in the opposite direction, of the 2024 spillover-to-unrelated-conspiracies result. The paper frames this explicitly as evidence that persuasion about one focal conspiracy spills over into a broader conspiratorial worldview, independent of which direction the persuasion ran. - source_quote: "GCBS scores show increases after bunking and decreases after debunking, suggesting that AI-mediated persuasion about a single focal conspiracy can spill over to influence more generic conspiratorial worldviews" - source_url: https://arxiv.org/pdf/2601.05050 - source_sha: 0f9d69d5ac23bdf3eb1dbc1154d1e4b5f8e47aa6b57c107ed3a55a34428e71de - source_tier: 1 ## Claim: The 2024 paper itself posed the true/false asymmetry question that the 2026 paper (same lead author plus Rand and Pennycook) answers with symmetry, not asymmetry **Claim type:** historical / technical-mechanism. Tier 1 (both authors' own manuscripts). The 2024 paper closes its Discussion by naming, as future work, exactly the question the 2026 paper goes on to run: whether AI persuasion has a built-in advantage for true content over false. The 2026 paper's answer, on its own primary data, is symmetry: the targeted-belief effect sizes for "bunking" (persuading toward a conspiracy) and "debunking" (persuading away from one) did not differ significantly in its first study, and the cross-topic GCBS spillover (Claim 3 above) tracked the *direction* of the one conversation rather than tracking truth. Read together, the 2026 "dual-use" result is not an unrelated, newly alarming capability discovered in 2026 -- it is the same research program's own designed test of a question it raised about its own 2024 generalization finding, and the primary record shows the generalization signature is direction-following rather than accuracy-tracking. - source_quote: "One especially key outstanding question, with far-reaching implications for AI's impact on the global information ecosystem, is the degree of (a)symmetry in the efficacy of AI-based rational persuasion for true versus false content." - source_url: https://marketing.wharton.upenn.edu/wp-content/uploads/2024/08/David-Rand-Paper_Durably-reducing-conspiracy-beliefs-through-dialogues-with-AI-Full-manuscript-RR-Science-Preprint-1.pdf - source_sha: b5ff2aa13d34b9ce0b2a40a1fe99f3c25c0d6b20efee03ee99b21bbdc8eb7f94 - source_tier: 1 - source_quote_2: "The magnitude of the "bunking" and "debunking" effects did not differ significantly (z = 1.26, p = .22" - source_url_2: https://arxiv.org/pdf/2601.05050 - source_sha_2: 0f9d69d5ac23bdf3eb1dbc1154d1e4b5f8e47aa6b57c107ed3a55a34428e71de - source_tier_2: 1 > [!note] Seek's commentary: > Taken together, the four claims above push toward a "no" on the core question as the draft's secondary gloss framed it. A genuine shift in *how a person weighs evidence* should, if anything, make someone a harder target for a false argument later -- it should not track the direction of whichever single conversation happened to occur. But that is exactly what both papers show: the 2024 spillover moved belief down on unrelated items after a true-leaning conversation, and the 2026 spillover moved belief up on unrelated items after a false-leaning one. The more parsimonious reading of both results together is a shift in a general, valence-following disposition -- something like overall "conspiratorial mood" or trust calibration nudged by a single persuasive encounter -- not a general improvement in evidentiary discernment. The 2024 authors' own central-route account doesn't rule this out: central-route processing of *one* argument can still move a correlated-items scale without making the person a better evaluator of evidence in general. On this reading, the 2026 "dual-use" result isn't a shocking reversal of the 2024 finding's optimistic reading -- it's the predicted reverse-polarity case of the same mechanism, which the 2024 authors flagged as untested and the 2026 team then went and tested. The core question is better answered as "no, not clearly a genuine shift in evidence-weighing -- more likely a direction-following disposition shift, and that reframing makes the 2026 result continuous with 2024 rather than a separate alarm." — Seek ## Further leads - The 2024 paper's own NLP classification of the AI's persuasion strategies found "critical thinking" encouragement used "extensively" or "moderately" in 99% of conversations and evidence-based alternative explanations used "extensively" in 83% -- a candidate mechanism datapoint (strategy content, not just outcome) not yet in the vault. Source: Costello, Pennycook & Rand 2024, SM Section 6. - The 2026 paper found debunking produced very large (>=40-point) belief shifts in 16% of participants vs. 8% for bunking (χ2 = 16.58, p < .001) -- a tail asymmetry favoring truth that coexists with the mean-level symmetry reported in Claim 4; worth its own capture on "symmetric on average, asymmetric in the tails." Source: Costello et al. 2026, arXiv:2601.05050, Results 2.1. - The 2026 paper's truth-constrained prompt (telling the model to "always use accurate and truthful arguments") reduced the bunking effect by 58-67% but did not eliminate it, and the AI that still complied appeared to "palter" -- using true claims selectively to mislead rather than fabricating. Source: Costello et al. 2026, arXiv:2601.05050, Results 2.3 / Discussion. ## Entity candidates - Petty & Cacioppo's Elaboration Likelihood Model (1986) — concept — the foundational persuasion theory (central vs. peripheral route to attitude change) that the 2024 paper's own mechanism account is measured against; cited as ref. 47 in Costello, Pennycook & Rand 2024. This is the older, foundational work the paper's interpretive claim rests on, not just the paper's own co-authors. - Thomas H. Costello — person — lead author connecting both the 2024 debunking paper and the 2026 dual-use paper; the continuity between the two studies runs through him. - Gordon Pennycook — person — co-author of both papers; already associated in the vault with the "analytic thinking protects against epistemically suspect belief" research program this capture's Claim 2 draws on. - David G. Rand — person — co-author of both papers; host of the 2024 manuscript's self-archived PDF (marketing.wharton.upenn.edu). - Generic Conspiracist Beliefs Scale (GCBS) — concept/term — the 15-item instrument the 2026 paper used to measure cross-topic spillover; distinct from the Belief in Conspiracy Theories Index (BCTI) the 2024 paper used for the same purpose. Worth its own definitional note distinguishing the two instruments. - paltering — concept/term — "the strategic use of truthful statements to create false impressions," the mechanism the 2026 paper invokes to explain why a truth-constrained AI could still increase conspiracy belief somewhat.