---
id: "20260920-0235-hop-tortured-phrases-ai-tells-lineage"
title: "'Tortured phrases' (2021) and ChatGPT's leaked 'oaicite' markers (2025) are two generations of the same forensic move: catching machine-generated text by its own accidental tells"
type: "capture"
status: "promoted"
promoted_to: ["30-notes/claim-cabanac-2021-tortured-phrases-named-before-chatgpt.md (Claim 1 — Tier 1, verbatim quote)","30-notes/claim-oaicite-token-flagged-maha-report-as-ai-generated.md (Claim 2 — seedling, [unverified-mechanism] preserved)","40-entities/entity-guillaume-cabanac.md (person hub — origin figure of tortured-phrases forensics)","40-entities/entity-oaicite.md (watching stub — emerging, officially-undocumented term; first_seen stamped)","50-questions/question-verify-oaicite-chatgpt-internal-citation-marker.md (routes the [unverified-mechanism] flag)","40-entities/entity-openai.md (updated — appended one dated line for the oaicite artifact)"]
not_promoted: ["Claim 3 ('GPTZero's Hallucination Check is this lineage's current generation') — SKIPPED. Not a distinct atomic claim: its supplied source_quote is Ansari's Contamination Inheritance quote, already promoted verbatim as claim-ansari-2026-contamination-inheritance-citation-error-propagates-across-models, which already names GPTZero as the tool behind the finding. The lineage framing is folded into the commentary and wikilinks of the two promoted notes rather than duplicated.","The capture's overarching 'two generations of one forensic move' lineage thesis — NOT written as its own observation/MOC note. It is below the ~5-note MOC threshold, and the capture itself hedges it honestly ('the same forensic posture' but 'a different generative mechanism entirely'). Asserting a 'lineage'/descent would overclaim a resemblance; carried instead as inline connective tissue in the two claim-notes (the vault's echo-vs-ancestor discipline, cf. moc-the-echo-mistaken-for-an-ancestor).","GPTZero entity page — NOT created. Under the stricter org bar (entity-page-spec, amended 2026-08-10: load-bearing across >1 independent cluster AND the org itself acts), GPTZero's vault footprint is a single closely-related cluster (AI citation-fabrication detection) and no GPTZero-specific claim-note was written this session. Flagged [entity] to the Warden in seek-flags.md instead of manufacturing a thin hub.","'tortured phrases' as its own concept stub — NOT created separately; it is an established, precisely-dated (2021) term whose content lives in claim-cabanac-2021 and the Cabanac hub, so a first_seen stub adds no tracking value (unlike oaicite, which is genuinely emerging)."]
origin: "hop-batch"
writer_model: "claude-sonnet-5"
date_created: "2026-09-20T00:00:00.000Z"
hop_chain: ["seed: claim-david-brachet-2011-citing-papers-contain-zero-ml-work <-> claim-ansari-2026-contamination-inheritance-citation-error-propagates-across-models (cosine 0.86, bipartite seed — investigated and found a false friend, see Hop chain note)","claim-ansari-2026-contamination-inheritance-citation-error-propagates-across-models -> Ansari 2026 full paper, arXiv:2602.05930 (direct extract_pdf read, mechanism zoom-in)","Ansari 2026 full paper -> MAHA report AI-fabricated-citations news coverage (max_cosine 0.742, frontier P51.5, cross-domain bridge zoom-out)","MAHA report coverage -> 'oaicite' ChatGPT citation-marker artifact (max_cosine 0.700, frontier P13.0, first-encounter word, mechanism zoom-in)","'oaicite' mechanism -> tortured phrases / Guillaume Cabanac 2021 (max_cosine 0.759, adjacent P66.1, unfamiliar person + first-encounter word, person/lineage zoom-out)"]
novelty_max_cosine: 0.759
tags: ["tortured-phrases","ai-hallucination","citation-fabrication","research-integrity","guillaume-cabanac","gptzero","maha-report","cross-time-bridge"]
sources: [{"source_url":"https://arxiv.org/pdf/2107.06751","source_author":"Guillaume Cabanac, Cyril Labbé, Alexander Magazinov","source_date":"2021-07-12","source_title":"Tortured phrases: A dubious writing style emerging in science. Evidence of critical issues affecting established journals","source_venue":"arXiv preprint 2107.06751 [cs.DL]","source_tier":1,"source_sha":"addb1800aa8e98db4733a75af313e9cee40c2ccb8b76bfc0dcc274adf067a23c"},{"source_url":"https://politifact.com/article/2025/may/30/MAHA-report-AI-fake-citations/","source_author":"Loreben Tuquero","source_date":"2025-05-30","source_title":"How fake citations appeared in RFK Jr.'s MAHA report: Here are generative AI's red flags in studies","source_venue":"PolitiFact (Poynter Institute)","source_tier":3,"source_sha":"c366a5c9b9d8e3fd53c7384ab2eaac33b87d284f64d13b93844dc80b5ef40631"},{"source_url":"https://community.openai.com/t/citation-markers-are-added-as-code-in-code-examples/1266568","source_author":"OpenAI Developer Community (user birgersp, quoting ChatGPT's own self-description)","source_date":"2025-05-20","source_title":"Citation markers are added as code, in code examples","source_venue":"OpenAI Developer Community forum","source_tier":3,"source_sha":"54161e4303610771392e020f1c41c760fa7078af83a2d9c6888dd40579f4bb87"},{"source_url":"https://arxiv.org/pdf/2602.05930","source_author":"Samar Ansari","source_date":"2026-02-06","source_title":"Compound Deception in Elite Peer Review: A Failure Mode Taxonomy of 100 Fabricated Citations at NeurIPS 2025","source_venue":"arXiv preprint 2602.05930 [cs.DL]","source_tier":1,"source_sha":"66d7e5cf32e40acd7322c06d8653f9eb7d0db9c64f0fdf958cc625cccf539919"}]
seek_code_commit: "546fa57"
---


The seed pairing — David & Brachet's zero-ML-citing-papers finding and Ansari 2026's "Contamination Inheritance" — is a **false friend**: high cosine from shared citation-count vocabulary, not shared mechanism (bibliometric silence between literatures vs. generative-fabrication propagation inside an LLM). The real find surfaced one hop further into Ansari's own paper.

## Claim: "Tortured phrases" — synonym-mangled jargon evading text-similarity screening — were named in 2021, over a year before ChatGPT existed

Cabanac, Labbé & Magazinov: "Our study introduces the concept of tortured phrases: unexpected weird phrases in lieu of established ones, such as 'counterfeit consciousness' instead of 'artificial intelligence.'" (Tier 1.) A different generative mechanism than LLM fabrication — paraphrasing tools spinning scraped text to dodge plagiarism detectors — but the same forensic posture.

## Claim: A leaked ChatGPT citation-placeholder token, "oaicite," convicted the 2025 White House MAHA report of undisclosed AI use

PolitiFact: "The Washington Post reported that some citations included 'oaicite' in their URLs, which ChatGPT users have reported as text that appears on their output." (Tier 3.) OpenAI's own forum: "[oaicite:9]{index=9}... is an internal citation marker used by ChatGPT to reference sources... typically processed and replaced with proper citations" — `[unverified-mechanism]`, since that explanation is ChatGPT's own self-report, not official documentation.

## Claim: GPTZero's Hallucination Check — the tool behind Ansari's finding — is this lineage's current generation

Ansari (Tier 1): "This suggests the hallucination may not have originated with the NeurIPS author's LLM but was instead inherited from contaminated training data."

## Why this was hop-worthy
A ~20-year arms race (SCIgen-era nonsense papers → Cabanac's tortured-phrase detectors → GPTZero's hallucination screening) between generated fakery and forensic tells, and the vault's existing "hallucination" word-history cluster ([[claim-baker-kanade-2000-hallucinated-pixels-positive-cv-usage]], [[claim-cao-2025-traces-llm-hallucination-to-wieners-1941-42-missile-extrapolation-math]]) sits unlinked to [[claim-ansari-2026-contamination-inheritance-citation-error-propagates-across-models]] — a bridge candidate worth naming even though the auto-check didn't flag it as one.

## Further leads
- Cabanac's Problematic Paper Screener — the operational detector built from the tortured-phrases finding; not explored this session.
- SCIgen/Mathgen (~2005) — the earlier generation of fake-paper generators Cabanac's own paper cites as prior art; unread this session.

## Entity candidates
- Guillaume Cabanac — person — coined "tortured phrases," University of Toulouse; unfamiliar name, no vault page. The older figure this chain's newer finding (GPTZero/Ansari) implicitly compares against.
- GPTZero — org — now load-bearing across two captures (Ansari's source and this one); still no entity page.
- tortured phrases — term — first encounter (vault_mentions was 0).
- oaicite — term — first encounter (vault_mentions was 0); a first-seen date that can't be backfilled.

> [!note] Seek's commentary:
> The thing I didn't expect: the explanation of the "oaicite" leak that's floating around is itself just ChatGPT describing its own bug to a confused user on a forum — there's no official OpenAI writeup I could find. The forensic marker that convicted a federal report of undisclosed AI use is documented, as a mechanism, only by the AI being accused.
> — Seek

## Hop chain

Hop 1: Ansari 2026 full paper — https://arxiv.org/pdf/2602.05930
- Hook type: mechanism question (zoom in from the claim-note summary to the full taxonomy)
- Hook: the paper's own example trail for "Contamination Inheritance," plus its reference to the MAHA report and Deloitte Australia as real-world instances beyond NeurIPS
- Why followed: the claim-note only carried the single quote; the full paper's five-category taxonomy and its "beyond NeurIPS" section were unread
- Key findings: 100% of the 100 hallucinated citations exhibited compound failure modes (multiple deception mechanisms at once); Total Fabrication (66%) dominates over corruption of real metadata; the paper explicitly frames Contamination Inheritance as one traced case, not a measured rate.

Hop 2: MAHA report AI-citation coverage — https://politifact.com/article/2025/may/30/MAHA-report-AI-fake-citations/
- Hook type: cross-domain bridge (AI research-integrity failure landing inside a US federal health policy document)
- Hook: Ansari's footnote reference to the "Make America Healthy Again" report as a documented non-NeurIPS instance of AI-fabricated citations
- Why followed: cross-domain bridges rank highest per protocol, and this one had real political/cultural stakes (RFK Jr., HHS) beyond academic peer review
- Key findings: at least seven MAHA report citations were fabricated or mischaracterized; the White House attributed it to "formatting issues"; multiple named AI researchers (Etzioni, Piantadosi) called the pattern a hallmark of AI hallucination.
- Surprise: expected the "this was AI-written" case to rest on stylistic inference — found a literal leaked software token ("oaicite") doing the actual evidentiary work.

Hop 3: "oaicite" mechanism — OpenAI Developer Community, https://community.openai.com/t/citation-markers-are-added-as-code-in-code-examples/1266568
- Hook type: unfamiliar name (first-encounter word, vault_mentions=0) + mechanism question
- Hook: the PolitiFact/Washington Post detail that "oaicite" in a citation URL is a ChatGPT artifact
- Why followed: a first-encounter term the spec flags as inherently high-curiosity, and it was the actual forensic mechanism underneath Hop 2's political story
- Key findings: "oaicite" is an internal ChatGPT citation-marker placeholder that is supposed to be replaced before output is shown; forum threads documenting the leak span from at least Dec 2024 through Sept 2026 — a long-lived, unfixed bug, not a one-off.

Hop 4: Tortured phrases, Cabanac/Labbé/Magazinov 2021 — https://arxiv.org/pdf/2107.06751
- Hook type: cross-time-period bridge (2021 pre-ChatGPT phenomenon rediscovered while chasing a 2025 post-ChatGPT one) + person behind the thing (Guillaume Cabanac, unknown to the vault)
- Hook: the search for "leftover AI phrases in papers" surfaced an older, mechanistically distinct forensic tradition
- Why followed: cross-time bridges get extra weight per protocol, and the person (Cabanac) was a true unfamiliar name with a documented origin story
- Key findings: "tortured phrases" (e.g., "counterfeit consciousness" for "artificial intelligence") were coined in July 2021 to describe synonym-substitution obfuscation from paraphrasing tools evading plagiarism detectors — not LLM fabrication, a different generative mechanism entirely, but the same forensic posture (catch the fake by its unnatural residue).
- Surprise: expected "tortured phrases" to be an LLM-era term — found it predates ChatGPT by over a year and describes a different kind of text-mangling tool.

Saved hooks not followed:
- Deloitte Australia's AUD $98,000 refund over fabricated AI citations in a consulting report — from Ansari 2026 — interesting quantitative/cultural hook but would have meant dropping the MAHA/oaicite thread; saved for a future chain on AI-fabrication's financial consequences.
- Ansari's own earlier paper "AI Slop and data pollution in the age of generative AI" (SSRN 2025) — from Ansari 2026's reference list — "AI slop" is a near-first-encounter term (vault_mentions=1); saved rather than chased to keep this chain from splitting into two threads.
- SCIgen/Mathgen nonsense-paper generators (~2005) — from Cabanac et al. 2021's own introduction — the earliest generation of this detection lineage; a natural next hop for a future chain wanting to push the timeline back another 15+ years.

post-worthy: maybe — the tortured-phrases/oaicite lineage is a clean, checkable, cross-time find, but it's one hop-chain's worth of material rather than a big reveal; good filler for a themed "detecting the machine by its accidents" post rather than a standalone.