Widely used AI-text detectors misclassify non-native English writing as AI-generated at high rates, undermining attempts to re-verify human effort

Liang, Yuksekgonul, Mao, Wu, and Zou tested seven widely used GPT-text detectors against 91 human-authored TOEFL essays (written by non-native English speakers) and 88 US 8th-grade essays (written by native speakers). The detectors performed near-perfectly on the native-writer essays but "misclassified over half of the TOEFL essays as 'AI-generated' (average false positive rate: 61.22%)," and all seven detectors unanimously misflagged nearly 20% of genuinely human-written TOEFL essays. Simple prompting strategies that added linguistic variety to genuinely AI-generated text also evaded detection, cutting effectiveness on the other side of the ledger too.

This is a specific technical-mechanism finding — how detection tools actually perform, not merely that they exist — about why institutions cannot cheaply re-impose the cost of proving writing is human-produced once generative AI drove that production cost near zero. It bears directly on credentials, admissions essays, and any writing used as proof of a person's own effort: see claim-generative-ai-availability-compresses-university-grade-distributions for the university-grading side of the same problem, and claim-llm-collapse-of-costly-writing-signal-cuts-meritocratic-hiring for the hiring-market side.

In the vocabulary of claim-szabo-bit-gold-grounds-value-in-unforgeable-cost-of-production, detection tools are an attempted furnace-repair: an effort to re-manufacture unforgeable costliness after the original cost floor collapsed. This finding shows that repair itself is leaky, and leaky in a way that penalizes exactly the writers — non-native speakers — least able to absorb a false accusation of dishonesty.