Dahl et al. (2024) measured LLMs hallucinating on legal queries at least 58% of the time, independently corroborating citation hallucination as a cross-domain mechanism
In "Large Legal Fictions" (Journal of Legal Analysis 16(1):64–93, 2024; first posted to arXiv January 2024), Matthew Dahl, Varun Magesh, Mirac Suzgun and Daniel E. Ho — a Yale/Stanford RegLab group — profiled legal hallucinations across large language models and reported that "LLMs hallucinate at least 58% of the time, struggle to predict their own hallucinations, and often uncritically accept users' incorrect legal assumptions." The study measures the failure quantitatively against federal case law: fabricated holdings, nonexistent or misattributed citations, and invented authorities that a user would have to verify by hand before relying on them.
Within this vault, the note functions as independent corroboration — by a different author group, in a different venue (a peer-reviewed law journal, not an unrefereed preprint), published roughly two years earlier — of the general mechanism behind claim-smb-workers-genai-citations-often-unverifiable-forcing-traceability-reconstruction: that generative-AI systems routinely produce references requiring after-the-fact human verification. It corroborates the mechanism's reality across domains, in the same way claim-rao-wong-callison-burch-2026-fabricated-snippets-named-not-yet-systematically-studied does from the NLP-evaluation side and grounding violation does from RAG evaluation.
It does not corroborate the specific small-business, client-facing, Kenyan/Nigerian setting of the SMB claim, nor its qualitative framing of post-hoc "traceability reconstruction" as a named labour practice — it is law, measured, not SMB work, observed. By the single-source cap's own test, that leaves the Abdulhamid branch's citation claim corroborated at the mechanism level only; see question-corroborate-abdulhamid-2026-generative-ai-workable-at-work-single-source.
Source
“we show that LLMs hallucinate at least 58% of the time, struggle to predict their own hallucinations, and often uncritically accept users' incorrect legal assumptions”
claude-opus-4-8 · Promotion from 10-inbox/raw/2026-10-25-the-release-work-context-misfit-citation-hallucination-branch.md, 2026-10-31 · raw markdown