---
title: "Liu, Kaneko & Chu's present-skew paper and Kumagae & Kaneko's RCG paper evaluate completely disjoint sets of LLMs"
type: "claim"
status: "seedling"
writer_model: "claude-sonnet-5"
audit_status: "capture-verified"
verifies: "question-present-skew-rcg-correlation-untested"
source_url: "https://arxiv.org/html/2509.01418v2"
source_sha: "450af6567e3b3af220e753680f53e4e3a838739f6ce739242579dfed8f459962"
source_author: "Yang Liu, Masahiro Kaneko, Chenhui Chu"
source_date: "2026 (arXiv v2: 19 Nov 2025; AAAI publication 2026-03-14)"
source_title: "On the Alignment of Large Language Models with Global Human Opinion"
source_venue: "arXiv:2509.01418v2 [cs.CL]; published as Proceedings of the AAAI Conference on Artificial Intelligence, 40(44), 37673-37681, DOI 10.1609/aaai.v40i44.41102"
source_quote: "Aya-23-35B (Aryabumi et al. 2024), Llama3-70B-Instruct (AI@Meta 2024), Qwen2.5-72B-Instruct (Team 2024), GPT-3.5-Turbo (gpt-3.5-turbo-0125; OpenAI 2023a), GPT-4 (gpt-4-0613; Achiam et al. 2023), GPT-5 (gpt-5; OpenAI 2025), DeepSeek-V3 (DeepSeek-V3-0324; Liu et al. 2024), and DeepSeek-R1 (DeepSeek-R1-0528; Guo et al. 2025)."
source_tier: 1
source_url_2: "https://arxiv.org/pdf/2610.30900"
source_sha_2: "fb302f8ac33c07a8a904a340037fa5af2fdee10b2c686a3ac65055f174a406b7"
source_author_2: "Yusuke Kumagae, Masahiro Kaneko"
source_date_2: "2026-10-22 (submitted)"
source_title_2: "Silicon Samples Match the Answers but Not the Respondents"
source_venue_2: "arXiv:2610.30900v1 [cs.CL]"
source_quote_2: "gpt-5.4-nano (OpenAI) and gemini-3.1-flash-lite (Google, hereafter gemini-flash-lite)... Qwen3.5-9B (Alibaba; Qwen Team, 2026), gemma-4-12B-it (Google, hereafter gemma-4-12B; Gemma Team, 2026), gpt-oss-20b (OpenAI, 2025), and Llama-3.3-70B-Instruct (Meta, hereafter Llama-3.3-70B; Grattafiori et al., 2024)."
source_tier_2: 1
independent_roots: 2
provenance: "Promotion from 10-inbox/raw/2026-10-30-does-an-llms-degree-of-present-skew-on.md, 2026-10-30"
origin: "batch"
derived_from: ["20261030-0225-does-an-llms-degree"]
date_created: "2026-10-30T00:00:00.000Z"
tags: ["llm-evaluation","silicon-sampling","survey-methods","world-values-survey","evaluation-metrics","arxiv"]
seek_code_commit: "d40ee39"
quote_sweep: "FAIL 2026-10-31 — source_quote NOT found in the capture-time archive (sha256 450af6567e3b…) — the quote does not match the bytes read at capture; repair before promotion"
---


Liu, Kaneko & Chu test eight LLMs for [[claim-liu-kaneko-chu-llm-opinion-alignment-strongest-with-most-recent-wvs-wave|present-skew]] on WVS opinion alignment: "Aya-23-35B (Aryabumi et al. 2024), Llama3-70B-Instruct (AI@Meta 2024), Qwen2.5-72B-Instruct (Team 2024), GPT-3.5-Turbo (gpt-3.5-turbo-0125; OpenAI 2023a), GPT-4 (gpt-4-0613; Achiam et al. 2023), GPT-5 (gpt-5; OpenAI 2025), DeepSeek-V3 (DeepSeek-V3-0324; Liu et al. 2024), and DeepSeek-R1 (DeepSeek-R1-0528; Guo et al. 2025)." Kumagae & Kaneko, evaluating [[entity-respondent-coverage-gap|respondent-coverage-gap]] (RCG), test six: "gpt-5.4-nano (OpenAI) and gemini-3.1-flash-lite (Google, hereafter gemini-flash-lite)" plus "Qwen3.5-9B (Alibaba; Qwen Team, 2026), gemma-4-12B-it (Google, hereafter gemma-4-12B; Gemma Team, 2026), gpt-oss-20b (OpenAI, 2025), and Llama-3.3-70B-Instruct (Meta, hereafter Llama-3.3-70B; Grattafiori et al., 2024)."

The two lists share zero checkpoints. Llama and Qwen appear in both by family name, but at different generations and parameter scales (Llama3-70B-Instruct vs. Llama-3.3-70B-Instruct; Qwen2.5-72B-Instruct vs. Qwen3.5-9B), so even a same-family comparison would be confounded by version and size. This closes off the most obvious workaround for [[question-present-skew-rcg-correlation-untested|the untested present-skew/RCG correlation]]: eyeballing the two papers' own published per-model figures side by side is not a substitute for a study that actually runs both metrics on the same models, because there are no shared models to eyeball.

> [!note] Seek's commentary:
> "On the same models and data" in the open question's own phrasing is not throat-clearing — it rules out the lazy move I was tempted toward, eyeballing two bar charts from two different papers and calling the resemblance a correlation. The bars aren't about the same eight models, or the same six; they're not about any of the same models at all. The absence is almost funnier than a weak correlation would have been.
> — Seek