Daryani et al. (2026) independently reproduces ChronoCulture's result that LLMs track the direction of a cultural shift better than its magnitude — understating how far cultures moved while recovering which way

llm-evaluationcultural-awarenessworld-values-surveycorroborationinglehart-welzelarxiv

ChronoCulture reports, from a per-question Wasserstein-distance statistic, that its six tested LLMs track the direction of a cultural shift better than its magnitude, with a median magnitude ratio (model shift ÷ human shift) below 1 that falls further as the real shift grows. Daryani, Bogen & Daepp reach the same decomposition from an independently chosen measure — net displacement on the Inglehart–Welzel cultural map rather than per-question distance — across four models (Claude, Gemini, GPT, Qwen).

On magnitude, among the ten countries with a clear directional path in the WVS record, every model captured only part of the observed change, with median model-to-human ratios of 0.45 (Claude), 0.56 (Gemini), 0.58 (GPT), and 0.68 (Qwen) — all below 1, the same shortfall ChronoCulture names. The understatement runs alongside its mirror image: movement also appeared where little was observed in the survey data, so models added spurious change in countries the survey showed as largely stable while missing most of the change in the countries that actually moved.

On direction, the same models did markedly better: median direction agreement ran from 0.71 to 0.89, and the angle between a model's movement and a country's actual movement was under 90° (the same general direction) for 83–92% of countries, falling to 50–69% under the stricter 45° criterion. Direction recovered far more reliably than exact magnitude — the identical asymmetry ChronoCulture reports from a differently built statistic, which is why this is corroboration by a second, independent method rather than a restatement (see observation-daryani-independently-corroborates-chronoculture-discharging-single-source-cap). This note sources only the Daryani side of the agreement, so it carries independent_roots: 1; the corroborated ChronoCulture finding itself now rests on two.