CoDA (arXiv:2610.22362) has hit the single-source cap at three claim-notes — what independently corroborates its co-evolution architecture and its reported OOD success numbers?
As of this promotion (2026-10-19), three claim-notes rest on CoDA (Yu, Ou, Shen, Li, Liu, Susladkar, Wang & Lourentzou, "CoDA: Co-Evolution of Data Engines and Action Policies," arXiv:2610.22362, 2026) — an unrefereed eight-author preprint from one research group (UIUC / CUHK-Shenzhen / Amazon):
- claim-coda-shared-memory-couples-data-engine-policy-optimality-preserving-reward-shaping
- claim-coda-co-evolution-raises-ood-manipulation-success-beyond-baselines-and-on-libero-pro
- claim-coda-append-only-episodic-memory-fifth-non-citing-instance-of-record-verdict-separated-log
That is the single-source concentration cap (sources.md, Cali 2026-07-29:
no more than three claim-notes may rest on a single unrefereed primary
until at least one independent source corroborates it). No independent
source — different author group, different venue — has yet confirmed any
of this preprint's claims.
Findings deliberately left in the capture rather than promoted, because of the cap:
- The memory-reuse transfer result: reusing memory collected under the π0.5 backbone raises a different policy backbone, OpenVLA-OFT, from 3.8% to 21.1% OOD success without generating any additional environment (abstract / §4, "Transfer across tasks and policies").
- The critic-choice ablation: swapping the diagnosing vision-language critic from GPT-5.5 to Claude Opus 5, InternVL3-78B, or Qwen3-VL-235B lowers OOD success from 27.6% to 26.1%, 25.7%, and 24.9% respectively, though all four still beat a success-rate-guided baseline (18.1%) by at least 6.8 points (Table 3).
The specific verification. Two things would need to land before this branch can grow past three notes or go evergreen:
- Independent corroboration of CoDA's architecture or results — a different author group, different venue, either reproducing the co-evolution loop's reported OOD gains or applying the same append-only-memory-plus-critic-diagnosis shape independently. The project website (plan-lab.github.io/coda) may eventually host code or follow-up results; not checked this session.
- A direct read of the external comparison points CoDA cites but this session did not fetch — LIBERO-Pro (Zhou, Xu et al., arXiv:2510.03827, 2025) and ASPIRE (Lu, Wu, Kou et al., arXiv:2607.00272, 2026) — to confirm CoDA's self-reported baseline numbers (25%→84%, 1%→76%, the 7-and-9-point margin over ASPIRE) against those papers' own published figures rather than CoDA's citation of them.
Why it matters. The cap exists because the failure mode is invisible
one note at a time: each note here is correctly sourced, correctly
seedling — while the branch as a whole could quietly read as corroborated
just because it is large, and because the specific numbers (25%→84%,
1%→76%) are exactly clean enough to invite uncritical repetition.
Corroboration discharges the cap (record it in the notes' audit_status);
contradiction is the more interesting finding and a note in its own right.
Progress, 2026-10-20 (partial — question stays open). Item 2 above is now attempted: this session independently fetched and read POET (arXiv:1901.01753), LIBERO-Pro (arXiv:2510.03827), and ASPIRE (arXiv:2607.00272) directly rather than relying on CoDA's citations of them. Result is a mixed, genuine partial answer, not a discharge:
- Architecture/lineage — POET's own text confirms the mechanism CoDA's related-work clause describes it as ("coevolves agents and parameterized environments"). This corroborates only that one-clause lineage reference, not CoDA's own implementation. (claim-poet-text-confirms-coevolution-mechanism-coda-cites-as-related-work)
- LIBERO-Pro existence — confirmed real, correctly described, unrelated author group. Its specific 25%/1%/84%/76% numbers could not be located or quote-checked in the paper's own extracted text (dense figure/caption layout defeated extraction around the numeric results). (claim-libero-pro-paper-confirms-benchmark-but-not-coda-percentages)
- ASPIRE existence — confirmed real, evaluates the same three LIBERO-Pro suites, qualitatively consistent "strongest on Object" pattern. Its own text reports results on "Pos"/"Task" axes, not CoDA's "position"/ "instruction" framing, and nothing in it confirms or disconfirms CoDA's specific 7-and-9-point margin. (claim-aspire-paper-confirms-suite-pattern-not-coda-margins)
Still open — item 1 (independent corroboration of CoDA's own architecture
or numbers) remains fully unresolved, and item 2's numeric half remains
[unverified-quant — needs primary] on both LIBERO-Pro and ASPIRE — not
because the papers are inaccessible, but because this session's text
extraction could not reliably recover numbers that live in figures/tables.
A future session with image-based table reading, or a session that reads
LIBERO-Pro's and ASPIRE's appendices specifically, could attempt the
reconciliation directly. No paper citing CoDA (arXiv:2610.22362) was found
as of 2026-10-20 — consistent with the preprint being five days old, not
evidence either way. Never force closure on this one; the cap stays in
place until a genuine independent confirmation or contradiction lands.