---
title: "CoDA (arXiv:2610.22362) has hit the single-source cap at three claim-notes — what independently corroborates its co-evolution architecture and its reported OOD success numbers?"
type: "question"
status: "open"
date_raised: "2026-10-19T00:00:00.000Z"
tags: ["single-source-cap","corroboration","robotics","vision-language-action","generative-simulation","arxiv"]
---


As of this promotion (2026-10-19), three claim-notes rest on CoDA (Yu, Ou,
Shen, Li, Liu, Susladkar, Wang & Lourentzou, "CoDA: Co-Evolution of Data
Engines and Action Policies," arXiv:2610.22362, 2026) — an unrefereed
eight-author preprint from one research group (UIUC / CUHK-Shenzhen /
Amazon):

- [[claim-coda-shared-memory-couples-data-engine-policy-optimality-preserving-reward-shaping]]
- [[claim-coda-co-evolution-raises-ood-manipulation-success-beyond-baselines-and-on-libero-pro]]
- [[claim-coda-append-only-episodic-memory-fifth-non-citing-instance-of-record-verdict-separated-log]]

That is the single-source concentration cap (`sources.md`, Cali 2026-07-29:
no more than three claim-notes may rest on a single unrefereed primary
until at least one independent source corroborates it). No independent
source — different author group, different venue — has yet confirmed any
of this preprint's claims.

**Findings deliberately left in the capture rather than promoted**, because
of the cap:

- The memory-reuse transfer result: reusing memory collected under the
  π0.5 backbone raises a different policy backbone, OpenVLA-OFT, from 3.8%
  to 21.1% OOD success without generating any additional environment
  (abstract / §4, "Transfer across tasks and policies").
- The critic-choice ablation: swapping the diagnosing vision-language
  critic from GPT-5.5 to Claude Opus 5, InternVL3-78B, or Qwen3-VL-235B
  lowers OOD success from 27.6% to 26.1%, 25.7%, and 24.9% respectively,
  though all four still beat a success-rate-guided baseline (18.1%) by at
  least 6.8 points (Table 3).

**The specific verification.** Two things would need to land before this
branch can grow past three notes or go evergreen:

1. **Independent corroboration of CoDA's architecture or results** — a
   different author group, different venue, either reproducing the
   co-evolution loop's reported OOD gains or applying the same
   append-only-memory-plus-critic-diagnosis shape independently. The
   project website (plan-lab.github.io/coda) may eventually host code or
   follow-up results; not checked this session.
2. **A direct read of the external comparison points CoDA cites but this
   session did not fetch** — LIBERO-Pro (Zhou, Xu et al., arXiv:2510.03827,
   2025) and ASPIRE (Lu, Wu, Kou et al., arXiv:2607.00272, 2026) — to
   confirm CoDA's self-reported baseline numbers (25%→84%, 1%→76%, the
   7-and-9-point margin over ASPIRE) against those papers' own published
   figures rather than CoDA's citation of them.

**Why it matters.** The cap exists because the failure mode is invisible
one note at a time: each note here is correctly sourced, correctly
seedling — while the branch as a whole could quietly read as corroborated
just because it is large, and because the specific numbers (25%→84%,
1%→76%) are exactly clean enough to invite uncritical repetition.
Corroboration discharges the cap (record it in the notes' `audit_status`);
contradiction is the more interesting finding and a note in its own right.

**Progress, 2026-10-20** (partial — question stays open). Item 2 above is
now attempted: this session independently fetched and read POET
(arXiv:1901.01753), LIBERO-Pro (arXiv:2510.03827), and ASPIRE
(arXiv:2607.00272) directly rather than relying on CoDA's citations of them.
Result is a mixed, genuine partial answer, not a discharge:

- **Architecture/lineage** — POET's own text confirms the mechanism CoDA's
  related-work clause describes it as ("coevolves agents and parameterized
  environments"). This corroborates only that one-clause lineage reference,
  not CoDA's own implementation. ([[claim-poet-text-confirms-coevolution-mechanism-coda-cites-as-related-work]])
- **LIBERO-Pro existence** — confirmed real, correctly described, unrelated
  author group. Its specific 25%/1%/84%/76% numbers could not be located or
  quote-checked in the paper's own extracted text (dense figure/caption
  layout defeated extraction around the numeric results).
  ([[claim-libero-pro-paper-confirms-benchmark-but-not-coda-percentages]])
- **ASPIRE existence** — confirmed real, evaluates the same three LIBERO-Pro
  suites, qualitatively consistent "strongest on Object" pattern. Its own
  text reports results on "Pos"/"Task" axes, not CoDA's "position"/
  "instruction" framing, and nothing in it confirms or disconfirms CoDA's
  specific 7-and-9-point margin. ([[claim-aspire-paper-confirms-suite-pattern-not-coda-margins]])

**Still open — item 1 (independent corroboration of CoDA's own architecture
or numbers) remains fully unresolved**, and item 2's numeric half remains
`[unverified-quant — needs primary]` on both LIBERO-Pro and ASPIRE — not
because the papers are inaccessible, but because this session's text
extraction could not reliably recover numbers that live in figures/tables.
A future session with image-based table reading, or a session that reads
LIBERO-Pro's and ASPIRE's appendices specifically, could attempt the
reconciliation directly. No paper citing CoDA (arXiv:2610.22362) was found
as of 2026-10-20 — consistent with the preprint being five days old, not
evidence either way. Never force closure on this one; the cap stays in
place until a genuine independent confirmation or contradiction lands.
