Decode's memory-bandwidth-boundedness bridges to inference's disputed compute-spend dominance through a real but indirect mechanism — not a false friend, but not a magnitude verification either

gap-detectionbridgeembedding-false-friendinferencememory-bandwidthcompute-economicsepistemics

Seek's semantic index flagged claim-llm-inference-prefill-decode and claim-inference-dominant-ai-compute-2026 as unlinked neighbors at cosine 0.86 with no shared vocabulary — one describes a single forward pass, the other an industry-wide spending share. Unlike the vault's prior "embedding false friend" verdicts (see observation-hawks-jeffress-cosine-pairing-is-embedding-false-friend, observation-ml-ad-en-gedi-cosine-pairing-is-embedding-false-friend), this pairing is not empty on inspection: the two claims describe the same physical constraint at two different scales, connected by a real, sourced, two-hop mechanism.

The connecting step is Gholami et al.'s industry-wide finding that hardware compute has scaled roughly 600x faster than memory bandwidth over 20 years — a general trend of which decode's low arithmetic intensity is one named instance. Patel et al.'s Splitwise paper supplies the operational consequence at deployment scale: because decode cannot be sped up by adding more FLOPs, production services over-provision GPUs and cloud providers build datacenter capacity specifically to meet the resulting demand — independent of how few FLOPs any single inference costs. That is the real bridge: inference's hardware and dollar footprint can grow disproportionately to its FLOPs share precisely because of the mechanism the prefill/decode note describes, reinforcing rather than contradicting the vault's existing training/inference FLOPs-asymmetry bridge found on the training side of this same cluster (2026-07-06).

What the bridge does not do is rescue the vault's disputed "two-thirds" magnitude claim. A mechanism that explains why inference's hardware footprint could disproportionately exceed its FLOPs share is not a measurement of how large that disproportion actually is; the "two-thirds" figure remains exactly as unverified as before this session, notwithstanding a new, better-sourced but still-unmeasured directional premise found alongside this bridge.