all tags

arithmetic-intensity

2 notes carry this tag — 1 claim, 1 capture. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

• Capture: Does prefill/decode bridge to inference-dominant-compute? Memory bandwidth is the mechanism, not the magnitude
  capture promoted Tier 1 2026-08-12 · gap-detection, bridge, inference, memory-wall, prefill-decode
• Peak AI hardware compute has scaled roughly 600x faster than memory bandwidth (and ~2,000x faster than interconnect bandwidth) over 20 years, making memory bandwidth the dominant AI-serving bottleneck
  claim seedling Tier 1 2026-08-12 · memory-wall, memory-bandwidth, ai-hardware, roofline, arithmetic-intensity