all tags

gpu-utilization

2 notes carry this tag — 1 claim, 1 capture. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

• Capture: Does prefill/decode bridge to inference-dominant-compute? Memory bandwidth is the mechanism, not the magnitude
  capture promoted Tier 1 2026-08-12 · gap-detection, bridge, inference, memory-wall, prefill-decode
• Because decode underutilizes GPU compute and power while prefill does not, LLM-inference services over-provision GPU hardware and cloud providers build additional datacenter capacity to meet the resulting demand
  claim seedling Tier 1 2026-08-12 · gpu-utilization, datacenter, power-wall, splitwise, inference-serving