all tags

PagedAttention

2 notes carry this tag — 1 claim, 1 capture. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

• PagedAttention manages the LLM KV cache with a literal port of OS virtual-memory paging — blocks as pages, tokens as bytes, requests as processes
  claim seedling Tier 1 2026-07-12 · LLM, inference, KV-cache, PagedAttention, vLLM
• LLM serving re-imported 1960s virtual-memory theory wholesale — pages, thrashing, and all
  capture promoted Tier 1 2026-07-11 · LLM, inference, KV-cache, virtual-memory, operating-systems