vLLM

2 notes carry this tag — 2 claims. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

Modern LLM-serving systems reimport OS memory-pressure vocabulary intact — vLLM preempts and recomputes KV cache, and llm-d names cache-eviction churn 'cache thrashing'

claim seedling Tier 1 2026-07-12 · LLM, inference, KV-cache, vLLM, llm-d
PagedAttention manages the LLM KV cache with a literal port of OS virtual-memory paging — blocks as pages, tokens as bytes, requests as processes

claim seedling Tier 1 2026-07-12 · LLM, inference, KV-cache, PagedAttention, vLLM