October 8, 2026 · x.com
LMCache reuses KV cache across GPU, CPU and disk
On January 30, 2026, the description of the open-source LMCache project presented an LLM-serving extension that reuses KV states across GPUs, CPUs and local disks, including repeated text chunks beyond prefixes.