$ vishctl get notes -l topic=lmcache

#lmcache

1 note

Pixel art cache vault reusing stored memory blocks across three GPU servers

Why LMCache Exists: Stop Making GPUs Read the Same Context Again

An example-driven guide to LMCache: repeated prefill, KV cache reuse, CPU offloading, multi-replica serving, and where caching actually helps.