LMCache/LMCache — stars, licence and what it does

LMCache

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

View on GitHub Website

Stars

11,601

Forks

1,826

Language

Python

Licence

Apache-2.0

amd cuda fast inference kv-cache llm pytorch rocm

Created 28 May 2024Last push 1 Sept 2026

Stars and forks are a snapshot taken when this directory was last refreshed, not a live count — the figure here matches the one in our articles and videos. Last refreshed 1 Sept 2026.