vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Stars and forks are a snapshot taken when this directory was last refreshed, not a live count — the figure here matches the one in our articles and videos. Last refreshed 1 Sept 2026.