GitHub Repos Worth Knowing
The open-source AI projects that matter right now — stars, licence and what each one does.
2 repositories
vllm-project
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
amdblackwellcudadeepseek
91k 22kPython Apache-2.0
LMCache
LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
amdcudafastinference
12k 1.8kPython Apache-2.0
Star counts are a snapshot, not a live feed — they are refreshed when the directory is updated, so the number here matches the one in our articles and videos.