bentoml
OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
Stars
12,523
Forks
838
Language
Python
Licence
Apache-2.0
Created 19 Apr 2023Last push 31 Aug 2026
Stars and forks are a snapshot taken when this directory was last refreshed, not a live count — the figure here matches the one in our articles and videos. Last refreshed 1 Sept 2026.