bentoml

OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Stars
12,523
Forks
838
Language
Python
Licence
Apache-2.0
Created 19 Apr 2023Last push 31 Aug 2026
Share:

Stars and forks are a snapshot taken when this directory was last refreshed, not a live count — the figure here matches the one in our articles and videos. Last refreshed 1 Sept 2026.