sgl-project/sglang

SGLang is a fast serving framework for large language models and vision language models.

Stars Over Time

30,790 stars by
rSb
PythonApache License 2.0blackwellcudadeepseekdeepseek-r1deepseek-v3deepseek-v3-2gpt-ossinferencekimillamallama3llavallmllm-servingmoeopenaipytorchqwen3transformervlm

Growth

HOT
Last 30 days+924 stars

Owner

Notable Stargazers

Building sgl-project/sglang?

We track who's paying attention — companies, roles, and the developers most likely to contribute or adopt.

Get in touch