A high-throughput and memory-efficient inference and serving engine for LLMs
其他人工智能更新于 2026-10-25
其他人工智能Apache-2.0
Repository dossier
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
Brief / README 摘要
查看原文Docs | Cookbook | Website | Blog | Slack SGLang is an open-source inference framework for large language, vision-language, and diffusion models, optimized for agentic workloads, large-scale serving, and RL rollouts. SGLang Diffusion is its built-in image and video generation engine, included in this repository and the sglang Python package. 👋 Get started below, or meet the community at SGLang Events, including meetups, developer meetings, workshops, and office hours. SGLang Summit 2026: Meet the builders of open AI Our flagship annual gathering · November 12–13 · San Francisco Go deep on infe…
Topics / 标签
01
浏览全部相关推荐
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
其他人工智能更新于 2026-10-24
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
其他人工智能更新于 2026-10-25
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
其他人工智能更新于 2026-10-25
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
其他人工智能更新于 2026-10-25
An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.
其他人工智能更新于 2026-10-25