跳到主要内容
GitStars
登录
其他人工智能NOASSERTION

Repository dossier

ai-dynamo/dynamo

A Datacenter Scale Distributed Inference Serving Framework

Brief / README 摘要

查看原文

*The open-source, datacenter-scale inference stack.** Dynamo is the orchestration layer above inference engines — it doesn't replace SGLang, TensorRT-LLM, or vLLM, it turns them into a coordinated multi-node inference system. Disaggregated serving, intelligent routing, multi-tier KV caching, and automatic scaling work together to maximize throughput and minimize latency for LLM, reasoning, multimodal, and video generation workloads. Built in Rust for performance, Python for extensibility. Events are updated automatically. Subscribe to our public calendar. You're serving LLMs across multiple GP…

Topics / 标签

01

相关推荐

浏览全部
01
rtk-ai/rtk★ 84.5kRust

CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies

其他人工智能更新于 2026-10-25
02
farion1231/cc-switch★ 148.5kRust

A cross-platform desktop All-in-One assistant for Claude Code, Codex, OpenCode, OpenClaw, Grok Build & Hermes Agent. Only official website: ccswitch.io

其他人工智能更新于 2026-10-25
03
oven-sh/bun★ 96.4kRust

Incredibly fast JavaScript runtime, bundler, test runner, and package manager – all in one

其他前端更新于 2026-10-25
04
denoland/deno★ 108.8kRust

A modern runtime for JavaScript and TypeScript.

其他其他更新于 2026-10-25
05
tauri-apps/tauri★ 112.2kRust

Build smaller, faster, and more secure desktop and mobile applications with a web frontend.

其他前端更新于 2026-10-25
06
rust-lang/rust★ 120.8kRust

Empowering everyone to build reliable and efficient software.

其他其他更新于 2026-10-25