CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
Repository dossier
ai-dynamo/dynamo
A Datacenter Scale Distributed Inference Serving Framework
Brief / README 摘要
查看原文*The open-source, datacenter-scale inference stack.** Dynamo is the orchestration layer above inference engines — it doesn't replace SGLang, TensorRT-LLM, or vLLM, it turns them into a coordinated multi-node inference system. Disaggregated serving, intelligent routing, multi-tier KV caching, and automatic scaling work together to maximize throughput and minimize latency for LLM, reasoning, multimodal, and video generation workloads. Built in Rust for performance, Python for extensibility. Events are updated automatically. Subscribe to our public calendar. You're serving LLMs across multiple GP…
Topics / 标签
相关推荐
A cross-platform desktop All-in-One assistant for Claude Code, Codex, OpenCode, OpenClaw, Grok Build & Hermes Agent. Only official website: ccswitch.io
Incredibly fast JavaScript runtime, bundler, test runner, and package manager – all in one
Build smaller, faster, and more secure desktop and mobile applications with a web frontend.
Empowering everyone to build reliable and efficient software.