A high-throughput and memory-efficient inference and serving engine for LLMs
Repository dossier
SemiAnalysisAI/InferenceX
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
Brief / README 摘要
查看原文Trusted by Operators of Trillion Dollar Token Factories such as OpenAI, Meta, Microsoft, Oracle, etc, & ML Community such as PyTorch Foundation, vLLM, SGLang, Tri Dao [2026/09] DeepSeek V4.1 Flash: added AgentX benchmarks dashboard [2026/08] Qwen3.8-Flash-Next: added AgentX benchmarks with native multi-token prediction (MTP) dashboard [2026/08] 🔥 AgentX: World's First Fully Open Source Apache 2.0 Realistic 1Mil+ Long Context, Multi Turn Benchmark Live dashboard [2026/08] 🔥 GLM5.3: continuous agentic benchmarks live too dashboard [2026/07] 🔥 Kimi K3 2.8T: continuous benchmarks live since Day…
Topics / 标签
相关推荐
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.
VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.