A high-throughput and memory-efficient inference and serving engine for LLMs
其他人工智能更新于 2026-10-25
其他人工智能Apache-2.0
Repository dossier
tenstorrent/tt-metal
:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
Brief / README 摘要
查看原文*TT-NN** is a Python & C++ Neural Network OP library. API Reference | Model Demos The Models team is focused on developing the following models, optimizing them for performance, accuracy, and compatibility. Follow each model link for more details. For a full model list see the Model Matrix, or visit the Developer Hub. Performance Metrics: - Time to First Token (TTFT) measures the time (in milliseconds) it takes to generate the first output token after input is received. - T/S/U (Tokens per Second per User): Represents the throughput of first-token generation after prefill. It is calculated as…
Topics / 标签
01
浏览全部相关推荐
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
其他人工智能更新于 2026-10-25
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
其他人工智能更新于 2026-10-24
An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.
其他人工智能更新于 2026-10-25
VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.
其他人工智能更新于 2026-10-25
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf
其他人工智能更新于 2026-10-22