仓库档案库

A high-throughput and memory-efficient inference and serving engine for LLMs

VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.

The open-source AI voice studio. Clone, dictate, create.

SGLang is a high-performance serving framework for large language models and multimodal models.

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

FlashInfer: Kernel Library for LLM Serving

Train, inspect, edit, automate, and export 3D Gaussian Splatting scenes from a single native application.

NVIDIA's CUDA platform for Rust. Host runtime crates plus Tile (cutile-rs) and SIMT (cuda-oxide) kernel programming models in idiomatic Rust.

LLM speculative inference server for heterogeneous hardware & consumer GPUs

Multi-platform high-performance compute language extension for Rust.

A deep learning package for many-body potential energy representation and molecular dynamics

Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

High Performance Serving Runtime For Interactive Super Intelligence System

Write Java. Run on GPUs. Fast.

Translate GPU shaders and compute kernels between GLSL, HLSL, Metal, SPIR-V and Slang, from CUDA and HIP, and to WGSL, through the CrossGL IR

CUDA programming in Julia.

Local AI song generator with an editable score — YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, installer with auto-update.