仓库档案库

ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.

FlashInfer: Kernel Library for LLM Serving

NVIDIA's CUDA platform for Rust. Host runtime crates plus Tile (cutile-rs) and SIMT (cuda-oxide) kernel programming models in idiomatic Rust.

Low-Latency Accelerated Web Remote Desktop Streaming Platform for Self-Hosting, Containers, Kubernetes, or Cloud/HPC

Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

Nvidia GPU exporter for prometheus using nvidia-smi binary OR using NVML

Write Java. Run on GPUs. Fast.