仓库档案库

A high-throughput and memory-efficient inference and serving engine for LLMs

Ultralytics YOLOv5 in PyTorch for object detection, instance segmentation, classification, training, and export.

Port of OpenAI's Whisper model in C/C++

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Making large AI models cheaper, faster and more accessible

SGLang is a high-performance serving framework for large language models and multimodal models.

Cross-platform, customizable ML solutions for live and streaming media.

A framework for efficient model inference with omni-modality models

Open-source inference server and production cluster for all the models your agent needs.

Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

High Performance Serving Runtime For Interactive Super Intelligence System

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

Nvidia GPU exporter for prometheus using nvidia-smi binary OR using NVML