A high-throughput and memory-efficient inference and serving engine for LLMs
02 / Repository index
仓库档案库
按平台、分类、语言与许可组合筛选;每条记录都能回到仓库原文核对。
5 records · filtered
A framework for efficient model inference with omni-modality models
MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.
High Performance Serving Runtime For Interactive Super Intelligence System
Jev-compatible API server for open decision models. Ollama for decision models: pull and serve 25 model families (Laya, pplx-decider, Clef, Winnow, coba...) locally or self-hosted behind /v1/systemone. The TypeSafe SDK works unchanged: set its base URL and pick an open model. CLI, desktop app, Docker, MCP server, public bench.