A high-throughput and memory-efficient inference and serving engine for LLMs
其他人工智能更新于 2026-10-25
其他人工智能MIT
Repository dossier
ggml-org/whisper.cpp
Port of OpenAI's Whisper model in C/C++
Brief / README 摘要
查看原文High-performance inference of OpenAI's Whisper automatic speech recognition (ASR) model: Plain C/C++ implementation without dependencies Apple Silicon first-class citizen - optimized via ARM NEON, Accelerate framework, Metal and Core ML AVX intrinsics support for x86 architectures VSX intrinsics support for POWER architectures Mixed F16 / F32 precision Integer quantization support Zero memory allocations at runtime Vulkan support Support for CPU-only inference Efficient GPU support for NVIDIA AMD ROCm GPU support AMD Ryzen AI NPU Support OpenVINO Support Ascend NPU Support Moore Threads GPU Su…
Topics / 标签
01
浏览全部相关推荐
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
其他人工智能更新于 2026-10-25
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
其他人工智能更新于 2026-10-25
VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.
其他人工智能更新于 2026-10-25
21 Lessons, Get Started Building with Generative AI
其他人工智能更新于 2026-10-24