Repository dossier
microsoft/BitNet
Official inference framework for 1-bit LLMs
Brief / README 摘要
查看原文07/23/2026: 📣 We released VibeASR.cpp — a real-time multilingual ASR inference engine on CPU using BitNet I2_S quantization, achieving RTF Code ] [ Models ] [ Report ] 07/20/2026: 📣 We released BitNet-embedding-0.6B and BitNet-embedding-270M on Hugging Face — the first 1-bit embedding models that deliver competitive embedding quality with significantly faster inference on CPUs. 1.42x to 2.28x speedup over F16 on BitNet-embedding-0.6B prefill (8 threads) 1.32x to 1.74x speedup over F16 on BitNet-embedding-270M prefill (8 threads) Supports I2_S conversion with optimized kernels on x86 CPUs Los…
相关推荐
An Open Source Machine Learning Framework for Everyone
Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.