Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.
Embed a live health badge in a README or docs page.
[](https://www.ai-tools-scout.com/projects/onnxstream)See how this project stacks up against other image tools.
Get the fastest-growing projects, useful MCP servers, and technical reads in one weekly email.