Part of Red River WestPart of Red River WestLearn more →

ZML

Production inference stack decoupling AI from proprietary hardware

stage
Seed
founders
Steeve Morin
location
Paris

# about

ZML is a production inference stack that decouples AI workloads from proprietary hardware. From a single codebase it compiles large language models — Llama, Gemma, Qwen, Mistral — to run at peak speed across NVIDIA, AMD, Google TPU, Intel, and Apple Metal, letting teams mix accelerators, break vendor lock-in, and cut inference cost and energy. Its LLMD inference server, built on Zig, MLIR, and OpenXLA, launched free in 2026.

# project

LICENSE
LANGUAGE
Sep 2024FIRST COMMIT
STARS
CONTRIBUTORS
DOWNLOADS