ZML

AI Native

ZML is an open-source model-to-metal AI inference stack that compiles and serves models with a Python-free execution path, explicit compilation for predictable latency, and multi-accelerator support via a general-purpose LLM server (ZML/LLMD) that documents batching, caching, and sharding for production deployments.