NVIDIA Dynamo

NVIDIA Dynamo is an open-source, modular inference orchestration framework that serves generative AI models across distributed multi-node GPU clusters by disaggregating inference phases, enabling KV-cache-aware routing, and tiered KV caching to improve latency and GPU utilization.