NVIDIA Dynamo in 5 Minutes: Dynamo On Kubernetes for AI Inference
Your model endpoint works for a demo. What does it take to scale it for your team?
In this episode of Dynamo in 5 Minutes, we walk through deploying NVIDIA Dynamo on Kubernetes, from defining your serving setup to sending requests to a live endpoint.
You’ll learn:
• How the Dynamo Operator creates and manages your serving setup
• Two deployment paths: describe what you need with DGDR, or customize an existing deployment recipe with DGD
• How requests move from an OpenAI-compatible frontend to inference engines such as SGLang, vLLM, or TensorRT-LLM
• The full DGDR workflow in a live demo, fro