Serve Your Own LLM: vLLM & SGLang, End-to-End
Details and enrolment: https://vllm-sglang.vizuara.ai vLLM & SGLang Engineering: End-to-End, a new live bootcamp by Dr. Sreedath Panat (PhD, MIT; co-founder, Vizuara AI Labs). Outside a handful of frontier labs, almost every open-source model you use (Llama, Mistral, Kimi, DeepSeek, Gemma) is served by vLLM or SGLang. This bootcamp teaches you to run them in practice: - Trace a request from the chat window to the GPU and back - Build a benchmark harness for latency and throughput - Tune memory, batching, prefix caching, quantization, multi-GPU and mixture-of-experts serving - Production: ro