264001
eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJid2V2ZW50cy1wdWJsaWMtYXBpIiwiYXVkIjpbInB1YmxpYy13ZWIiXSwic3ViIjoiaHR0cHM6Ly93d3cuZ29vZ2xlY2xvdWRldmVudHMuY29tIiwiaWF0IjoxNzc3MzgzOTU3LCJuYmYiOjE3NzczODM5NTcsImV4cCI6MTc3NzM4NzU1NywiY29udGV4dCI6eyJwYXlsb2FkIjp7ImlkIjoiIiwicmVnVHlwZU5hbWUiOiIiLCJldmVudF9pZCI6IjI2NDAwMSIsImNfMzI5MDQxNiI6IiJ9fX0.oeKfO8R3TbvpdnM4GaEx_7dDSlzOY0CpRCAqlnIJQ_0
phase 7 playlists session info modal
Day 3 – April 24, 2026
Breakouts
BRK2-113 • Kubernetes, Cloud Runtimes • Technical
The GKE inference playbook: Optimize cost and performance
location_on Mandalay Bay F
schedule 12:30 PM - 1:15 PM
Balancing inference latency and cost is generative AI’s toughest challenge. This session delivers the playbook for a high-performance, cost-efficient inference stack on Google Kubernetes Engine (GKE). Explore innovations for scaling state-of-the-art models, crushing cold starts, and maximizing utilization with Ironwood Tensor Processing Units (TPUs) and vLLM. We’ll take a deep dive into GKE Inference Gateway, demonstrating routing based on the service level objective (SLO) across clusters to ensure your application stays responsive – and your budget stays intact. Read more
This agenda widget contains logic for handling same sessions available at multiple times
GTM Tracking Header name present
Session
contains logic for gtm tracking when modal open