Kubernetes Podcast from Google

This week’s interview was recorded live at Google Cloud Next, and features Alain Regnier and Camila Martins talking about recent developments in Kubernetes and cloud-native technologies. Including exploring highlights from KubeCon EU, and the value of community events. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod - bluesky: @kubernetespodcast.com News Google Cloud Next KubeCon Europe Amazon Q for the Command Line Blog - Enhance AI-assisted development with Amazon ECS, Amazon EKS and AWS Serverless MCP server KubeCon China, KubeCon Japan, and KubeCon India CNCF Maintainer Summit and Maintainer Track at KubeCon North America LLM-d project VLLM Kubernetes Inference Gateway Blog: Introducing the Inference Extension for Gateway API Interview Kubo Labs Google Developer Expert (GDE) Program DevOpsDays Kubernetes Community Days (KCD) KCD Rio de Janeiro 2025 KubeCon EU 2025 Schedule SecNumCloud OpenTelemetry Docker Community and Docker Captains Program Elastic Community HashiCorp Community GKE Dataplane V2 Kubernetes Network Policies GKE VPC-native clusters GKE Dashboards Docker's AI/ML Trends Report 2024 eBPF Liz Rice CNCF Landscape - Service Mesh Container Storage Interface (CSI) Agones McDonald's AI lightning talk at Google Cloud Next Target AI lightning talk at Google Cloud Next Target AI session at Google Cloud Next Google Cloud Next 2024 Developer Keynote

Guests are Nick Eberts and Jon Li. Nick is a Product Manager at Google working on Fleets and Multi-Cluster and Jon is a Software Engineer at Google working on AI Inference on Kubernetes. We discussed the newly announced Multi Cluster Orchestrator (MCO) and the challenges of running multiple clusters. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod - bluesky: @kubernetespodcast.com News of the week Etcd has released version 3.6.0 Kubernetes 1.33 is now available in the Rapid channel in GKE Kyverno 1.14.0 was released Links from the interview Nick Eberts on LinkedIn Jon Li on LinkedIn MCO Blog MCO Repo Cluster Inventory API ClusterProfile API Gemma 3 vLLM Sample (deploy on Google Cloud using Terraform and Argo CD) Hello World Sample (deploy on Google Cloud using Terraform and Argo CD) Gateway API Inference Extension

In this episode, we're bringing you a curated selection of conversations from the KubeCon EU 2025 showfloor. We'll be diving into the rise of platform engineering, exploring some cutting-edge technologies, getting updates on core Kubernetes components, and hearing some truly unique user stories, like using Kubernetes on a dairy farm! Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod - bluesky: @kubernetespodcast.com News of the week CNCF Blog - Announcing the Automated Governance Maturity Model Kubernetes Blog CNCF Blog - Understanding Kubernetes Gateway API: A Modern Approach to Traffic Management Open Observability Summit Links from the interview NAIS at NAV, with Hans Kristian Flaatten and Audun Fauchald Strand Audun Fauchald Strand Hans Kristian Flaatten NAV (Norwegian Labor and Welfare Administration) Kubernetes Podcast 216: NAIS, with Johnny Horvi and Frode Sundby NAIS KubeCon EU 2025 Keynote: Adventures of Building a Platform as a Service for the Government - Hans Kristian Flaatten, Lead Platform Engineer, NAV & Audun Fauchald Strand, Principal Software Engineer, NAV GKE release notes Platform Engineering, with Max Körbächer and Andreas (Andi) Grabner Max Körbächer Andreas (Andi) Grabner Book: “Platform Engineering for Architects: Crafting modern platforms as a product” by Max Körbächer, Andreas Grabner, and Hilliary Lipsig Cloud Native Summit Munich Kubernetes at LinkedIn, with Ahmet Alp Balkan and Ronak Nathani Ahmet Alp Balkan Ronak Nathani Kubernetes Podcast 249: Kubernetes at LinkedIn, with Ahmet Alp Balkan and Ronak Nathani Ahmet’s Blog Introducing Multi-Cluster Orchestrator: Scale your Kubernetes workloads across regions LLMs on Kubernetes, with Mofi and Abdel KubeCon EU 2025 talk: Yes You Can Run LLMs on Kubernetes - Abdel Sghiouar & Mofi Rahman, Google Cloud About the Gateway API Gateway API Inference Extension Deploy GKE Inference Gateway SIG etcd with Ivan Valdes Ivan Valdes etcd.io SIG etcd on GitHub Open Source Kubernetes, with Jago Macleod Jago Macleod Google Open Source: Kubernetes Schedmd Slurm Ray Run:ai from Nvidia Medium blog: “Deploy Slurm on GKE” by Abdel Sghiouar AI-Hypercomputer, xpk XPK (Accelerated Processing Kit, pronounced x-p-k) is a command line interface that simplifies cluster creation and workload execution on Google Kubernetes Engine (GKE). XPK generates preconfigured, training-optimized clusters and allows easy workload scheduling without any Kubernetes expertise. Cursor AI Editor Dairy Farm Automation & Banking with Kubernetes, with Clément Nussbaumer Clément Nussbaumer Talos Linux Cluster-api Cluster API is a Kubernetes subproject focused on providing declarative APIs and tooling to simplify provisioning, upgrading, and operating multiple Kubernetes clusters. KubeCon EU 2025 Talk: “Day-2’000 - Migration From Kubeadm+Ansible To ClusterAPI+Talos: A Swiss Bank’s Journey” - Clément Nussbaumer, PostFinance Kubeadm Kubeadm is a tool built to provide kubeadm init and kubeadm join as best-practice "fast paths" for creating Kubernetes clusters. Being a First-Time KubeCon Attendee, with Nick Taylor Kubernetes The Hard Way K3s - “The certified Kubernetes distribution built for IoT & Edge computing” Kubernetes Ingress Controllers Kubernetes Up and Running Kubernetes Docs KubeCon EU 2025 Sponsored Keynote: The Science of Winning: Oracle Red Bull Racing’s Formula with Open Source, Kubernetes and AI - Sudha Raghavan, SVP of OCI Developer Platform, Oracle

Nina Polshakova is a software engineer at Solo.io, where she’s worked on Istio and API Gateway projects. She’s been part of the Kubernetes release team since v1.27 and is currently serving as the Release Lead for v1.33. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod - bluesky: @kubernetespodcast.com News of the week 229 new things Google announced at Next 25 MCO: Multi-Cluster Orchestrator Golden Kubestronaut Cloud Native Platform Engineering Associate The kube-scheduler-simulator K0s and k0smotron are now CNCF Sandbox projects Links from the interview Nina Polshakova Kubernetes Deprecation Policy Kubernetes Dev Google Group solo.io Istio API Gateway (General concept, linking to K8s Gateway API) Kubernetes Release Team GitHub Istio revisions Working in Public by Nadia Eghbal (Link to publisher's site about the book) Kubernetes Maintainers Read Mean Comments (KubeCon EU 2024) Kubernetes 1.33 release blog (Link to release announcement blog) Kubernetes Enhancement Proposals (KEPs) Sidecar Containers Multiple Service CIDR support (KEP link) Dynamic Resource Allocation (DRA) DRA support for partitioned devices (KEP link) DRA device taints and tolerations (KEP link) DRA: Prioritized Alternatives in Device Requests (KEP link) Kubernetes 1.33 sneak peak (Link to pre-release highlights) EndpointSlices API Kubernetes Gateway API node.status.nodeInfo.kubeProxyVersion is a lie (issue) KEP-4004: Deprecate the kubeProxyVersion field of v1.Node #4005 (KEP link) Kubelet Removal: Host network support for Windows pods (KEP link) Containerd SIG Windows HostProcess Containers (Windows) Removal: KEP-5040: Disable git_repo volume driver (KEP link) User Namespaces (Beta, Enabled by Default) CRI-O Runc In-place Resource Resize for Pods (Link to the alpha announcement, but now beta) Vertical Pod Autoscaler (VPA) KEP-5080: Ordered Namespace Deletion PyTorch Linkerd Terry Pratchett's Discworld series Tiffany Aching series Guards! Guards! Going Postal Kubernetes Slack New Contributor Orientation

Today we welcome Jesse Butler and Nic Slattery to talk about the Kubernetes Resource Orchestrator, or KRO. Jesse works as a principal product manager at AWS and Nic is a Product Manager at Google. The Kubernetes Resource Orchestrator is a new cloud agnostic tool meant to simplify Kubernetes resources for devs and platform admins. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod - bluesky: @kubernetespodcast.com News of the week Kubernetes JobSets: An open-source API for managing distributed jobs as a single unit. Integrates with Kueue for better resource utilization. Kubernetes Blog: Introducing JobSet Kueue Project Google Cloud Next '24: Happening in Las Vegas, April 9-11. The Kubernetes Podcast team will be there! Google Cloud Next Kagent: A new open-source AI agent framework built on Microsoft's Autogen, designed for automating operations and troubleshooting in Kubernetes. kagent.dev Links from the interview Kubernetes Resource Orchestrator (KRO) KRO Announcement Blogs Google Cloud Blog- Simplify the developer experience on Kubernetes with KRO AWS Open Source Blog - Introducing kro: Kube Resource Orchestrator AWS Open Source Blog - Kube Resource Orchestrator, From Experiment to Community Project Reddit thread - anyone tried kro for kubernetes resource management yet? The New Stack: Kubernetes Gets a New Resource Orchestrator in the Form of Kro InfoQ: Cloud Giants Collaborate on New Kubernetes Resource Management Tool CRD (Custom Resource Definition): Kubernetes CRDs - A mechanism within Kubernetes to extend the API. Knative: Knative.dev - A Kubernetes-based platform for building serverless applications. Terraform: Terraform.io - Infrastructure as code software. Helm: Helm.sh - A package manager for Kubernetes. KPT (Kubernetes Package Tool): KPT - A tool for packaging and managing Kubernetes configurations. Crossplane: cncf.io/projects/crossplane - An open-source project for managing cloud resources through Kubernetes. Common Expression Language (CEL): cel.dev - A powerful expression language. kubebuilder: kubebuilder on GitHub - A framework to build Kubernetes controllers, details available in Kubernetes documentation.

Ahmet Alp Balkan and Ronak Nathani are software engineers at LinkedIn compute infrastructure team running the Kubernetes platform for LinkedIn and they joined us today to talk about how they run Kubernetes at scale and what they learned along the way. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod - bluesky: @kubernetespodcast.com News of the week CubeFS was moved to the CNCF Graduated Maturity Level. CNCF Maturity Levels Canonical announced 12 year Kubernetes Long Term Support. Kubernetes Community Days (KCDs) Links from the interview LinkedIn Engineering Blog- Stateful workload operator: stateful systems on Kubernetes at LinkedIn Kubernetes Blog: How we run Kubernetes in Kubernetes aka Kubeception Flannel: Flannel is a simple and easy way to configure a layer 3 network fabric designed for Kubernetes. Spanner: Google Cloud's globally-distributed database service. Kubernetes Architecture - learn more about the control plane from the Kubernetes docs! Kubernetes Resource Model Kubernetes Resource Orchestrator (KRO) Ahmet Alp Balkan Blog: So you wanna write Kubernetes controllers?

Lior Lieberman is a software engineer lead at Google Cloud focusing on GCE, Kubernetes, and Service Mesh. He is a leading contributor to Gateway API and the maintainer of Ingress2gateway. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod - bluesky: @kubernetespodcast.com News of the week NFTables mode for kube-proxy | Kubernetes Kubescape becomes a CNCF incubating project Announcing the Beta Release of OpenTelemetry Go Auto-Instrumentation using eBPF | CNCF New Phippy Book Guidelines: Enhancing Community Access & Engagement | CNCF Links from the interview Lightning Talk: Why Service Is the Worst API in Kubernetes, & What We’re Doing About It - Tim Hockin GitHub - kubernetes-sigs/ingress2gateway: Convert Ingress resources to Gateway API resources Migrating from Ingress Gateway API Inference Extension 0.1.0 release README on GitHub kubernetes-sigs/ingate - an Ingress & Gateway API Controller GAMMA - https://gateway-api.sigs.k8s.io/mesh/

Kakeru is the initiator of the Kubernetes History Inspector or KHI. An open source tool that allows you to visualise Kubernetes Logs and troubleshoot issues. We discussed what the tool does, how it's built and what was the motivation behind Open sourcing it. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod - bluesky: @kubernetespodcast.com News of the week The Schedule for the KubeCon and CloudNativeCon 2025 Maintainers Summit is live The CNCF 2024 review of the top 30 projects The CNCF End User Case Study for KubeCon Contest Kubernetes Resource Orchestrator Blog Kubernetes Resource Orchestrator Github EKS Hybrid nodes CoreWeave Nvidia GB200 NLV-72 GA Links from the interview KHI: Kubernetes History Inspector DAG WebGL

William Morgan is the CEO of Buoyant, the company behind Linkerd. You worked at Twitter before as a software engineer and engineering manager and you have a long experience in the field. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod - bluesky: @kubernetespodcast.com News of the week RedHat blog: Next generation multicluster application connectivity and traffic policy management KubeCon EU 2025 schedule CFP for KubeCon Japan (closes Feb 2, 2025) CFP for KubeCon China (closes Feb 2, 2025) CFP for KubeCon India (closes March 23, 2025) kubezonnet Links from the interview linkerd.io Linkerd on GitHub Linkerd architecture “Linkerd doesn’t use Envoy” Blog Post (2020) envoyproxy.io Sidecar containers in Kubernetes Linkerd2 on GitHub Rust programming language Dynamic Admission Control (Mutating Webhooks) Linkerd Multi-cluster Federated Services KubeCon NA 2024, “Open Source 2.0: The Maintainers' Perspective - Panel” Cloud Native Startup Fest, “​​Panel: Startups With Open Source Projects: Can They Be Successful in the CNCF? And Should They Be?”

John Belamaric is a senior staff software engineer at Google who has been involved in Kubernetes since 2016, and is currently a co-chair of both SIG Architecture and WG Device Management. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod - bluesky: @kubernetespodcast.com News of the week KubeCon Japan CFP KubeCon India CFP Links from the interview Working Group Device Management on GitHub (meeting info here) CoreDNS Dynamic Resource Allocation in Kubernetes Control Topology Management Policies on a node NVIDIA Multi-Instance GPUs Links from the post-interview chat 2025 Kubernetes Community Day Events

This episode is a recap of 2024. Co-hosts Abdel and Kaslin and guest host Mofi got together to reflect on how 2024 has been in the Cloud Native and Kubernetes space. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod Links from the interview 2024 Wrapped: Top 5 episodes 10 years k8s anniversary episodes 226, 227, 228, 229 CNCF Kubernetes 10 years documentary Google Kubernetes 10 years documentary Gateway API with Rob Scrott episode LLM Gateway Emily Fox on the podcast Kubernetes Podcast on Bluesky Kubernetes Podcast on LinkedIn Kubernetes on Bluesky Kubernetes Podcast on Youtube Introduction to Distributed ML Workloads with Ray on Kubernetes

Release Lead Frederico Muñoz walks us through the 1.32 release: new feature highlights, deprecations and removals, and the release theme: Penelope. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod News of the week Gateway API v1.2: WebSockets, Timeouts, Retries, and More Streamline Kubernetes cluster management with new Amazon EKS Auto Mode Top announcements of AWS re:Invent 2024 Links from the interview Kubernetes v1.32: Penelope (Release Blog) SIG ContribEx Comms Kubernetes Contributor Awards 2023 (Frederico received an award last year) The Odyssey by Homer, Samuel Butler on Google Books Releases on Kubernetes.io Links from the post-interview chat Kubernetes 1.27: In-place Resource Resize for Kubernetes Pods (alpha)

KubeCon North America 2024 took place in Salt Lake City, Utah on Nov 12-15. We interviewed people on the show floor to gather their impressions of the event, what they learned and what they want to see in the future. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod News of the week Cert-manager is a CNCF graduate project Dapr is a CNCF Graduated project Dapr episode on the Kubernetes Podcast Istio 1.24 release. Ambient Mesh GA Cloud Native Heroes Challenge CNCF Flagship events for 2025 New Cloud Native Certifications Kubernetes certifications prices increase in 2025 wasmCloud is a CNCF incubated project SpectroCloud $75 million Series C funding Solo.io donates Gloo API Gateway to the CNCF Links from the interview Guests: Rajas Kakodkar Jeremy Rickard Rey Lejano Jimmy Zelinskie Frederic Branczyk Lucy Sweet Sreekaran Srinath Joe Thompson Tag runtime SIG Security SIG Docs WG LTS The Maintainer Monologues - Sarah Christoff, Jason Hall, Scott Rigby, Karen Chu & Ryan Nowak Expanding the Capabilities of Kubernetes Access Control - Jimmy Zelinskie & Lucas Käldström

Guests are Maciej Rozacki, Product Manager on GKE for AI Training, and Wojciech Tyczyński, Software Engineer on the GKE team at Google. We explore what it means for GKE to support 65k nodes, and the open source contributions that made this possible Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod News of the week The Kubernetes Podcast is on Bluesky OpenTelemetry expanding into CI/CD observability Gitpod is moving away from Kubernetes OpenCost is a CNCF Incubated project Links from the interview Guests: Maciek Wojciech Kubernetes OSS Scalability thresholds PGS on the Kubernetes Podcast Batch Working Group Serving Working Group episode on the podcast Dynamic Resource Allocation Kueue Multitenancy and Fairness at Scale with Kueue SIG Scalability Links from the post-interview chat Consistent Reads from Cache Kubernetes Scalability: A Multi-Dimensional Analysis

Yuan is a principal software engineer at Red Hat, working on OpenShift AI. Previously, he has led AI infrastructure and platform teams at various companies. He holds leadership positions in open source projects, including Argo, Kubeflow, and Kubernetes WG Serving. Yuan authored three technical books and is a regular conference speaker, technical advisor, and leader at various organizations. Eduardo is an environmental engineer derailed into a software engineer. Eduardo has been working on making containerized environments the de facto solution for High Performance Computing(HPC) for over 8 years now. Began as a core contributor to the niche Singularity Containers, today known as Apptainer under the Linux foundation. In 2019 Eduardo moved up the ladder to work on making Kubernetes better for performance oriented applications. Nowadays Eduardo works at NVIDIA on the Core Cloud Native team working on enabling specialized accelerators into Kubernetes workloads. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod News of the week Docker official terraform provider Tetrate and Bloomberg Envoy AI Gateway KubeCon+CloudNativeCon North America 2024 laptop drive Remaining KCDs for 2024 Links from the interview Yuan Tang Eduardo Arango WG Serving Kserve Kserve Serving models with OCI images LLM Gateway Dynamic Resources Allocation

This episode is special. We collaborated with the folks behind the Cloud Security Podcast from Google, Anton Chuvakin(LinkedIn)and Tim Peacock, to bring you a joint episode. We had the pleasure to jointly interview Michelle Chubirka, a Cloud Security Developer Advocate. We talked about VM and Container security, debunked some myths about isolation, attack surfaces, immutability of containers, and more. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod News of the week Nvidia NIM on GKE Kubernetes Steering Committee Election Results for 2024 The schedule for KubeCon and CloudNativeCon India Diagrid Catalyst Beta Dapr on the Kubernetes Podcast with Salaboy Links from the interview Cloud Security Podcast Anton Chuvakin Tim Peacock Michelle Chubirka Dora report Container Security: It’s All About the Supply Chain - Michele Chubirka Software composition analysis (SCA) DevSecOps Decisioning Principles Kubernetes CIS Benchmark Cloud-Native Consumption Principles State of WebAssembly outside the Browser - Abdel Sghiouar Why Perfect Compliance Is the Enemy of Good Kubernetes Security - Michele Chubirka - KubeCon NA 2024 Links from the post-interview chat Cloud Code Skaffold Introduction to Distributed ML Workloads with Ray on Kubernetes - Mofi Rahman & Abdel Sghiouar - KubeCon NA 2024

Marvin Beckers is a Team Lead at Kubermatic and a contributor and maintainer of the CNCF Sandbox Project, KCP. KCP is an open source horizontally scalable control plane for Kubernetes-like APIs. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod News of the week [Docker Blog] Announcing Upgraded Docker Plans: Simpler, More Value, Better Development and Productivity [LinuxFoundation Blog] Linux Foundation Announces Intent to Form Developer Relations Foundation [Computer Weekly Article] NetApp Insight 2024 - Live show report: day zero Links from the interview KCP Kubernetes Resource Model (KRM) Crossplane Links from the post-interview chat Cloud Native Maturity Model

Guests are Avin Regmi and David Xia from Spotify. We spoke to Avin and David about their work building Spotify’s Machine Learning Platform, Hendrix. They also specifically talk about how they use Ray to enable inference and batch workloads. Ray was featured on episode 235 of our show, so make sure you check out that episode too. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod News of the week IBM acquired Kubecost KubeCon Japan in 2025 Call for Proposals for KubeCon EU 2025 is now open Artifact Hub is a CNCF incubating project OpenMetrics is dead, long live OpenMetrics Kubecolor 0.4.0 Links from the interview Avin Regmi David Xia Hendrix ML Platform Ray on Kubernetes KubeRay Workbench instances Backstage PyTorch Ray Summit 2024 Kueue

Solomon Hykes is the co-founder of Dagger. He is probably best known as the creator of Docker. The tool that changed how developers package, run and distribute software in the last 11 years. His impact on our industry is undeniable. Today, we discuss his new venture, Dagger. Dagger is a new approach to how we do CI/CD. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod News of the week Kubeadm v1beta4 1.32 Release Cycle Info Updates to the Certified Kubernetes Administrator Exam 2024 Generative AI Survey Microsoft Azure Advanced Container Networking enhancements Links from the interview Solomon Hykes on LinkedIn Dagger OpenStack Act (GitHub Actions Locally) Buildkit Cue GraphQL Dagger Discord Caching - Dagger Documentation Bazel Terraform Pulumi Kubectl gRPC GraphQL Google Cloud’s Package Index The Daggerverse Cloud Foundry PostHog RedHat Development Model Links from the post-interview chat Scaffold Solomon Hykes - Docker, Dagger, and the Future of DevOps Directed Acyclic Graphs Solomon Hykes on wikipedia Stack Overflow

In this episode, guest host and AI correspondent Mofi Rahman interviews Richard Liaw and Kai-Hsun Chen from Anyscale about Ray and KubeRay. Ray is an open-source unified compute framework that makes it easy to scale AI and Python workloads, while KubeRay integrates Ray’s capabilities into Kubernetes clusters. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod News of the week CNCF Blog - LitmusChaos audit complete! Kubernetes Podcast from Google episode 234 - LitmusChaos, with Karthik Satchitanand Google Cloud Blog - Run your AI inference applications on Cloud Run with NVIDIA GPUs Diginomica article - KubeCon China - at 33-and-a-third, Linux is a long player. So, why does Linus Torvalds hate AI? CNCF-Hosted Co-Located Event Schedule for KubeCon NA 2024 Google Kubernetes Engine Release Notes - August 20, 2024 (1.31 available in Rapid Channel) Kubernetes Podcast from Google - Kubernetes v1.31: "Elli", with Angelos Kolaitis Red Hat Press Release - Red Hat OpenStack Services on OpenShift is Now Generally Available Red Hat Enables OpenStack to Run Natively on OpenShift Platform Broadcom Revamps Tanzu to Simplify Cloud-Native App Development and Deployment Tanzu Platform 10 Offers Cloud Foundry Users Deep Visibility and Productivity Enhancements VMware Explore Conference Website CNCF Blog - Announcing 500 Kubestronauts CNCF - Kubestronaut FAQ Dapr Day 2024 Virtual Event Website Links from the interview Kai-Hsun Chen on LinkedIn Richard Liaw on LinkedIn Ray from the RISE Lab at UC Berkeley Ray: A Distributed System for AI by Robert Nishihara and Philipp Moritz - Jan 9, 2018 KubeRay Docs KubeRay on GitHub PyTorch Apache Airflow Apache Spark Kubeflow Apache Submarine (retired) Jupyter Notebooks VS Code Examples of schedulers for Batch/AI workloads in Kubernetes Kueue Volcano Apache Yunikorn Examples of observability tools for Batch/AI workloads in Kubernetes Prometheus Grafana Fluentbit Examples of loadbalancers Nginx Istio Ray Data: Scalable Datasets for ML Dask Python - Parallel Python Ray Serve: Scalable and Programmable Serving HPA - Horizontal Pod Autoscaling in Kubernetes Karpenter - “Just-in-time nodes for any Kubernetes cluster” Lazy Computation Graphs with the Ray DAG API Types of hardware accelerators Google Cloud Tensor Processing Units (TPUs) AMD Instinct AMD Radeon AWS Trainium AWS Inferentia Pandas Numpy KubeCon EU 2024 - Accelerators(FPGA/GPU) Chaining to Efficiently Handle Large AI/ML Workloads in K8s - Sampath Priyankara, Nippon Telegraph and Telephone Corporation & Masataka Sonoda, Fujitsu Limited NVidia Megatron Links from the post-interview chat DRA - Dynamic Resource Allocation in Kubernetes Different ways of Running RayJob on Kubernetes Ray framework diagram in the docs