The Cloudcast

Between the bold predictions, VC economics, and rising usage-patterns are stories of limited ROIs, undefined use-cases and associated job losses. AI is in an awkward phase of maturity and it’s not clear how it will evolve into the next phase. SHOW: 962 SHOW TRANSCRIPT: The Cloudcast #962 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST: "CLOUDCAST BASICS" SHOW SPONSORS: [TestKube] TestKube.io/cloudcast[Interconnected] SHOW NOTES: THE SPECTRUM OF AI FEEDBACK? @cloudcastpod@cloudcastpod.bsky.social@cloudcastpod@cloudcastpod

Stephan Donze, Founder and CEO of AODocs, discusses the enterprise unstructured data crisis, where 80% of business data remains untapped due to legacy system limitations and the challenges of AI-powered document management at scale. We explore how AI agents can transform document workflows while maintaining trust and compliance, the architectural principles needed for cloud-native document management, and why traditional search fails in the age of generative AI. SHOW: 961 SHOW TRANSCRIPT: The Cloudcast #961 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS" SPONSORS: [Interconnected][TestKube] TestKube.io/cloudcastSHOW NOTES: AODocs websiteTopic 1 - Welcome to the show, Stephan. Give everyone a quick introduction. Topic 2 - We hear all the time about unstructured data and the continual growth in the Enterprise. I’ve heard numbers of upwards of 80% of all corporate data is unstructured. I’ve worked at several companies and supported a significant number of customers over the years, and I can count on one hand how many say they have “control” of their data. How did this come to be, and is the problem as big as I think? Topic 3 - The second part of this, and this might be an even bigger problem, is how much of the data is used? Too many needles in the haystack, if you will. How does Agentic AI address this challenge, and where do traditional document management systems fail? Topic 4 - We’ve talked about data quality in the past on the show, and I’m wondering if this also becomes an issue. Let’s say you have a bunch of draft documents leading up to the final version. Is it possible that improper version control and/or we’re back to a data quality problem of finding the “final version” needle in the haystack? How does AI prevent this and also not hallucinate an answer that may not be true? Topic 5 - Some have called AI’s ability to absorb and report on data just fancy search. What are your thoughts on this? Where and how does traditional search differ from Agentic AI management? Topic 6 - I also see this as being so much more than indexing and reporting on documents. There is also the concept of automation and workflows that agentic AI can improve upon. What use cases are your customers implementing? Topic 6a - Where do you think the industry will go in the next 2-3 years? Topic 7 - If anyone is interested, what’s the best way to get started? FEEDBACK? @cloudcastpod.bsky.social@cloudcastpod@cloudcastpod@cloudcastpod

How is it possible that smart people both love and hate AI? Does it matter how smart you are, or just how you interact with AI? SHOW: 960 SHOW TRANSCRIPT: The Cloudcast #960 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST: "CLOUDCAST BASICS" SHOW SPONSORS: [TestKube] TestKube.io/cloudcast[Interconnected]SHOW NOTES: WHAT TYPES OF SMART PEOPLE LOVE AND HATE AI? FEEDBACK? @cloudcastpod@cloudcastpod.bsky.social@cloudcastpod@cloudcastpod

Todd Robinson, Founder and President of OpenMetal.io, discusses the resurgence of bare metal infrastructure driven by AI workloads, digital sovereignty requirements, and companies reassessing public cloud economics. The conversation explores how organizations are finding cost and control advantages in bare metal solutions, particularly for long-running applications. It examines OpenMetal's open-source approach using technologies like Ceph and OpenStack to deliver flexible infrastructure alternatives. SHOW: 959 SHOW TRANSCRIPT: The Cloudcast #959 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotw NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS" SPONSORS: [Interconnected] [TestKube] TestKube.io/cloudcast SHOW NOTES: OpenMetal websiteTopic 1 - Welcome to the show. Tell us about your background, and you developed a passion around bare metal and cloud services? Topic 2 - Between AI (GPU rental), digital sovereignty initiatives, and even virtualization alternatives, it feels like bare metal is having a resurgence. Give some a sense of what the demands for bare metal solutions look like today? Topic 3 - As companies understand the economics of having used public cloud services, are there certain use-cases that become immediately obvious where more private, hosted, bare metal services just make more sense? Topic 4 - OpenMetal is based on open source technologies like Ceph and OpenStack. How important to customers about the technologies under their applications, or do the economics and control aspects play a bigger role in their decisions? Topic 5 - I’m often asked if there is a model about when it makes more sense to use on-demand service vs. more fixed services. Is there a rule of thumb (e.g. longevity of an application, amount of change, etc.) that you’ve found drives the most success at picking the right environment for applications? Topic 6 - OpenMetal could be described as a public or private cloud service. Do you find that there is still the stigma over “private cloud” that we saw when the hyperscalers were initially growing so quickly? FEEDBACK? @cloudcastpod.bsky.social@cloudcastpod@cloudcastpod@cloudcastpod

How did Oracle Cloud (with OpenAI) suddenly command the news cycle, with a chance to potentially overtake much larger clouds in a few years? Let’s explore how Oracle’s focus on bare-metal and bandwidth might have ripple effects on Cloud and AI. SHOW: 958 SHOW TRANSCRIPT: The Cloudcast #958 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST: "CLOUDCAST BASICS" SHOW SPONSORS: [TestKube] TestKube.io/cloudcast[Interconnected] SHOW NOTES: WHAT ARE THE ALTERNATIVE PATHS FOR AI? The Cloudcast #330 - Oracle’s Next-Generation Cloud IaaSOracle Chosen as TikTok’s Secure Cloud ProviderOracle Cloud and OpenAI sign $300B dealOracle CloudOracle and OpenAI FEEDBACK? @cloudcastpod@cloudcastpod.bsky.social@cloudcastpod@cloudcastpod

Ole Lensmarm, Founder/CTO at TestKube, discusses how Kubernetes-native testing platforms are designed to address limitations in traditional CI/CD testing workflows. The conversation covers how TestKube differs from existing testing environments, expands test coverage opportunities for development and QA teams, and provides best practices for testing in Kubernetes environments. SHOW: 957 SHOW TRANSCRIPT: The Cloudcast #957 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotw NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS" SPONSORS: [Interconnected] [TestKube] TestKube.io/cloudcast[DoIT] doit.comd-o-i-t.comSHOW NOTES: TestKube - A Kubernetes-native platform that powers Continuous Testing for today’s AI-accelerated developmentTestKube (open source)Why did we start TestKube (Ole Lensmar)Topic 1 - Welcome to the show. Tell us about your background and what led you to start TestKube. Topic 2 - Let’s talk about the origins of TestKube. What were some areas where you saw people having frustrations or limitations that were holding back their ability to do proper testing to get things into production? Topic 3 - Let’s talk about the basics of TestKube. Can you talk about how it’s different from existing testing environments, or how people use CI/CD today Topic 4 - Does TestKube expand what a typical Dev-team, or QA-team would test, or does it create new opportunities for test coverage that were very difficult before? Topic 5 - What are some of the results or feedback you’ve heard from people using TestKube? Topic 6 - What are some best practices you’re seeing as people begin to evolve how they test for their Kubernetes environments? Topic 7 - What’s the best way for people to get started with TestKube FEEDBACK? @cloudcastpod.bsky.social@cloudcastpod@cloudcastpod@cloudcastpod

Apple’s iPhone had the Android ecosystem, but where is the Android of AI going to come from to challenge the OpenAI/NVIDIA duopoly? Let’s explore the possibilities. SHOW: 956 SHOW TRANSCRIPT: The Cloudcast #956 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST: "CLOUDCAST BASICS" SHOW SPONSORS: [DoIT] doit.comd-o-i-t.com[TestKube] TestKube.io/cloudcastSHOW NOTES: WHAT ARE THE ALTERNATIVE PATHS FOR AI? FEEDBACK? @cloudcastpod@cloudcastpod.bsky.social@cloudcastpod@cloudcastpod

Brian Gracely (@bgracely) Aaron Delp (@aarondelp) and Brandon Whichard (@bwhichard, @SoftwareDefTalk) discuss the top stories in Cloud and AI from August 2025. SHOW: 955 SHOW TRANSCRIPT: The Cloudcast #955 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS" SPONSORS: [TestKube] TestKube.io/cloudcast[DoIT] doit.comd-o-i-t.comSHOW NOTES: Link to August 2025 News and ArticlesFEEDBACK? Email: Bluesky: @cloudcastpod.bsky.socialTwitter/X: @cloudcastpodInstagram:@cloudcastpodTikTok:@cloudcastpod

From extreme ups to startling downs, every week can feel like the peak of expectations and the trough of disillusionment for AI. SHOW: 954 SHOW TRANSCRIPT: The Cloudcast #954 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST: "CLOUDCAST BASICS" SHOW SPONSORS: [DoIT] doit.comd-o-i-t.com[VASION] custom demoSHOW NOTES: THE UPS AND DOWNS OF AI - THE CONSTANT HYPE CYCLE Healthy Competition [YES] Consumer and Enterprise Markets [YES] Market leader(s) [YES, sort of] Well-Defined, profitable business model [NO] Open, lower-cost alternative emerged [YES/NO] Usage patterns emerging [YES/NO] Are inference prices coming downFEEDBACK? @cloudcastpod@cloudcastpod.bsky.social@cloudcastpod@cloudcastpod

Amit Kinha - Field CTO DoIT | FinOps Foundation Board Member discusses how the relationship between technology and financial accountability has evolved, and how mainstream FinOps is shifting IT focus around innovation. SHOW: 953 SHOW TRANSCRIPT: The Cloudcast #953 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotw NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS" SPONSORS: custom demodoit.comd-o-i-t.comSHOW NOTES: DoIT - Intent Aware FinOpsDoIT hires Citigroup FinOps Star as ExecutiveFinOps FoundationFinOps X (event)Topic 1 - Welcome to the show. Tell us about your background and your involvement in FinOps. Topic 2 - We’ve been through the early days of cloud, where we were told that cloud was cheaper, and then after COVID, everyone seemed to realize that cloud was actually more expensive. Where are we with FinOps and companies understanding how to think about cloud spending? Topic 3 - You work with the FinOps Foundation. What types of roles do you see focused on FinOps, and how is that evolving as there is greater cloud cost visibility across an entire organization? Topic 4 - How has the technology around FinOps evolved? How much is still manual? How much is piecing together different costs from different systems? And how much is evolving to have an AI component? Topic 5 - How do the tools and platforms from DoIT help to make FinOps easier for companies? What are some of the key areas of focus, and some insights you’re hearing from the companies that you work with directly? Topic 6 - If you had to give a CIO or CFO guidance on how to best think about FinOps, what are the top things you would focus on? FEEDBACK? Email: show at the cloudcast dot netBluesky: @cloudcastpod.bsky.socialTwitter/X: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

As we begin to transition from the Cloud era to the AI era, what types of changes can we expect to see happen in the market, within our businesses, and for individuals? SHOW: 952 SHOW TRANSCRIPT: The Cloudcast #952 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST: "CLOUDCAST BASICS" SHOW SPONSORS: [DoIT] doit.comd-o-i-t.com[VASION] custom demoSHOW NOTES: WHEN TWO ERAS OVERLAP - CLOUD AND AI FEEDBACK? @cloudcastpod@cloudcastpod.bsky.social@cloudcastpod@cloudcastpod

After a very long roadtrip, let’s explore the lessons we can learn from some of the greatest business models in tech and how or if they apply to the AI era companies. SHOW: 951 SHOW TRANSCRIPT: The Cloudcast #951 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST: "CLOUDCAST BASICS" SHOW SPONSORS: [VASION] custom demo[DoIT] doit.comd-o-i-t.comSHOW NOTES: 7 Powers of Competitive DynamicsVol 1Vol 2GoogleMetaAWSVol 1Vol 2Vol 3LESSONS FROM THE GREATEST BUSINESS MODELS FEEDBACK? @cloudcastpod@cloudcastpod.bsky.social@cloudcastpod@cloudcastpod

Haseeb Budhani, Co-Founder and CEO of Rafay Systems, discusses the evolution from traditional DevOps to platform engineering and what "Enterprise Ready" Kubernetes looks like in 2025. We explore AI workloads running on Kubernetes and how modern orchestration solutions can transform teams from bottlenecks into enablers. We also cover the security considerations for GPU-enabled AI workloads and balancing developer self-service capabilities with proper governance and control. SHOW: 950 SHOW TRANSCRIPT: The Cloudcast #950 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS" SPONSORS: [DoIT] doit.comd-o-i-t.com[VASION] custom demoSHOW NOTES: Rafay websiteTopic 1 - Welcome to the show, Haseeb. Give everyone a quick introduction. Topic 2 - Let’s start by talking about the evolution of Kubernetes as a platform. You’ve said and we’ve talked about on this show for some time how Kubernetes is more of a platform to run platforms. We’ve also seen trends in the industry and shifts in what it means to be DevOps or Platform Engineering in recent years. You've positioned Rafay as a Kubernetes Operations Platform that's now evolved into a Cloud Automation Platform. How do you define the difference between Kubernetes management and true platform engineering? Topic 3 - What does “Enterprise Ready” Kubernetes look like in 2025? Topic 4 - Let’s flip over to AI/ML and GPUs with Kubernetes for a bit. Many developers and data scientists aren’t aware of the underlying platform they run on. I saw a stat recently that about 95% of AI runs on Kubernetes, either on-prem or in the cloud. Despite this, Platform teams are often stuck doing manual GPU provisioning, which doesn't scale with AI adoption. How do modern GPU orchestration solutions change the platform team's role? Topic 5 - With GPU workloads often handling sensitive data and AI models, security becomes even more critical. How should organizations approach security and compliance in their GPU-enabled Kubernetes operations? Topic 6 - "Most developers don't want to write YAML or manage clusters — they just want to ship software." How do you balance giving developers the self-service capabilities they want while maintaining the control and governance that platform teams need? Topic 7 - If anyone is interested, what’s the best way to get started? FEEDBACK? @cloudcastpod.bsky.social@cloudcastpod@cloudcastpod@cloudcastpod

Shay Levi (Co-Founder & CEO @ Unframe) & Larissa Schneider (Co-Founder & COO @ Unframe) discuss the complexities of building an enterprise-grade AI platform. Topics include what an AI platform is, the advantages of adoption, and the efficiencies gained. SHOW: 945 SHOW TRANSCRIPT: The Cloudcast #945 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotw NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS" SPONSORS: [VASION] Vasion Print eliminates the need for print servers by enabling secure, cloud-based printing from any device, anywhere. Get a custom demo to see the difference for yourself.[DoIT] Visit doit.com (that’s d-o-i-t.com) to unlock intent-aware FinOps at scale with DoiT Cloud Intelligence.SHOW NOTES: Unframe websiteTopic 1 - Shay & Larissa, welcome to the show! Give everyone a brief introduction and a little about your background. Topic 2 - Today, we’re discussing AI Security and Enterprise Platforms. What are the problems or issues you see with AI development today? Topic 3 - Is this where an AI platform comes into play? I’m seeing more and more about this term and wondering what it truly means to be a platform. What is your definition of a platform, and what are the advantages? Topic 4 - Shay, considering your background in APIs and API security, how does that knowledge transfer into this space? Topic 5 - Larissa, with your background in operations, where do you see the inefficiencies in AI development and lifecycle management of the AI models and the datasets? Topic 6 - Let’s talk about Unframe. Give everyone an overview. Is this a SaaS service? How and where does it fit into your typical AI development stack? Topic 7 - If listeners want to get started and learn more, what’s the best way to get started? FEEDBACK? @cloudcastpod.bsky.social@cloudcastpod@cloudcastpod@cloudcastpod

Are we beginning to see the dawn of a 2nd phase of Cloud Computing, as AI begins to become a workload that impacts every aspect of the previous era of Cloud? Let’s explore… SHOW: 948 SHOW TRANSCRIPT: The Cloudcast #948 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST: "CLOUDCAST BASICS" SHOW SPONSORS: [DoIT] doit.comd-o-i-t.com[VASION] custom demoSHOW NOTES: CLOUD 1.0 vs. CLOUD 2.0 FEEDBACK? @cloudcastpod@cloudcastpod.bsky.social@cloudcastpod@cloudcastpod

Brian Gracely (@bgracely) Aaron Delp (@aarondelpt) and Brandon Whichard (@bwhichard, @SoftwareDefTalk) discuss the top stories in Cloud and AI from July 2025. SHOW: 947 SHOW TRANSCRIPT: The Cloudcast #947 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS" SPONSORS: [VASION] custom demo[DoIT] doit.comd-o-i-t.comSHOW NOTES: Link to July 2025 News and ArticlesFEEDBACK? Email: Bluesky: @cloudcastpod.bsky.socialTwitter/X: @cloudcastpodInstagram:@cloudcastpodTikTok:@cloudcastpod

The hardest thing for any growing company to do is manage the transition from hypergrowth to the dual tracks of growth and stability. AWS is entering their Hybrid phase, or the transition from Day 1 to Day 2. How will it go? SHOW: 946 SHOW TRANSCRIPT: The Cloudcast #946 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST: "CLOUDCAST BASICS" SHOW SPONSORS: [DoIT] doit.comd-o-i-t.com[VASION] custom demoSHOW NOTES: Amazon Q2 (July 2025) ResultsReviewing Amazon/AWS Q2 2025 Results (CNBC)AWS QoQ Earnings Growth Rates (2014-2025)Andy Jassy defends Amazon/AWS AI strategyAmazon Q2 2025 Earnings Call TranscriptUpdate from Andy Jasay Amazon Generative AI (Amazon Internal)HOW WILL AWS HANDLE DAY 1 AND DAY 2? FEEDBACK? @cloudcastpod@cloudcastpod.bsky.social@cloudcastpod@cloudcastpod

Elliot Shmukler (Co-Founder and CEO at Anomalo) talks about the impact of data quality on AI, how unstructured data can be improved, and how monitoring of data lakes can help prevent model drift and give organizations confidence with predictable results. SHOW: 945 SHOW TRANSCRIPT: The Cloudcast #945 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotw NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS" SPONSORS: doit.comd-o-i-t.comcustom demoFCTR.ioSHOW NOTES: Anomalo websiteThe Cloudcast #598 - Data QualitySnowflake invests in AnomaloTopic 1 - Elliot, welcome back! It’s hard to believe it has been 3 years since we spoke! Give everyone a brief introduction. Topic 2 - Here’s the problem I see when it comes to AI adoption today. There isn’t an “off the shelf” AI model with an organization's data built in; that’s impossible. So, you must bring this data, often unstructured, to the model, often with mixed results. Do you agree? Topic 3 - I see data quality in two ways… the quality of the data before ingestion is one way, we want the data to be clean going in. But, we also need a way to detect, mitigate, and do a root cause analysis for quality checks along the way, correct? Give everyone an idea of what this life cycle looks like. Topic 4 - What are you seeing as the barriers to adoption? Is it the tools, the models, the need for RAG pipelines, the lack of data scientists, and AIOps? Topic 5 - We have this crossroads where proprietary data makes an organization unique, but exposing that unique data puts the organization at risk. How much of a factor does this play, and how do you advise organizations around this complex intersection Topic 6 - There is always this concept of predictable results. This answer should be consistent and repeatable. We’ve seen things like model/data drift and hallucinations hinder this concept, leading to a lack of confidence in the results. How do you advise organizations to tackle this lifecycle management and predictability over time? Topic 7 - If listeners want to get started and learn more, what’s the best way to get started? FEEDBACK? @cloudcastpod.bsky.social@cloudcastpod@cloudcastpod@cloudcastpod

If the AI Agent hype ends up being real, how will businesses manage AI Agents from the perspective of people vs. non-people? SHOW: 944 SHOW TRANSCRIPT: The Cloudcast #944 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST: "CLOUDCAST BASICS" SHOW SPONSORS: [VASION] custom demo[FCTR] FCTR.io[DoIT] doit.comd-o-i-t.comSHOW NOTES: Batch jobs vs Cron jobsRobotic Process AutomationWhat is AIOps?AI Platform goes rogue, deletes company database (Replit)How do consultants think about AI AgentsWHAT IF AI AGENTS ARE SUCCESSFUL? FEEDBACK? @cloudcastpod@cloudcastpod.bsky.social@cloudcastpod@cloudcastpod

Luke Marsden, CEO and Founder, HelixML talks about Private GenAI. What is it? Why do you need it? We also discuss integration into CI/CD pipelines, the layers of a Private GenAI Stack, and why most organizations are opting for RAG over fine-tuning LLMs. SHOW: 943 SHOW TRANSCRIPT: The Cloudcast #943 Transcript SHOW VIDEO: https://youtube.com/@TheCloudcastNET NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS" SPONSORS: doit.comd-o-i-t.comFCTR.iocustom demoSHOW NOTES: HelixML websiteHelixML GitHubHelix 1.0 Announcement BlogTopic 1 - Welcome to the show Luke. Give everyone a brief intro. Topic 2 - Let’s start with Priavte GenAI. What is it? Why should organizations out there consider it? Why not just use OpenAI GPT’s and fine tune them? Topic 2a Follow up - Regulatory Compliance - take the opposing forces in the EU for instance to using SaaS based services based in the United States. Topic 3 - Let’s break down the layers in a typical Private AI stack. I’m seen various ways to represent this such as infrastructure layer, MLOps layer, models, data layer (typically RAG), etc. How do you break up the stack into individual components Topic 4 - My mind immediately jumps to similarities in the DevOps space. Abstraction layers and components like Docker and containers comes to mind, integration into CI/CD pipelines, etc. I feel like MLOps is it’s own thing with specific tools and workflows. Does this all come together and if so how? Topic 5 - Also, what does this mean for versioning and lifecycle management of the models and the data? Topic 6 - We are seeing more and more data pipelines with backed by multiple models, sometimes in multiple locations. How do handle this from both a scheduling and interface standpoint? Is everything hidden behind APIs for instance? Topic 7 - If anyone is interested, what’s the best way to get started? FEEDBACK? @cloudcastpod.bsky.social@cloudcastpod@cloudcastpod@cloudcastpod