The Cloudcast-logo

The Cloudcast

Technology Podcasts

The Cloudcast (@cloudcastpod) is the industry's #1 Cloud Computing podcast, and the place where Cloud meets AI. Co-hosts Aaron Delp (@aarondelp) & Brian Gracely (@bgracely) speak with technology and business leaders that are shaping the future of business. Topics will include Cloud Computing | AI | AGI | ChatGPT | Open Source | AWS | Azure | GCP | Platform Engineering | DevOps | Big Data | ML | Security | Kubernetes | AppDev | SaaS | PaaS .

Location:

United States

Description:

The Cloudcast (@cloudcastpod) is the industry's #1 Cloud Computing podcast, and the place where Cloud meets AI. Co-hosts Aaron Delp (@aarondelp) & Brian Gracely (@bgracely) speak with technology and business leaders that are shaping the future of business. Topics will include Cloud Computing | AI | AGI | ChatGPT | Open Source | AWS | Azure | GCP | Platform Engineering | DevOps | Big Data | ML | Security | Kubernetes | AppDev | SaaS | PaaS .

Language:

English


Episodes
Ask host to enable sharing for playback control

Using AI to Build Tech Communities

5/22/2024
Jonas Rosland (@jonasrosland, Head of Open Source Community @CIQ) talks about using AI tools to accelerate building and communications in Open Source Software (OSS) communities. We also discuss the differences between Community Roles and Dev Rel. SHOW: 823 SHOW TRANSCRIPT: The Cloudcast #823 CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS" SHOW SPONSOR: Neo4j explores knowledge graphs and vector searchNeo4j.com/developer SHOW NOTES: Jonas’ session abstract from All Things Open (ATO) 2023Session slides and description of the talkHit Save! - Video Game Preservation CIQ Enterprise Linux Platform Topic 1 - Good Afternoon Jonas! Give everyone a quick background on your time building open-source communities and a bit about your foundation. We’ll dig into both areas today. Topic 2 - We caught up at All Things Open last fall. You gave a fascinating talk on using AI tools to accelerate the building of OSS communities. Give everyone the backstory on how that topic and presentation came to be. Topic 3 - This may be a dumb question, but DevRel is (still) all the rage. What is the difference between the approach to building OSS communities and the straight-up DevRel teams? How is success tracked in each? Are there solid metrics, or is it “fuzzy”? Topic 4 - Sadly, as far as I can tell, the session wasn’t recorded. But, for me, the big takeaway was how much dabbling you were doing with the tools and your good and bad experiences. I learned a lot from a practical aspect. But, the AI industry and tools are moving so fast. What’s in your toolbox today and why? Topic 5 - What are some of the gaps in the tools today? What’s missing? Topic 6 - Let’s talk about your side gig. You were part of the founding team and are exec director of a video game preservation society, Hit Save! How did that come to be? What does that entail? FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:34:44

Ask host to enable sharing for playback control

Lessons Learned from AWS Leadership Transition

5/19/2024
After just three years, AWS is making another change at the top of the leadership org-chart. What lessons can we learn from leadership transitions and what might come next? SHOW: 822 SHOW TRANSCRIPT: The Cloudcast #822 SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS" SHOW NOTES: Andy Jassy makes AWS leadership announcement“There’s no AI without the cloud”, says AWS CEOSix things to know about the new AWS CEO, Matt Garmin AWS HAS NEW LEADERSHIP. WHY NOW? WHAT LESSONS CAN WE LEARN FROM SELIPSKY’S 3 YEARS AS AWS CEO [Andy on X] Lead Amazon, married and father of two kids, big sports/music/film fan, experienced buffalo wings eater. Go Kraken! [Adam on X] Husband & dad. Water skier/tennis player. Fan of Seahawks & Sounders. CEO at #AWS. FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:33:00

Ask host to enable sharing for playback control

AI Safety and Regulation

5/15/2024
Mark Collier (@sparkycollier, COO @openInfradev) talks about the advantages of open source AI and the intersection of OSS and AI transparency, safety, and potential regulations. SHOW: 821 SHOW TRANSCRIPT: The Cloudcast #821 CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS" SPONSOR: Neo4j.com/developerSHOW NOTES: Mark’s Talk at ATOEU AI Act PassesHow Tech Giants Cut Corners Harvest DataThe EU Guide Act - A Guide for DevelopersOpenInfra FoundationTopic 1 - Our topic for today is AI Safety and Regulation. I saw our guest speak at All Things Open here in Raleigh late last year and he is also a Cloudcast alumnus having been on the show previously talking about OpenStack and the OpenInfra Foundation. We’d like to welcome Mark Collier (Chief Operating Officer @ OpenInfra Foundation) for this discussion. Mark, welcome to the show. Topic 2 - There’s a lot of news today about AI safety and regulation. The industry also seems to be caught up in an AI arms race of who has the bigger model, faster model, etc. OpenAI have become the early category leader but they might have started with good intentions, but, contrary to their name, they aren’t open… at all. One message in your talk is how open-source software will prevent the coming of the “AI overlords”. Tell everyone a bit of what you mean by this. What is the problem we are facing and many may not even realize it. Topic 3 - I don’t want to call you old (I think we are about the same age), but you’ve seen some things. You’ve also been around OSS and foundations for a bit now. How can open source solve the problem? Topic 4 - We hear a lot about AI regulation, but this seems to be a moving target. What is both the current and future state of AI regulation? In my opinion, we haven’t seen a lot of successful regulations to date. We saw recently the EU pass an AI Act. Is this the first of many? The start of a trend? Topic 5 - Let’s talk about the “day job”. What’s new with OpenInfra Foundation these days? Topic 6 - OpenStack releases are still going strong and you’ve even run out of letters on OpenStack releases and have rolled around on the alphabet and are back to C. This is the 29th release of OpenStack. What’s the news for the Caracal release? FEEDBACK? Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

Duration:00:31:06

Ask host to enable sharing for playback control

Bringing Open Source to AI

5/11/2024
Happy Mothers Day! And let’s explore some new happenings at the intersection of open source and AI. SHOW: 820 SHOW TRANSCRIPT: The Cloudcast #820 SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS" SHOW NOTES: InstructLab ProjectLAB: Large-Scale Alignment for ChatBotsGranite LLMs7b-base model7b-lab modelInstructLab: What is contributing to AI LLM models was easy? HAPPY MOTHERS DAY TO ALL THE MOMS OPEN SOURCE MEETS AI RAG (retrieval augmented generation) FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:26:02

Ask host to enable sharing for playback control

Front-End Clouds and Web Development

5/8/2024
Malte Ubl (@cramforce, CTO @Vercel) talks about Front-End web development and clouds, how AI impacts front-end infrastructure, and impacts to the business. SHOW: 819 CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS" SHOW NOTES: Vercel (homepage)Elevate your frontend with AIV0.devTopic 1 - Our topic for today is front-end development and front-end clouds, and we’ll also explore AI-generated front ends. Our guest is Malte Ubl, CTO at Vercel. Malte, welcome to the show. Give everyone a quick background on your time at Vercel and Google Search. Topic 2 - Let’s start at the start. We hear all the time about front-end developers and back-end developers. What is your definition of a front-end and, more specifically, a front-end cloud? Topic 3 - What are the most common use cases you see today? What problem are you solving when you talk to organizations? Topic 4 - How much of a front-end is typically integrated with 3rd party services, and how much is build your own? Topic 5 - Where does AI fit into this from a developer's perspective? Are we to the point where we can develop a front-end from a prompt? Topic 6 - Let’s talk about the business side of this. Do companies typically have a “front-end problem”? If so, what does it look like, and how do they know? FEEDBACK? Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

Duration:00:26:59

Ask host to enable sharing for playback control

Identifying Leadership Traits to Follow

5/5/2024
What are the key characteristics and red flags with today’s leaders in the tech industry? How to identify the leadership skills, the team building skills, and the execution skills. SHOW: 818 SHOW TRANSCRIPT: The Cloudcast #818 SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS" SHOW NOTES: WHERE ARE THE LEADERS IN THEIR CAREERS? LEADERSHIP SKILLS, TEAM BUILDING, EXECUTION AND RED FLAGS FEEDBACK? Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod

Duration:00:24:22

Ask host to enable sharing for playback control

Cloud News of the Month - April 2024

5/1/2024
Aaron (@aarondelp) and Brian (@bgracely) talk about all the major news stories in Cloud and AI from April 2024 SHOW: 817 TRANSCRIPT: Cloudcast #817 - CNOTM - April 2024 CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS" SHOW NOTES: LINKS TO ALL ARTICLES FOR APRIL 2024 CLOUD NEWSSegments Covered in the Show: FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:43:06

Ask host to enable sharing for playback control

Open Source and Business…sigh

4/28/2024
Every few years we have to be reminded that open source isn’t a business model. Let’s talk about the business dynamics that everyone seems to keep forgetting. SHOW: 816 SHOW TRANSCRIPT: The Cloudcast #816 SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS" SHOW NOTES: Adam Jacobs discusses open source and business“figure out how to play nice with competition”The will never be another Red Hat - Economics of OSSOPEN SOURCE IS A LICENSE, NOT A BUSINESS MODEL FREE, FREE TIERS, EXTENSIONS, CLONES FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:32:28

Ask host to enable sharing for playback control

Sizing AI Workloads

4/24/2024
John Yue (CEO & Co-Founder @ inference.ai) discusses AI workload sizing, matching GPUs to workloads, availability of GPUs vs. costs, and more. SHOW: 815 CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS" SHOW NOTES: Inference.ai (homepage)TechCrunch postSiliconAngle post on ChatGPUTopic 1 - Our topic for today is sizing and IaaS hosting for AI/ML. We’ve covered a lot of basics lately, today we’re going to dig deeper. There is a surprising amount of depth to AI sizing, and it isn’t just speeds and feeds of GPUs. We’d like to welcome John Yue (CEO & Co-Founder @ inference.ai) for this discussion. John, welcome to the show Topic 2 - Let’s start with sizing, I’ve talked to a lot of customers recently with my day job, and it is amazing how deep AI/ML sizing can go. First, you have to size for training/fine-tuning differently than you would for the inference stage. Second, some just think, pick the biggest GPUs you can afford and go. How should your customers approach this? (GPU’s, software dependencies, etc.) Topic 2a - Follow-up question what are the business side, what are the business parameters that need to be considered? (budget, cost efficiency, latency/response time, timeline, etc.) Topic 3 - The whole process can be overwhelming and as we mentioned, some organizations may not think of everything. You recently announced a chatbot to help with this exact process, ChatGPU. Tell everyone a bit about that and how it came to be. Topic 4 - This is almost like a match-making service, correct? Everyone wants an H100, but not everyone needs or can afford an H100. Topic 5 - How does GPU availability play into all of this? NVIDIA is sold out for something like 2 years at this point; how is that sustainable? Does everything need to run on a “Ferrari class” NVIDIA GPU? Topic 6 - What’s next in the IaaS for AI/ML space? What does a next-generation data center for AI/ML look like? Will the Industry move away from GPUs to reduce dependence on NVIDIA? FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:33:34

Ask host to enable sharing for playback control

The Maintenance Episode

4/21/2024
For some strange reason, “maintenance” has been in the news quite a bit lately. Is there ever a time when maintenance is enjoyable, or appreciated? SHOW: 814 SHOW TRANSCRIPT: The Cloudcast #814 SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS" SHOW NOTES: AWS increased the price of longer-running EKS clusters by 6xBroadcom changes VMware licensing from perpetual to subscriptionBroadcom offers security patches to perpetual license customersIncreasing the Kubernetes support window to 1 yearDiscovering the XZ backdoor (Oxide and Friends, podcast)IS MAINTENANCE EVER APPRECIATED OR ENJOYABLE? TECHNICAL DEBT VS. MAINTENANCE FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:21:51

Ask host to enable sharing for playback control

Synthetic Data for AI

4/17/2024
Kalyan Veeramachaneni (@kveeramac, CEO/Founder @DataCebo) discusses the generation and value proposition of synthetic data for GenAI. SHOW: 813 CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS" SHOW NOTES: DataCebo (homepage)Synthetic Data Vault - SDVTechCrunch ArticleMIT News ArticleTopic 1 - Our topic for today is synthetic data. While the concept and need for synthetic data has been around for a long time, it isn’t a topic that typically comes to the forefront and something we haven’t talked about until today. Today is a bit of crossing the streams between developers and testing data and using GenAI to achieve this goal. For this, we’re joined by Kalyan, CEO and Co-Founder of DataCebo. Welcome to the show Topic 2 - First, for those not familiar, what is synthetic data? What is the use case and need? What problem is it solving today? Topic 2a - Hopefully, listeners out there are making the connection to the advantages of GenAI for synthetic data, but take us through your original concept at MIT and the history of Synthetic Data Vault (SDV). Topic 3 - We recently did a show on the security and privacy of training LLMs where we covered the need to mask PII for the training of models for compliance. I can also see bias issues coming into play or maybe training data that doesn’t exist in the real world (weather models example). What are some of the use cases that you’ve seen require synthetic data sets. Are there certain industries (healthcare, financials, etc.) that benefit? Topic 4 - You were designing this based on GenAI before GenAI was “cool”. How has the rise of LLMs impacted this space? Topic 5 - If I understand this correctly, organizations would put generative AI on a problem to describe a need for a data set, the model would then evaluate the available data and create a quality synthetic or “fake” dataset. How would the organization verify the quality of the dataset? How would they validate that a synthetic data set is as good as the original data? Topic 6 - Let’s talk about resources for a bit. When I think of GenAI and training, I think of large amounts of hardware and in particular GPU’s that might have limited availability. Is that true here? Also, is this on-prem or in the cloud, or both? FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:25:58

Ask host to enable sharing for playback control

The Fear and Excitement of Learning in a new era

4/14/2024
With the AI Era upon us, the challenge of trying to learn and make sense of the technologies, the business opportunities and the pitfalls is both exciting and equally terrifying. SHOW: 812 SHOW TRANSCRIPT: The Cloudcast #812 SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS" SHOW NOTES: WHEN WAS THE LAST TIME YOU REALLY LEARNED SOMETHING NEW IN TECH? PICK A TOPIC, READ, BE CONFUSED, LOOK FOR CONFIRMATION, RINSE, REPEAT FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:31:53

Ask host to enable sharing for playback control

Building Media and Streaming Platforms

4/10/2024
Brad Winett (President/Co-founder @TrackItCloud) talks about platforms for entertainment and media. Topics include use cases, partnering with AWS, and creation and consulting services. We even dig into AR and VR a bit at the end. SHOW: 811 CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS" SHOW NOTES: TrackIt (homepage)Topic 1 - Our topic for today is media and entertainment in the cloud. I don’t believe we have ever done a show specifically on this topic, and there are some considerations worth talking about. For today, we have Brad Winett, President and Co-founder at TrackIt. Brad, welcome to the show. Let’s jump right in. The media industry as a whole has undergone major change, just like many others. Most of us see it from the consumer end as a cord-cutter. What made you jump into this market and this industry specifically? Topic 2 - Platforms and content distribution in the early days of cloud was a differentiator. I think back to Netflix, they initially had a market advantage because they were able to scale better and to more devices than anyone and even open sourced a number of internally developed items and were the AWS poster child. Over time, these user experiences have become the norm. How should people out there think about media platforms? Are we past the days of build your own? Topic 3 - What about use cases? Media streaming is pretty broad. What does a normal customer look like? Is this big streaming services, smaller companies, etc? Topic 4 - How much of the tech stack is AWS products and how much of the stack is custom typically? Walk us through what a media streaming stack looks like. How is this different from a SaaS provider providing a turnkey service? Topic 5 - I know TrackIt is a big AWS partner. Give everyone an overview of the landscape of AWS Partnership these days. Do you provide mainly professional services and consulting? Topic 6 - Where does open-source software fit into this? Topic 7 - I feel the standard last question these days is how AI will potentially enhance or impact this is some way. FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:31:34

Ask host to enable sharing for playback control

Will Enterprise AI adoption patterns follow Enterprise Cloud adoption?

4/7/2024
What will be the adoption patterns for AI within the Enterprise? Will it follow the early days of Cloud Computing, or will new and different patterns emerge? SHOW: 810 SHOW TRANSCRIPT: Cloudcast #810 SHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS" SHOW NOTES: WHAT WERE THE PATTERNS FOR ENTERPRISE IT AND CLOUD? WHAT’S DIFFERENT ABOUT AI vs. CLOUD? FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:28:13

Ask host to enable sharing for playback control

Cloud News of the Month - March 2024

4/3/2024
Aaron (@aarondelp) and Brian (@bgracely) discuss the biggest tech stories, announcements, and trends from March 2024. SHOW: 809 SHOW TRANSCRIPT: https://bit.ly/cloudcast-809-transcript CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS" SHOW NOTES: LINKS TO ALL THE ARTICLES FOR MARCH 2024 CLOUD NEWS Segments Covered in the Show: FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:33:24

Ask host to enable sharing for playback control

The $69B bet against replacement

3/31/2024
Let’s dig into the mindset behind the VMware price increases that have been happening since Broadcom acquired the company in 2023. SHOW: 808 CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS" SHOW SPONSORS: Enter the WS02 Choreo Code ChallengeWSO2 Choreo - Why build a platform? Just add developers instead SHOW NOTES: What VMware might look like under BroadcomWhat to do about VMwareVMware 10X Price Increase Leaves Companies Looking for AlternativesVMware pricing in the Broadcom Era BROADCOM IS FITTING VMWARE INTO THEIR BUSINESS MODEL IT'S A BOLD STRATEGY BROADCOM, LET’S SEE IF IT PAYS OFF FOR THEM FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:28:29

Ask host to enable sharing for playback control

LLM Security and Privacy

3/27/2024
Sean Falconer (@seanfalconer, Head of Dev Relations @SkyflowAPI, Host @software_daily) talks about security and privacy of LLMs and how to prevent PII (personally identifiable information) from leaking out SHOW: 807 CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS" SHOW SPONSORS: Enter the WS02 Choreo Code ChallengeWSO2 Choreo - Why build a platform? Just add developers insteadimmediate and ongoing savingsSHOW NOTES: SkyFlow (homepage)Partially Redacted PodcastSoftware Engineering DailyTopic 1 - Our topic for today is the security and privacy LLMs. What’s Sean’s origin story? Topic 2 - Let’s dig into LLM security and privacy. We see this concern a lot on the podcast and we’ve touched on it with various past shows, but we haven’t dug in deep. First, let’s frame the problem. What are we talking about when we talk about LLM security and privacy? Topic 3 - First, there is a fear that customer PII information might leak out. Second, company IP or confidential into might leak out related to products or offerings. We’ve seen examples of both to date. This could be exposed in the form of integration into a model (query it for the answer) or in the fine-tuning or RAG stage. Either one could lead to compliance issues, lost rev etc. But, that same data at risk is the potential differentiation of the models. How do you both mask the data but take advantage of the data? Topic 4 - One thing I’ve noticed is many orgs only think about privacy in relation to the fine-tuning stage where they are taking a broad model and making it company specific. It is about much more than that though. Just like standard software development, we have different stages. How is the data collected and stored, how is it used for training and fine-tuning, how is it used after deployment and during interaction stage, etc. How should security and privacy be handled across all phases? Topic 5 - Let’s talk beyond LLMs for a bit. What about Data Lakes and Data Warehousing? I see this as a problem across all big data, correct? Topic 6 - How does API security fit into this? Much of what we are talking about is at the storage and retrieval level. But, increasingly we see API issues exposing data. How does that fit in here? Topic 7 - Let’s talk podcasts, we had Jeff, the previous host of Software Engineering Daily on a few times. How are things over at Software Engineering Daily? Tell everyone a bit about the show. FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:26:56

Ask host to enable sharing for playback control

Cloud Fundamentals needed for AI

3/24/2024
If you’re planning to deploy AI for your business, here’s 5 important capabilities your business needs from the cloud era in order to be successful. SHOW: 806 CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS" SHOW SPONSORS: Enter the WS02 Choreo Code ChallengeWSO2 Choreo - Why build a platform? Just add developers insteadSHOW NOTES: The Year Ahead in Cloud and Expectations for AI in 2024 IF YOU WANT TO DO AI WELL, YOU NEED TO HAVE DONE CLOUD WELL 5 IMPORTANT CLOUD CAPABILITIES NEEDED TO SUCCEED WITH AI FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:21:55

Ask host to enable sharing for playback control

Building an AI Product Company

3/20/2024
Krish Ramineni (@krishramineni, CEO/Founder of @Firefliesai) talks about what it is like to build an AI product company in both the pre-LLM era as well as post-LLMs. We also discuss privacy and security concerns and AI behind the scenes. SHOW: 805 CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS" SHOW SPONSORS: Enter the WS02 Choreo Code ChallengeWSO2 Choreo - Why build a platform? Just add developers insteadSHOW NOTES: Fireflies.ai (homepage)Fireflies MIT ArticleTopic 1 - Welcome to the show. Before diving into today’s discussion, tell us a little about your background. Topic 2 - Our show and listeners tend to be interested and employed in the Enterprise infrastructure and AI/ML space. Some may find it surprising that we are talking today, but we wanted to really dig into how an up-and-coming AI company provides value at scale from individuals all the way to large enterprises. What goes into both building the product as well as taking that product to market? So, let’s start there. You recently posted about “Free AI” on LinkedIn. What was the problem you were trying to solve, and how did that influence the product you built? Topic 3 - As the foundational models in the industry keep improving and are going multi-modal, do you worry that the LLMs of the world might push out specialized models? How do you think about staying ahead of the curve? How does something like GPU shortages or big companies like Meta purchasing thousands at a time impact your decisions? Topic 4 - Fireflies.ai is all about the abstraction of the technology away from the user. They have no idea (and shouldn’t) about the back end and everything “behind the curtain”. How do you think about this abstraction layer from a product standpoint? Topic 5 - Now, let’s talk about PLG vs. traditional Enterprise software sales models. You did another post about that recently. We’ve worked in environments selling both (sometimes at the same time), and they are very different motions. Do you feel both are needed to build an AI company? Topic 6 - How does Security and compliance with IT departments fit into all of this? I’ve spoken to customers that have a policy of no AI tools at the personal level for instance or maybe client, company and private data might be at risk and only certain tools are vetted and approved. I’ve seen other companies only allow tools licensed by their corp IT. How do you navigate this issue? How does something like GDPR play here? Topic 7 - Last question, another AI specific concern we hear about is companies training models on user data. What is your thoughts here? How does a company fine tune and train new models and products but keep customer and company privacy from leaking out? FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:26:16

Ask host to enable sharing for playback control

What if the CNCF was private equity?

3/17/2024
For years, the CNCF has been the central governance body for cloud-native projects. But are there too many projects now? What if the CNCF was less governance and more like private equity? SHOW: 804 CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS" SHOW SPONSORS: Enter the WS02 Choreo Code ChallengeWSO2 Choreo - Why build a platform? Just add developers insteadSHOW NOTES: CNCF LandscapeCNCF Trail MapWHY DOESN’T THE CNCF RECOMMEND A CLOUD-NATIVE STACK? HOW MANY PROJECTS WOULD GET “CNCF APPROVED” IF THEY TOOK A PRIVATE EQUITY APPROACH? FEEDBACK? @cloudcastpod@cloudcastpod@cloudcastpod

Duration:00:22:53