The Analytics Power Hour

As the world turns, a couple of things happen: 1) we grow and learn, and 2) the world changes. On this episode, inspired by a job interview question, the hosts walked through a range of thoughts and beliefs they had at one time that they no longer have today. Analytics intake forms are good…or bad? Analytics centers of excellence are the sign of a mature organization…or they're just one of many potential options? Privacy concerns are something no one really cares about…or they are something everyone cares deeply about? Voices were raised. Light profanity was employed. Laughter ensued. This episode's Measurement Bite from show sponsor Recast is a brief explanation of statistical significance (and why shorthanding it is problematic…and why confidence intervals are often more practically useful in business than p-values) from Michael Kaminsky. For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Does size matter? When it comes to datasets, the conventional wisdom seems to be a resounding, "Yes!" But what about small datasets? Small- and mid-sized businesses and nonprofits, especially, often have limited web traffic, small email lists, CRM systems that can comfortably operate under the free tier, and lead and order counts that don’t lend themselves to "big data" descriptors. Even large enterprises have scenarios where some datasets easily fit into Google Sheets with limited scrolling required. Should this data be dismissed out of hand, or should it be treated as what it is: potentially useful? Joe Domaleski from Country Fried Creative works with a lot of businesses that are operating in the small data world, and he was so intrigued by the potential of putting data to use on behalf of his clients that he’s mid-way through getting a Master’s degree in Analytics from Georgia Tech! He wrote a really useful article about the ins and outs of small data, so we brought him on for a discussion on the topic! This episode’s Measurement Bite from show sponsor Recast is an explanation of synthetic controls and how they can be used as counterfactuals from Michael Kaminsky! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Data does not just magically spring into existence. Someone, somewhere, has to decide what data gets created and the rules for its creation. We would claim that this often starts as a pretty simple exercise, and then, over time, that simplicity balloons to be pretty complex! What if, for instance, you decided to listen to every #1 song on the Billboard Hot 100 going back to its inception in 1958? You may start by just capturing the song name, the artist, and the week(s) it was the #1 song. But, before you know it, you may find that you’re adding in artist details…and songwriter details…and producer details…and genre details…and instrumentation details, and your dataset has 105 columns! But, oh, the questions that dataset could answer! And that’s exactly the dataset that our guest for this episode, Chris Dalla Riva, created. He uses it (with a range of supplemental datasets) for his pieces in his Substack, Can’t Get Much Higher, as well as the underlying raw material for his upcoming book, Uncharted Territory: What Numbers Tell Us about the Biggest Hit Songs and Ourselves. While the underlying material was music, the parallels to more staid business data were many when it comes to the underlying processes and challenges for doing that work! This episode's Measurement Bite from show sponsor Recast is an explanation of the miracle of randomization when it comes to addressing unobserved confounders from Michael Kaminsky! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

From spreadsheets to strategy: what does data look like from the CEO’s chair? For this episode, we sat down with Anna Lee, CEO of Flybuys and former CFO/COO of THE ICONIC, to get her view on data-led leadership and what great looks like in data and analytics. Discover how Anna's journey from finance to the corner office has shaped her approach to leveraging evidence for strategic decision-making. From productive curiosity, to informed pragmatism, and how data teams can build trust with leadership, this is a candid conversation about analytics from the top down. Whether you’re embedded in a squad or building the next big data platform, this one’s for anyone who’s ever wondered what it takes to truly influence the C-suite! This episode's Measurement Bite from show sponsor Recast is an overview of the fundamental problem of causal inference from Michael Kaminsky! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

If you didn’t have a visceral reaction to the title for this episode, then you are almost certainly not in our target audience. There are few more certain ways to get a room full of analytics folk fired up than to raise the topic of dashboards. Are they where data goes to die, or are they the essential key to unlocking self-service access to actionable insights? Are they both? Is the question irrelevant, because, if they exist to inform business users, aren’t they soon going to be replaced by an AI-powered chatbot, anyway? We thought a great way to dig into the topic (and, BTW, we were right) would be to have someone on the show who has co-penned multiple books on the topic. As luck would have it, Andy Cotgreave, one of the co-authors of both 2017’s The Big Book of Dashboards: Visualizing Your Data Using Real-World Business Scenarios and the imminently releasing Dashboards That Deliver: How to Design, Develop, and Deploy Dashboards That Work agreed to join us for a lively chat on the topic! This episode’s Measurement Bite from show sponsor Recast is a quick explanation of power analysis from Michael Kaminsky! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

What is "process" in analytics? On the one hand, it can be seen as a detailed sequence of minutia by which anything that needs to be repeated in the world of analytics gets carried out in a structured and consistent manner. On the other hand, that’s the sort of definition that strikes terror and rage in the hearts of many souls. Some of those souls are co-hosts of this podcast. Even the For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Imagine a world where business users simply fire up their analytics AI tool, ask for some insights, and get a clear and accurate response in return. That’s the dream, isn’t it? Is it just around the corner, or is it years away? Or is that vision embarrassingly misguided at its core? The very real humans who responded to our listener survey wanted to know where and how AI would be fitting into the analyst’s toolkit, and, frankly, so do we! Maybe they (and you!) can fire up ol’ Claude and ask it to analyze this episode with Juliana Jackson from the Standard Deviation podcast and Beyond the Mean Substack to find out! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Did you know that, upon closer inspection, many a statistical test will reveal that "it's just a linear model" (#IJALM)? That wound up being a key point that our go-to statistician, Chelsea Parlett-Pelleriti, made early and often on this episode, which is the next installment in our informally recurring series of shows digging into specific statistical methods. The method for this episode? ANOVA! As a jumping off point to think about how data works—developing intuition about mean and variance (and covariates) while dipping our toes into F-statistics, family-wise error rates (FWER), and even a little Tukey HSD—ANOVA’s not too shabby! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Product managers for BI platforms have it easy. They "just" need to have the dev team build a tool that gives all types of users access to all of the data they should be allowed to see in a way that is quick, simple, and clear while preventing them from pulling data that can be misinterpreted. Of course, there are a lot of different types of users—from the C-level executive who wants ready access to high-level metrics all the way to the analyst or data scientist who wants to drop into a SQL flow state to everyone in between. And sometimes the tool needs to provide structured dashboards, while at other times it needs to be a mechanism for ad hoc analysis. Maybe the product manager’s job is actually…impossible? Past Looker CAO and current Omni CEO Colin Zima joined this episode for a lively discussion on the subject! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

It’s a process few people genuinely enjoy, but it’s one which we all find ourselves going through periodically in our careers: landing a new job. We grabbed MajorData himself, Albert Bellamy, for a wide-ranging discussion about the ins and outs of that process: LinkedIn invitation etiquette (and, more importantly, effectiveness), how networking is like spousal communication (!), the usefulness of reducing the mental load required of recruiters and hiring managers, and much, much more! You might just want to drop and do twenty push-ups by the end of the episode! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Synthetic data: it's a fascinating topic that sounds like science fiction but is rapidly becoming a practical tool in the data landscape. From machine learning applications to safeguarding privacy, synthetic data offers a compelling alternative to real-world datasets that might be incomplete or unwieldy. With the help of Winston Li, founder of Arima, a startup specializing in synthetic data and marketing mix modelling, we explore how this artificial data is generated, where its strengths truly lie, and the potential pitfalls to watch out for! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Is it just us, or are data products becoming all the rage? Is Google Trends a data product that could help us answer that question? What actually IS a data product? And does it even matter that we have a good definition? If any of these questions seem like they have cut and dried answers, then this episode may just convince you that you haven't thought about them hard enough! After all, what is more on-brand for a group of analysts than being thrown a question that seems simple only to dig in to realize that it is more complicated than it appears at first blush? On this episode, Eric Sandosham returned as a guest inspired by a Medium post he wrote a while back so we could all dive into the topic and see what we could figure out! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

No matter how simple a metric's name makes it sound, the details are often downright devilish. What is a website visit? What is revenue? What is a customer? Go one level deeper with a metric like customer acquisition cost (CAC) or customer lifetime value (CLV or LTV, depending on how you acronym), and things can get messy in a hurry. In some cases, there are multiple "right" definitions, depending on how the metric is being used. In some cases, there are incentive structures to thumb the definitional scale one way or another. In some cases, a hastily made choice becomes a well-established, yet misguided, norm. In some cases, public companies simply throw their hands up and stop reporting a key metric! Dan McCarthy, Associate Professor of Marketing at the Robert H. Smith School of Business at the University of Maryland, spends a lot of time and thought culling through public filings and disclosures therein trying to make sense of metric definitions, so he was a great guest to have to dig into the topic! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Data that tracks what users and customers do is behavioral data. But behavioral science is much more about why humans do things and what sorts of techniques can be employed to nudge them to do something specific. On this episode, behavioral scientist Dr. Lindsay Juarez from Irrational Labs joined us for a conversation on the topic. Nudge vs. sludge, getting uncomfortably specific about the behavior of interest, and even a prompting of our guest to recreate and explain a classic Seinfeld bit! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

We finally did it: devoted an entire episode to AI. And, of course, by devoting an episode entirely to AI, we mean we just had GPT-4o generate a script for the entire show, and we just each read our parts. It's pretty impressive how the result still sounds so natural and human and spontaneous. It picked up on Tim's tendency to get hot and bothered, on Moe's proclivity for dancing right up to the edge of oversharing specific work scenarios, on Michael's knack for bringing in personality tests, on Val's patience in getting the whole discussion to get back on track, and on Julie being a real (or artificial, as the case may be?) Gem. Even though it includes the word "proclivity," this show overview was entirely generated without the assistance of AI. And yet, it’s got a whopper of a hallucination: the episode wasn’t scripted at all! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

How is an outlier in the data like obscenity? A case could be made that they're both the sort of thing where we know it when we see it, but that can be awfully tricky to perfectly define and detect. Visualize many data sets, and some of the data points are obvious outliers, but just as many (or more) fall in a gray area—especially if they're sneaky inliers. z-score, MAD, modified z-score, interquartile range (IQR), time-series decomposition, smoothing, forecasting, and many other techniques are available to the analyst for detecting outliers. Depending on the data, though, the most appropriate method (or combination of methods) for identifying outliers can change! We sat down with Brett Kennedy, author of Outlier Detection in Python, to dig into the topic! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Do you cringe at the mere mention of the word, "insights"? What about its fancier cousin, "actionable insights"? We do, too. As a matter of fact, on this episode, we discovered that Moe has developed an uncontrollable reflex: any time she utters the word, her hands shoot up uncontrolled to form air quotes. Alas! Our podcast is an audio medium! What about those poor souls who got hired into an "Insights & Analytics" team within their company? Egad! Nonetheless, inspired by an email exchange with a listener, we took a run at the subject with Chris Kocek, CEO of Gallant Branding, who both wrote a book and hosts a podcast on the topic of insights! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Why? Or… y? What is y? Why, it's mx + b! It's the formula for a line, which is just a hop, a skip, and an error term away from the formula for a linear regression! On the one hand, it couldn't be simpler. On the other hand, it's a broad and deep topic. You've got your parameters, your feature engineering, your regularization, the risks of flawed assumptions and multicollinearity and overfitting, the distinction between inference and prediction... and that's just a warm-up! What variables would you expect to be significant in a model aimed at predicting how engaging an episode will be? Presumably, guest quality would top your list! It topped ours, which is why we asked past guest Chelsea Parlett-Pelleriti from Recast to return for an exploration of the topic! Our model crushed it. For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

In celebration of International Women’s Day, this episode of Analytics Power Hour features an all-female crew discussing the challenges and opportunities in AI projects. Moe Kiss, Julie Hoyer and Val Kroll, dive into this AI topic with guest expert, Kathleen Walch, who co-developed the CPMAI methodology and the seven patterns of AI (super helpful for your AI use cases!). Kathleen has helpful frameworks and colorful examples to illustrate the importance of setting expectations upfront with all stakeholders and clearly defining what problem you are trying to solve. Her stories are born from the painful experiences of AI projects being run like application development projects instead of the data projects that they are! Tune in to hear her advice for getting your organization to adopt a data-centric methodology for running your AI projects—you’ll be happier than a camera spotting wolves in the snow! 🐺❄️🎥 For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Every listener of this show is keenly aware that they are enabling the collection of various forms of hyper-specific data. Smartphones are movement and light biometric data collection machines. Many of us augment this data with a smartwatch, a smart ring, or both. A connected scale? Sure! Maybe even a continuous glucose monitor (CGM)! But… why? And what are the ramifications both for changing the ways we move through life for the better (Live healthier! Proactive wellness!) and for the worse (privacy risks and bad actors)? We had a wide-ranging discussion with Michael Tiffany, co-founder and CEO of Fulcra Dynamics, that took a run at these topics and more. Why, it's possible you'll get so excited by the content that one of your devices will record a temporary spike in your heart rate! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.