Experimental Mind #253
Your weekly overview of interesting reads, events and jobs for the experimental mind.
Hi folks! In this edition ideas five reads, one video, five jobs and a couple of events. Enjoy.
Thanks to Convert and Sitespect for their support.
đ Interesting things you might have missed
What is Experimentation-led Growth (ELG)? by Jonny Longden
Most businesses misunderstand experimentation, reducing it to A/B testing and website tweaks, when it should be about critical thinking, evidence-based decision-making, and innovation. Experimentation-Led Growth (ELG) shifts the focus from isolated tests to a broader strategic mindset, using experimentation as a tool for smarter business decisions, systemic thinking, and long-term growth. Link
____
Reflections from Superweek by Mark Pybus
Mark Pybus wrote some reflections on his visit to the Supwerweek conference. âThe future isnât just about running tests; itâs about leveraging experimentation to deliver meaningful value for both customers and businesses. By connecting data, outcomes, and teams, weâre unlocking a new era of innovation.â Link
____
How Microsoftâs Experimentation adapted to EU data protection
Microsoft's Experimentation Platform (ExP) adapted to EU data protection rules by developing a scorecard merging solution that enables global experiment analysis while respecting data boundaries. This approach ensures accurate decision-making across regions by merging regional results using advanced statistical methods and rigorous validation. Link
____
Guide to building an internal feature flagging system by Brock Lumbard
Ever thought of building your own feature flagging system? Brock Lumbard lists all the design decisions you will need to make and some implementation details. Link
____
OKRs for Internal Products by Jeff Gothelf
OKRs for internal products should focus on the success of the internal teams using them, just as they would for external customers. By identifying internal users and measuring their behavior (such as efficiency gains, adoption rates, and leading indicators of impact) teams can ensure their work supports colleagues in achieving their goals. Link
____
The Beautiful Mess now on YouTube
John Cutler started a YouTube channel and his goal is to post 100 videos in 2025. Follow him here for advice around anything product related. Below is an example of what to expect.
____
Last weekâs most clicked item:
âStop A/B testingâ
Avinash Kaushik is someone I admire a lot. He influenced much of my thinking about analytics. Recently Avinash published a post where he states that we can better stop A/B testing. That was a shocker to me. Of course, I agree that we should not do bad A/B testing, but stopping it all together is blaming the method, not the real thing that is broken. Ronny Kohavi wrote a detailed response, including a link to Avinashâs original piece. Link
đ§ Podcast of the week
If you like this episode, make sure to subscribe to the podcast. Or discover other podcasts via the Experimental Mind curated podcast feed.
đ Job opportunities
Find 100+ open roles on ExperimentationJobs.com. This weekâs featured roles:
Senior Technical Consultant (Experimentation) at Creative CX (United Kingdom)
Senior Conversion Rate Optimisation (Experimentation) Consultant at Conversion.com (Farringdon, United Kingdom)
Senior Product Designer, Growth and Experimentation at Yahoo (Multiple locations, USA)
Senior Growth & Conversion Rate Optimisation (CRO) Manager at Proton (Europe)
Senior Conversion Rate Optimization Specialist (CRO) at Exness (Cyprus)
đ
Upcoming events
A running list of upcoming events.
đ13 Feb: Berlin Experimentation Meetup #7 (Berlin, Germany)
đ26-28 Feb: Experimentation Island (USA) Get $250 discount on your ticket!
đAlso, don't miss GMS 2025 on June 18, 2025, in Frankfurt! As Europe's #1 growth conference, it's the perfect platform to learn, network, and grow. Use my promo code KEVIN100 to get âŹ100 off your ticket and be part of this event! For more details, visit the official website: www.growthmindedsuperheroes.com
đŁ How was this edition?
Let me know:
If you have made it to here and you are enjoying this newsletter, I would love to read a short testimonial from you.
Read what others are saying and add your own.
Have a great week â and keep experimenting.
Thanks, Kevin