Experimental Mind #270
Your weekly overview of interesting reads, events and jobs for the experimental mind.
Last week, I attended Experimentation Elite in Birmingham, where my little job board received the Industry Contribution Award. I'm incredibly honored!
This week’s edition covers a bunch of interesting reports that came out: state of the agency/vendor landscape, how AI is reshaping research, new ways to think about product discovery, and key industry insights from Benedict Evans and Mary Meeker.
➡️ Agency & Vendor Experimentation Ecosystem 2025
A study by Craig Sullivan with 40 interviews and 200+ survey responses shows the current state of the agency/vendor landscape and the future growth opportunities.
Get the report from Convert
Thanks to Convert and Sitespect for their continued support.
🔎 Interesting things you might have missed
Faster, smarter, cheaper: AI is reinventing market research
AI is revolutionizing market research by automating surveys, analysis, and insights; replacing expensive, slow human panels with continuous, AI-powered simulations of consumer behavior. Link
____
Visualizing the world of causal inference
This interactive mind map presents a structured overview of methods for treatment effect estimation in causal inference grouped by its core identification strategy. Link
____
‘What is Discovery?’
Ant Murphy surveyed 40 product leaders and found that product discovery is fundamentally about reducing risk through continuous research and learning, not just before coding, but throughout the lifecycle, to gain confidence in desirable, viable, and feasible solutions. Link
____
The Product Operating Model explained
A product operating model empowers autonomous, cross-functional teams, combining product, engineering, operations, and other functions, to take full lifecycle ownership and deliver software solutions built as modular platforms. Link
____
Lightning Lessons
Maven introduces these short and free lightning lessions to accelerate your career. Link
____
AI eats the world
Every year, Benedict Evans produces a big presentation exploring macro and strategic trends in the tech industry. This is his latest one. Link
____
Mary Meeker’s AI Report
Another industry report from Mary Meeker with her view of the latest trends around Ai. With 340 pages a big one (have not read/skimmed it completely yet). Link
____
Last week’s most clicked item:
How to come up with tiny experiments
Anne-Laure Le Cunff suggests designing tiny experiments, small, low-risk actions, to explore new ideas and behaviors. By practicing self-anthropology, challenging fixed mindsets, drawing inspiration from others, leveraging constraints, and asking "What if...?", you can promote curiosity and adaptability in your daily life. Link
🚀 Job opportunities
Find 100+ open roles on ExperimentationJobs.com. This week’s featured roles:
Senior CRO Manager at Growth Shop (Canada)
Conversion Rate Optimisation Manager at Moss (Berlin, London, Amsterdam, Warsaw, Tallinn)
Senior Data Scientist - Experimentation Platform at Skyscanner (London or Barcelona)
Data Scientist – Economist at bol.com (Utrecht, Netherlands)
Head of Digital Content, SEO and CRO at MediaMarkt (Rotterdam, Netherlands)
📅 Upcoming events
A running list of upcoming events. Will I see you in Birmingham, Frankfurt, Amsterdam or at the virtual Women in Experimentation summit?
11 Jun: Student's T-Test Day (Murphy’s Pub, Seattle, USA)
12 Jun: DiDo #48: How to truly understand your customers (Utrecht, NL)
🎁18 Jun: GMS (Frankfurt, Germany, get €100 off
KEVIN100)🆕1 Jul: Berlin Experimentation Meetup #9 (Berlin, Germany
🆕3 Jul: EXL Meetup (Amsterdam, Netherlands)
🎁7 Jul: Accelerating Innovation with AB Testing (virtual, get $500 off)
9 Jul: Women in Experimentation Summit 2025 (virtual)
9 Jul: CRO & Growth Meetup (Paris, France)
💬 Quote to think about
Design like you’re right. Test like you’re wrong
— Skyscanner’s Hypothesis Kit
😃 Something that made me smile
👂How was this edition?
Let me know by clicking one of these options: Great | Good | OK | Meh
Or even better, simply hit reply. I read every email.
Have a great week — and keep experimenting.
Thanks, Kevin