Experimental Mind #264

Your weekly overview of interesting reads, events and jobs for the experimental mind.

Apr 28, 2025

Hi folks!

Another roundup of the best articles that I read last week.

➡️ How to increase customer loyalty with hybrid experimentation
Hybrid experimentation combines client-side and server-side testing within a single experiment and enables organizations to optimize both visual and functional aspects of the user journey simultaneously. It allows for faster iterations, more relevant experiences, and strengthens customer loyalty through continuous improvements.
Link to article from Sitespect

Thanks to Convert and Sitespect for their continued support.

🔎 Interesting things you might have missed

[Paper] On the persistent mischaracterization of Google and Facebook A/B tests
Ronny Kohavi pointed towards this paper: Online platform studies in marketing research often use tools like Facebook or Google Ads to observe real consumer behavior, but they lack true random assignment, making causal claims unreliable. A review of 133 studies shows that many mistakenly present their findings as causal experiments, and the authors provide guidance on how to properly position, conduct, and report such studies. Link

____

Experimentation Culture award nominees announced
Check out the nominees in the Rising Star, Team and Organization-wide categories. And join the May 22 to learn from them and celebrate the winners. Link

____

📘Book: Prove it or lose it
Rommil Santiago launched his new book: a practical guide that teaches you how to manage and defend an experimentation program using the GROW framework and stakeholder strategies. Link

____

Being evidence-driven in uncertain times
Even in highly uncertain times, organizations can remain evidence-driven by adapting their strategies and focusing on current realities rather than relying solely on historical data. Tim Wilson advises regularly revisiting business outcomes, identifying the most pressing problems, and aligning efforts to address them collaboratively, ensuring decisions are grounded in evidence and learning. Link

____

Testing with tariffs
Are people willing to pay extra for domestically made products? In this case, they are not. Link

____

Last week’s most clicked item:

How to host an internal experimentation summit in your org
Ben Labay from Speero interviewed experimentation leaders from organisations like BBC, Zalando, and Delivery Hero on how to successfully organise an internal experimentation summit. Includes a checklist for planning your own event. Link

🎧 Podcast of the week

If you like this episode, make sure to subscribe to the podcast. Or discover other podcasts via the Experimental Mind curated podcast feed.

🚀 Job opportunities, supported by Eppo

Find 100+ open roles on ExperimentationJobs.com. This week’s featured roles:

Senior CRO Specialist at Sofatutor (Berlin, Germany)
Senior Product Data Scientist at Gametime (USA)
CRO Manager at Road (Amsterdam, Netherlands)
CRO Optimization Specialist at Tend (New York, USA)
Data Scientist, Experimentation & Incremental Measurement at Lululemon (Vancouver, Canada)

📅 Upcoming events

A running list of upcoming events.

🎁29 Apr: Testing Business Ideas with ChatGPT (virtual, get $50 off)
🎁12 May: Accelerating Innovation with AB Testing (virtual, get $500 off)
15 May: Berlin Experimentation Meetup #8 (Berlin, Germany)
22 May: Experimentation Culture Awards (virtual)
🎁4-5 Jun: Experimentation Elite (Birmingham, UK, get 10% off: EXELITEJOBS10)

🎁Also, don't miss GMS 2025 on June 18, 2025, in Frankfurt! As Europe's #1 growth conference, it's the perfect platform to learn, network, and grow. Use my promo code KEVIN100 to get €100 off your ticket and be part of this event! For more details, visit the official website: www.growthmindedsuperheroes.com