Experimental Mind #218

Your weekly overview of interesting reads, events and jobs for the experimental mind.

May 21, 2024

Hi folks! In this week’s edition my favourite reads & listens, a career interview with Deborah O’Malley and something that made me smile. Let’s go.

➡️ The Convert X Women in Experimentation Annual Summit
This unique online event is free to attend and open to all. “Frameworks to use right away, authentic connections, and a huge haul of freebies…this summit gives you everything you need to progress in your experimentation career.”
Register here for free

Thanks to Convert, Sitespect, Exatom and Zoho PageSense for their support.

🔎 Interesting things you might have missed

Removing Dilution to Maximize Experiment Power
Blogpost by the DoorDash team about reducing or eliminating dilution Dilution happens when users that could not possibly have been impacted by the treatment, are part of the experiment. Preventing or removing it, will increase power.
Link to article

___

Experimentation Culture Awards
This Thursday Ton Wesseling will host the live broadcast of the yearly Experimentation Culture Awards. Always a great moment to celebrate the progress our industry is making. Registration is free.
Register here

___

Ask Me Anything
Last Thursday I did a fireside chat and AMA, hosted by Statsig about eveything experimentation. Let me know

___

A wealth of behavioural insights
The Dutch Behavioural Insights Network Netherlands (BIN NL) just released their fourth update report. It contains the results of 34 behavioural insights projects that have been carried out within the Dutch government, many of which have been tested in the field by a randomized controlled trial.
Link to report

___

Fixed-Power Designs: It’s Not IF You Peek, It’s WHAT You Peek at
Mårten Schultzberg from Spotify explains a method that is called fixed-power design. “In a fixed-power design, you start the experiment without an estimated sample size, estimate the required sample size from the currently available outcome data in the experiment, and stop when your current sample size is larger than the required sample size.“
Link to article
___

🎧 Podcast tip of the week
David Bland’s ‘How I Tested’ podcast has quickly become one of my favourites. These stories go beyond testing in the digital world. In the latest episode he interviews Aaron Slessinger about testing at HP.

Also added to the Experimental Mind curated podcast feed.

💬 My Experimentation Career Journey

Today’s interview is with Deborah O’Malley. Deborah is founder of GuessTheTest.com among many other things.

I see life as one, big ongoing experiment. In my work, my relationships, my health, and within myself, I strive for continuous optimization. — Deborah O’Malley

Read the full interview with Deborah

🚀 Job opportunities

Find 100+ open roles on ExperimentationJobs.com. This week’s featured roles:

CRO Specialist at Sofautor (Germany/Global)
CRO Marketing Specialist at Intellectsoft (Kyiv, Ukraine)
CRO Specialist at Soly (Amsterdam, Netherlands)
Marketing Effectiveness & Experimentation Manager at Bark (London, UK)
Senior Experimentation Manager at Sky (London, United Kingdom)

Experimentation Jobs has been shortlisted for an Experimentation Elite Award! 🎉

📅 Upcoming events

A running list of upcoming events.

23 May: Experimentation Culture Awards (virtual)
25 May: MeasureCamp (Madrid, Spain)
4 Jun: CRO Belgium (Ghent, Belgium)
4-7 Jun: Marketing Analytics Summit (Phoenix, USA)
6 Jun: Women in Experimentation Summit (virtual)
6 Jun: Digital Marketing Live (Amsterdam, Netherlands)
6-7 Jun: NeuroPsychoEconomics (Milan, Italy)
8 Jun: MeasureCamp (Copenhagen, Denmark)
🎁11-12 Jun: Experimentation Elite (Birmingham, United Kingdom)
Use code ’EXPJOBS10‘ to get 10% off
15 Jun: MeasureCamp (Paris, France)
🎁19 Jun: Growth Marketing SUMMIT (Frankfurt am Main)

Full list of experimentation conferences & events in 2024

👋 On June 19th I’ll be attending growth marketing SUMMIT, Europe's premier real life conference for digital growth, experimentation and optimization in Frankfurt, Germany. Use code ’experimental-mind‘ to get 10% off and let’s meet there.