Experimental Mind #236

Your weekly overview of interesting reads, events and jobs for the experimental mind.

Sep 23, 2024

Hi folks! Another overview of the best articles on experimentation including new job posts, an interview with Gavin Bryant, two new events and a wuzzle to solve.

ps. Experimentation Jobs is giving away gift cards for people that found a job!

➡️ What is Feature Testing in Experimentation?
As full-stack experimentation becomes more accessible and experimentation skills continue to extend beyond marketing and permeate the entire organization, we’ll see more feature testing.
Link to article from Convert

Thanks to Convert, Sitespect, Zoho PageSense and Eppo for their support.

🔎 Interesting things you might have missed

Experimentation and Privacy by Design
Matt Gershoff on how Conductrics is following data minimization and privacy by default designs directly into their product.
Link to article

____

Analysing Tech Layoffs
Bhavik Patel analysed the data from layoffs.fyi and was able to conclude which function in tech has been hit hardest in the layoffs.
Link to article

____

Safe to fail
There are several ways leaders can begin to create an environment of Safe to Fail inside their organizations:
Link to article

____

Gift cards for job finders
Did you or someone you know land an experimentation role through Experimentation Jobs? They're giving away 10 gift cards worth €25 each to lucky job finders.
Read more

____

Google’s NotebookLM
With this latest experimental release of NotebookLM you can now listen to conversation about your sources. I tried it with the links shared in this newsletter and it’s kind of shocking you can listen to something that feels like an an informal podcast between two people about the articles. Let me know if you are interested and I can share the link so you can hear it yourself.
Link to article

____

Last week’s most clicked item:

Peeking not considered harmful
tl;dr Peeking at experiment results before they're finished isn't bad if you do it right. In fact, it can help end experiments sooner when results are clear, saving time. The key is adjusting how you interpret the data to avoid mistakes. You shouldn’t peek too often, but checking a few times during an experiment is optimal for quicker results without sacrificing accuracy.
Link to article

🎧 Podcast of the week

In episode 1 of a new season of the No Hacks podcast, Slobodan Manic interviews Stewart Ehoff about building experimentation habits in organisations, but also in your personal life.

If you like this episode, make sure to follow the No Hacks podcast. Or discover other podcasts via the Experimental Mind curated podcast feed.

💬 My Experimentation Career Journey

Today’s interview is with Gavin Bryant, He is Founder and Managing Director of First Principles and also host of the Experimentation Masters Podcast.

The great thing about experimentation is that it bridges so many different cross-functional teams – Product, Growth, Data Science, Data Analytics, Engineering, Design, Analytics, Marketing, User Research etc. This ensures that there will always be multiple pathways into a dedicated experimentation role through adjacencies. — Gavin Bryant

Read the full interview with Gavin

🚀 Job opportunities

Find 100+ open roles on ExperimentationJobs.com. This week’s featured roles:

Principal Conversion Rate Optimisation Consultant at Browser to Buyer (Europe)
Statistics Engineer at Eppo (USA)
Senior Strategy Consultant (Experimentation) at Creative CX (UK)
Data Scientist II at Pinterest (Toronto, Canada)
Conversion Rate Optimization (CRO) Manager at Sleep Doctor (Seattle, USA)

📅 Upcoming events

A running list of upcoming events.

24-26 Sep: ConvEx (virtual)
25 Sep: Significance Summit (San Francisco, USA)
9 Oct: Advanced Topics in Practical A/B Testing (Austin, USA)
10-11 Oct: Experimentation Live + Unite (Austin, USA)
17 Oct: Conversion Jam (Stockholm, Sweden)
18 Oct: Monetate Elevate (London, UK)
18-19 Oct: CODE@MIT (Boston, USA)
7 Nov: DDMA Experimentation Heroes (Amsterdam, NL)
22-24 Nov: Conversion Hotel (Texel, Netherlands)
Meet me there. Final batch of tickets now available.
🆕22-25 Nov: Society for Judgement and Decision Making (New York, USA)
🆕28 Nov: Asia Pacific Experimentation Summit (virtual)

Check out more experimentation conferences & events in 2024

💬 Quote to think about

“Managers commonly assume that the greater an investment they make, the larger an impact they’ll see. But things rarely work that way online, where success is often about getting many small changes right. Though the business world glorifies big disruptive ideas, in reality most progress is achieved by implementing hundreds or thousands of minor improvements that can have a big cumulative impact. Nevertheless, and once in a blue moon, one small change can result in a big return because of the internet’s massive scale."
— Stefan H. Thomke in Experimentation Works