Spotify's Data Platform

Your overview of interesting reads, events and jobs for the experimental mind: #212

Apr 08, 2024

Hi folks!

In today’s issue I’ve included articles around flickering A/B tests, data platforms and testing with static content. Also David Mannheim shares his career journey. Plus a bunch of new events and jobs. Enjoy.

➡️ Why do my A/B tests cause flicker?
In this blog SiteSpect uncovers how an A/B testing platform sometimes causes website flicker and what you can do about this.
Read the full article here

Thanks to Convert, Sitespect, Exatom and Zoho PageSense for their support.

🔎 Interesting things you might have missed

Spotify’s Data Platform
What are the building blocks of a data platform and how to start building one. In this blog post from Spotify explains their setup.
Read the full article

___

ExperimentsGPT now available
David Bland created this Open AI app to help entrepreneurs and innovators in selecting and conducting experiments for early-stage business ideas. Ask it things like: "How do I test my riskiest assumption?", "Provide a table of experiments for me." and "How can I test without building anything?".
Try it out (you need a ChatGPT Plus account)

___

Less Confusion Matrix
Bart Schutz explains why there is a gap between the uplifts of statistically significant winning A/B tests and their real-world effects. And why you need to calculate and report things like the False Discovery Ratio (FDR) of your program.
Read the full article

___

Problems with static content and A/B testing
Gustaf Nilsson Kotte from IKEA goes through the problems related to A/B testing and personalisation in a static files based architecture.
Read the full article

💬 My Experimentation Career Journey

Today’s interview is with David Mannheim, founder of Made With Intent.

I think “what to experiment” will become more at the forefront. Currently, and forgive me for potentially being so blasphemous, but online brands mostly test by moving sh*t around on a page. — David Mannheim

Read the full interview with David

🚀 Job opportunities

Find 100+ open roles on ExperimentationJobs.com. This week’s featured roles:

Conversion Rate Optimization (CRO) Specialist at ConversionWise (Remote, UK)
Lead Analyst at Vista (Bengaluru, India)
Conversion Rate Optimisation & Personalisation Specialist at Wolf & Badger (London, United Kingdom)
Growth Marketing Manager, Experimentation at MongoDB (USA)
Group Product Manager, Experimentation at Etsy (New York, USA)

📅 Upcoming events

A running list of upcoming events.

13 Apr: MeasureCamp (New York, USA)
🎁18 Apr: Emerce Conversion & Analytics (Amsterdam, NL). Get 15% off
20 Apr: MeasureCamp (Amsterdam, Netherlands)
23-24 Apr: Conversion Rate Conference (virtual)
13-17 May: CRO trends that need to go away (virtual)
15-17 May: Measuring Behavior (Aberdeen, Scotland)
23 May: Experimentation Culture Awards (virtual)
🆕25 May: MeasureCamp (Madrid, Spain)
🆕4-7 Jun: Marketing Analytics Summit (Phoenix, USA)
🆕6 Jun: Women in Experimentation Summit (virtual)
🆕6 Jun: Digital Marketing Live (Amsterdam, Netherlands)
🆕6-7 Jun: NeuroPsychoEconomics (Milan, Italy)
🆕8 Jun: MeasureCamp (Copenhagen, Denmark)

Full list of experimentation conferences & events in 2024

👋 On June 19th I’ll be attending growth marketing SUMMIT, Europe's premier real life conference for digital growth, experimentation and optimization in Frankfurt, Germany. Use code ’experimental-mind‘ to get 10% off and let’s meet there.

Experimental Mind

Discussion about this post