Server-Side, Bayesian, Manifesto, Theater, Algorithm...
Your overview of interesting reads, events and jobs for the experimental mind: #208
Hi folks!
A fresh edition with a bunch of interesting reads. Enjoy!
➡️Guide to Creating an Effective Server-Side Testing Program by SiteSpect:
Server-side testing enables algorithm enhancement, purchase flow optimization, configuration changes, and new feature introduction without latency or data issues. This guide gives a deep understanding of server-side testing and helps in crafting an effective strategy.
Download the guide
Thanks to Convert, Sitespect and Exatom for their support.
🔎 Interesting things you might have missed
NHST or Bayesian? | Ronny Kohavi
There is an ongoing debate between choosing Bayesian methods and classical Null Hypothesis Statistical Testing (NHST) for A/B testing. Ronny Kohavi takes a novel approach mapping p-values to Bayes Factors, demonstrating values closely aligned with False Positive Risk (FPR).
Link to document
___
A manifesto for overhauling digital ‘experimentation’
Jonny Longden wrote a critique of how businesses currently approach digital experimentation and a manifesto for rethinking and overhauling the discipline. I agree with most points. Not sure about the ‘it is simply a piece of research and evidence amongst others’, though. Experimentation done well does have higher validity.
Link to article
___
Marty Cagan on Lenny’s Podcast
Started listening to Marty Cagan pushing back on ‘product management theater’. Not done yet. Did read John Cutler’s commentary already.
Listen to podcast
___
[DUTCH] Tim vs the police algorithm
Tim Hanssen got a fine for calling while driving. But he was simply scratching his face and the police algorithm signalled it as ‘using mobile phone’. He reproduced the algorithm to show how this works.
Link to article
💬 My Experimentation Career Journey
Today not one, but eleven experimentation career stories from: Els Aerts, Erin Weigel, Laura Forster, Tracy Laranjo, Gintarė Forshaw, Melanie Kyrklund, Lucia van den Brink, Florien Cramwinckel, Maria Luiza de Lange, Kelly (Anne) Wortham and Georgiana Hunter-Cozens.
🚀 Job opportunities
Looking for a new challenge in experimentation? Find 100+ experimentation related jobs on ExperimentationJobs.com. These jobs are from all over the world, on-site, fully remote or hybrid. Take a look and start pivoting your career.
This week’s featured roles:
Senior Conversion Rate (CRO) Consultant at Delve (Europe)
CRO Product Designer at Scentbird (Slovakia)
Conversion Rate Optimization (CRO) Specialist at ConversionWise (Remote, United Kingdom)
Manager, Marketing Experimentation & Personalization at The Home Depot (USA)
Principal Data Scientist, Experimentation & Personalization at Capital One (Multiple locations, USA)
Are you hiring? Submit here
Also, make sure to follow Experimentation Jobs on LinkedIn.
📅 Upcoming events
A running list of upcoming events.
19 Mar: Conversionboost (Copenhagen, Denmark
🏷️Use promo code ‘expMind50more’ for an extra 50 euro off.23 Mar: MeasureCamp (Helsinki, Finland)
🎁8 Apr: Accelerating Innovation with A/B Testing with Ronny Kohavi (virtual,
$1,999$1,499 USD)13 Apr: MeasureCamp (New York, USA)
18 Apr: Emerce Conversion & Analytics (Amsterdam, NL)
Full list of experimentation conferences & events in 2024
👋 On June 19th I’ll be attending growth marketing SUMMIT, Europe's premier real life conference for digital growth, experimentation and optimization in Frankfurt, Germany. Use code ’experimental-mind‘ to get 10% off and let’s meet there.
💬 Quote to think about
“Statistics gives you a set of tools for decision-making, but how you use them is up to you — it’ll be as individual as any other decision.” — Cassie Kozyrkov (source)
😃 Something that made me smile
Cartoon from Iqbal Ali:
The risk of launching your new product feature isn't just about the risk of how users are going to react to this change. You also need to consider the risk of time and resources you're investing.
👂Feedback?
It would be great if you can share one thing I can improve or add. Thank you!
Enjoying this newsletter? Consider sharing it with a friend or colleague.
Have a great week — and keep experimenting.
Thanks, Kevin