Experimental Mind #233

Your weekly overview of interesting reads, events and jobs for the experimental mind.

Sep 02, 2024

Hi folks!

In this week’s edition:

5 interesting things you might have missed
Podcast of the week: Freakonomics on failure
My Experimentation Career Journey with Dvir Sharon
5 fresh job opportunities
All 13 events happening in September and October
Something that made me smile from Marketoonist

➡️ 3 simple design principles for an effective website
When designing a website, it is easy to try and reinvent the wheel when—more often than not—the simple things make the biggest impact. Zoho shares some guiding principles to help you to design a great website that is simple yet effective.
Link to article from Zoho PageSense

Thanks to Convert, Sitespect and Zoho PageSense for their support.

🔎 Interesting things you might have missed

Better Proxy Metrics From Past Experiments
The Netflix team wrote a paper and blogpost about the relationship between proxy and north start (business) metrics:

The goal of our work is to understand the true relationship between the proxy metric(s) and the north star metric — so that we can assess a proxy’s ability to stand in for the north star metric, learn how to combine multiple metrics into a single best one, and better explore and compare different proxies.

Link to article

____

How DoorDash is pushing experimentation boundaries with interleaving designs
Interleaving can boost the sensitivity of experiments. And allow for quicker and more accurate detection of changes than in traditional A/B testing. The DoorDash team explains how this works and how they recommend others implement it.
Link to article

____

Fresh Starts from the Test & Learn Community
Latest edition of the TLC Connector newsletters is fully dedicated to fresh starts. The Summer months are over (for many) so it’s time to think about new beginnings:

The TLC Connector | Teach. Learn. Converse.

Fresh Starts: First Tests, Experiment Plans, & Career (Re)Starts

Hi TLCers…

10 months ago · 3 likes · Test & Learn Community, Kristi Angel, and Matt Gershoff

____

Product Experimentation Meetup slides + Q&A
Ronny Kohavi presented at this meetup in Barcelona based on questions asked by the audience. Most commonly asked questions answered here. The rest in Slido.
Link to presentation

____

Last week’s most clicked item:

A Practical Guide to Building an Experimentation Center of Excellence
According to Dave Albert from CRO Metrics: “… enduring success is wholly dependent on building a Center of Excellence around your experimentation practices.” He shares his thought on how to structure and measure success.
Link to article

🎧 Podcast of the week

Call every failure an experiment that didn’t go the way you wanted it to, then that can project you on to a more positive route ...
— Stephen Dubner

If you like this episode, make sure to subscribe to the Freakonomics podcast. Or discover other podcasts via the Experimental Mind curated podcast feed.

💬 My Experimentation Career Journey

Today’s interview is with Dvir Sharon, Sr Growth Marketing Manager at Bright Data.

“I’m all about optimizing processes, whether it’s finding the best routes to work, tweaking my morning routines for better sleep or just finding the most efficient way to take my baby girl and my dog on a trip. (Yep, I’m a proud geek).”

Read the full interview with Dvir

🚀 Job opportunities

Find 100+ open roles on ExperimentationJobs.com. This week’s featured roles:

Sr. Manager, Marketing Measurement Science at General Motors (Multiple locations, USA)
Ecommerce CRO Manager at Mira (Warsaw, Poland)
Senior Manager, Advanced Analytics – Identity Experimentation at Walmart (Sunnyvale, USA)
Senior Software Engineer, Experimentation Platform at Liftoff (Remote, USA)
CRO Program Manager at Speero (Remote, USA)

Do you find this jobs overview useful? Leave a testimonial. Thanks.

📅 Upcoming events

A running list of upcoming events.

5-6 Sep: Advances with Field Experiments (Chicago, USA)
🆕6 Sep: Experiment Nation's CRO Therapy (virtual)
7 Sep: MeasureCamp (Prague, Czechia)
7 Sep: MeasureCamp (Chicago, USA)
18-19 Sep: Nonprofit Innovation & Optimization (Indianapolis, USA)
21 Sep: MeasureCamp (London, United Kingdom)
23 Sep: Accelerating Innovation with A/B Testing (virtual)
$500 discount for Experimental Mind readers
24-26 Sep: ConvEx (virtual)
9 Oct: Advanced Topics in Practical A/B Testing (Austin, USA)
10-11 Oct: Experimentation Live + Unite (Austin, USA)
17 Oct: Conversion Jam (Stockholm, Sweden)
18 Oct: Monetate Elevate (London, UK)
18-19 Oct: CODE@MIT (Boston, USA)

Check out more experimentation conferences & events in 2024

💬 Quote to think about

One of the biggest problems I'm observing in organizations in 2024 is the disconnect between experimentation and strategy.
If you view strategy as a collection of integrated choices, then shouldn't experimentation be the way you are informing those choices?

— David Bland (source)