Experimental Mind: Bets, Roadmapping, Philosophy, Randomization, Zoom, Salary...

🔎 What I've been reading this week

In my new role I am creating a roadmap for our internal experimentation platform. I always come back to the work John Cutler does on this topic. In this Google doc he outlines his thinking around bets, succes metrics and create a roadmap. Useful content.

In this episode, Luka Nikolić shares why it’s better to adopt a mindset of experimentation to make the right decisions and deliver value to customers.

At Lyft, the experimentation team’s purpose is to drive data-driven decision making. We primarily do so by facilitating different experiment techniques including AB testing, time-split experiments…

The three fundamental statistical concepts of A/B testing: randomization, blocking, and re-randomization.

Interesting research paper trying to answer which communication channel you should use in case you need to ask for help.

In two experiments, we found that seeking help in-person was far superior to seeking help through any form of mediated communication channel—including seeking help over synchronous, with-face video channels. Nonetheless, we found that richer media channels do still offer an advantage over text-based channels. Yet, importantly, help-seekers appear largely unaware of both these facts.

A question we've heard asked quite often in the Experiment Nation community is what should a CRO expect to be paid? After 2 minutes of Googling, we couldn't find any great information so we decided to collect it ourselves! All information is confidential and only averages will be shared.

🚀 Job opportunities

Are you looking for a new opportunity? These are this week's featured jobs:

• Principal Analyst, Experimentation at Vista (remote EU)

• [Dutch] Conversie Manager at Online Dialogue (Utrecht, Netherlands)

• Senior Manager Data Science at Vista (remote EU)

• Product Manager, Growth & Retention at Vista (remote EU)

• Product Manager, Experimentation at Adyen (Amsterdam, Netherlands)

Or check the other 17 open roles from companies like Netflix, Apple, Adidas, Gitlab, Stripe, Just Eat, Skyscanner, Lego and Spotify.

Are you hiring? Post your open roles to the job board. Readers of this newsletters can post for free, by using this coupon code at the last step: SUBSCRIBER200

📅 Upcoming events

This is a running list of upcoming events. First 2022 event is on it:

• Panel session on Behavioural Data Science (Nov 30, online)

• CJAM Session with Terry Pierelli & Erin Weigel (Dec 2, online)

• How to build a successful experimentation program (Dec 2, online)

• Coalesce, the analytics engineering conference (Dec 6-10, online)

• Etsy Experimentation Virtual Event (Dec 7-8, online)

• 🆕 SUPERWEEK (Jan 31-Feb 4, 2022, Hungary)

💬 Quote of the week

“"When you invent the ship, you also invent the shipwreck; when you invent the plane you also invent the plane crash; and when you invent electricity, you invent electrocution… Every technology carries its own negativity, which is invented at the same time as technical progress." — Paul Virilio

😉 Fun of the week

This tweet was (again) making the rounds this week. I tried it as well and now each morning I wake up with a smile on my face. Let's see how long the effect stays.

The Americanized French @Ivyzenati

I changed the sound of my alarm clock to hand clapping sounds 👏🏼 to get all the recognition I deserve when I wake up at 7AM.

🔁 Any feedback?

I like to hear what you think of this newsletter, Share your feedback, it takes less than a minute.

🙏 Thanks for reading

If you're enjoying the Experimental Mind newsletter you can buy me a coffee or beer. Thanks to the 12 people who already did it. Much appreciated.

And share this email with a friend or colleague. I would love this community of experimenters to grow. You can point them here to subscribe.

Have a great week — and keep experimenting.

Kevin