Experimental Mind: Unshipping

A message from Blooming People

Starting next week Mimi VerLoren van Themaat, owner of Blooming People, will share valuable tips and insights. Follow her on LinkedIn

This is a sponsored plug from a reader of Experimental Mind

🔎 Interesting reads you probably missed

Last Friday me and my colleague Joshua Tankard presented two topics at the Test & Learn Community (TLC) hosted by the great Kelly Wortham.

Apparently they call it 'unshipping'. So many people only add stuff to products, but it makes sense to also look what you can remove from a product, especially from Instagram.

Speero opened up their Experimentation Blueprints:

Blueprints help visualize organizational processes in order to optimize how a business delivers an experimentation program.

Julian Aylward from Gousto wrote a framework for selecting a primary metric for experimentation:

• Sensitivity and MDEs

• Low(er) variance

• Statistically Sound

• Causal Relationship with North Star Metric

• Prefer Leading to Lagging

• As Universal as Possible

• Resistant to Change

Ever wondered why power calculators give different results? Ronny Kohavi explains why.

Introduction of Airbnb interleaving experimentation framework, usage and approaches to address challenges in our unique business

Experimentation has always been a challenge for teams. Even teams who have experience writing hypotheses and designing experiments struggle to spend the “right” amount of effort on their learning.

My former colleague Pragam Rathore proposes to stop using the term Minimal Viable Product.

🚀 Job opportunities

You will drive visioning for the next generation of the platform that enables Experimentation at Twitch and oversee scaling the existing systems and bringing new products from 0-1.

Find all open roles on the job board.

📅 Upcoming events

All upcoming events in the next months:

• 13 Oct: Digital Analytics Summit (Amsterdam, NL)

• 13 Oct: DiDo#40 Results are not Learnings (Utrecht, NL)

• 20-21 Oct: Conference on Digital Experimentation (Boston)

• 25-26 Oct: CXL Live (Austin, Texas)

• 31 Oct: Accelerating Innovation with A/B Testing (online)

• 3 Nov: Dutch CRO Awards (Amsterdam, NL)

• 18-20 Nov: Conversion Hotel (Texel, the Netherlands)

Also checkout the full overview of events for next months.

💬 Quote of the week

"Creative experimentation propels our culture forward. That our stories of innovation tend to glorify the breakthroughs and edit out all the experimental mistakes doesn't mean that mistakes play a trivial role. As any artist or scientist knows, without some protected, even sacred space for mistakes, innovation would cease." — Evgeny Morozov

😉 Fun of the week

People running a marathon, really like to finish within 4 hours.

Tanay Jaipuria @tanayj

the distribution of marathon finishing times is fascinating (via https://t.co/CGyA0LWMI9) https://t.co/bdOSBfTjP9

👍 Thank you for reading

If you’re enjoying the Experimental Mind newsletter please share this email with a friend or colleague. Looking for inspiration how to best do that? Take a look at what others are saying.