Experimental Mind: how A/B testing can (and can’t) improve your headline writing

Nov 22, 2021

🔎 What I've been reading this week

In response to his earlier post about misunderstanding of p-values, Ronny Kohavi now wrote a note explaining p-values, and the intuition behind the application of Bayes Rules. He is open to feedback.

Short summary on the MIT Conference on Digital Experimentation (MIT CODE):

"This community has made substantial recent advances in making these methods both more practical and more theoretically rigorous.”

"We found, surprisingly, that no single feature of a headline's writing style makes much of a difference in forecasting success."

Ruben de Boer released this free ebook to help you apply psychology in your A/B testing program.

🚀 Job opportunities

Are you looking for a new opportunity? These are this week's featured jobs:

(Dutch) Conversie Manager at Online Dialogue (Utrecht, Netherlands)
Senior Manager Data Science at Vista (remote EU)
Product Manager, Growth & Retention at Vista (remote EU)
Product Manager, Experimentation at Adyen (Amsterdam, Netherlands)

Or check the other 15 open roles from companies like Netflix, Adidas, Gitlab, Stripe, Just Eat, Skyscanner, Lego and Spotify.

Are you hiring? Post your open roles to the job board. Readers of this newsletters can post for free, by using this coupon code at the last step: SUBSCRIBER200

📅 Upcoming events

This is a running list of upcoming events:

CJAM Session with Nir Eyal & Hazjier Pourkhalkhali (Nov 23, online)
Design The Next Step (Nov 25, 2021)
🆕 Panel session on Behavioural Data Science (Nov 30, online)
CJAM Session with Terry Pierelli & Erin Weigel (Dec 2, online)
🆕 Etsy Experimentation Virtual Event (Dec 7-8, online)

💬 Quote of the week

“Tell me how you measure me and I will tell you how I will behave. If you measure me in an illogical way, do not complain about illogical behavior." — Eli Goldratt

😉 Fun of the week

James Green @ajamesgreen

Inspired by @CMastication https://t.co/0UDOm6PQNK

🔁 Any feedback?

I like to hear what you think of this newsletter, Share your feedback, it takes less than a minute.

🙏 Thanks for reading

If you're enjoying the Experimental Mind newsletter you can buy me a coffee or beer. Thanks to the 12 people who already did it. Much appreciated.

And share this email with a friend or colleague. I would love this community of experimenters to grow. You can point them here to subscribe.

Have a great week — and keep experimenting.

Kevin

Experimental Mind