Experimental Mind: Hello 2022, Goals, Culture, Course, Trust, ML, Ads, Sleep, Jobs, Events...

Jan 03, 2022

🔎 What I've been reading the last two weeks

A post by Lukas Vermeer describing Vista’s cross-organizational effort to make Experimentation an integral part of the culture.

2. Learn how to accelerate innovation with A/B testing

In this class, Ronny Kohavi will teach everything he knows about A/B testing in 5 two hour session, starting on January 31. The first cohort was rated a 4.8 out of 5. If you register via my affiliate link, you will receive a $50 Amazon gift card and you will also support this newsletter. You can register here.

Latest blogpost from the Microsoft Experimentation team:

At Microsoft, the trustworthiness of A/B test results is essential for data-driven decisions. In earlier parts of our trustworthy experimentation series, we shared patterns and some recommendations to increase trustworthiness in both pre- and during- experiment stages. Now we tackle the final stage in the experiment lifecycle.

4. Learn Machine Learning from Cassie Kozyrkov

Making Friends with Machine Learning was an internal-only Google course specially created to inspire beginners and amuse experts. Now, it is available to everyone! See this introduction:

Many Big Tech companies have created platforms that offer businesses tips and tools and services to better target their customers online. These can be helpful — but anybody relying on them needs to be very careful. That’s because many of these companies’ claims about how to measure advertising effectiveness are wrong.

I've always liked to do some small personal experiments. But never so rigorous as Alexey Guzey did with this sleep experiment.

I slept 4 hours a night for 14 days and didn’t find any effects on cognition (assessed via Psychomotor Vigilance Task, a custom first-person shooter scenario, and SAT). I’m a 22-year-old male and normally I sleep 7-8 hours. I was fully alert (very roughly) 85% of the time I was awake, moderately sleepy 10% of the time I was awake, and was outright falling asleep 5% of the …

🚀 Job opportunities

For many people the Festive Season is a time to think. And reflect on what you want to do in life. Maybe it's time for a new challenge in your career. If you're experiencing this, please try to create it your current role. Otherwise, consider looking for other opportunities. There are plenty of open roles.

The job board currently has 16 open roles. Take a look.

And these are the latest featured jobs:

[Dutch] Conversie Manager at Online Dialogue (Utrecht, Netherlands)
Principal Analyst, Experimentation at Vista (remote EU)
Senior Experimentation Strategist at Speero (remote)
Product Analytics & Data Lead at Stitch Money (remote NL/Cape Town)

Is your company hiring? Post your open roles to the job board. Readers of this newsletter can post for free, simply use the same email address.

📅 Upcoming events

This is a running list of upcoming events:

🆕 Accelerating Innovation with A/B Testing (Jan 31-Feb 10, online)
‍SUPERWEEK (Jan 31-Feb 4, Hungary)
🆕 Quantum Leap (Feb 7-9, Austin, TX, US)
MeasureCamp North America (Feb 26, online)

Do you know of an event that should be on this list? Let me know.

💬 Quote of the week

"The old is dead, and I don't know what the new is. The only way to find the new is to start different things and see if there's something that can come out of experimentation." — David Lynch

😉 Four tips for a good 2022

Janis Ozolins @OzolinsJanis

For a good 2022: - adapt growth mindset - find a community - collect things to find ideas - zoom out and be patient https://t.co/VZCxby1dBq

🔁 Any feedback?

I like to hear what you think of this newsletter, Share your feedback, it takes less than a minute.

🙏 Thanks for reading

If you're enjoying the Experimental Mind newsletter, you can buy me a coffee or beer (in case you rather use Paypal, you can send it to 'kevin@experimentalmind.com'. Thanks to the 19 people who have already done it. Much appreciated.

And share this email with a friend or colleague. I would love for this community of experimenters to grow. You can point them here to subscribe.

Have a great week — and keep experimenting.

Kevin

Experimental Mind