The fourth Ghost of Experimentation: Peeking

1 · Skyscanner · Jan. 31, 2019, 4:08 p.m.
By Lizzie Eardley, with Tom Oliver👻 This post is part of a series exploring common misconceptions amongst experimentation practitioners that lead to Chasing Statistical Ghosts.The Ghost of TemptationThis ghost is all our fault as experimenters. Understandably, when we have put in lots of effort developing a new feature or campaign we want it to be a success — and we want to know it’s a success quickly — but we must be careful to not introduce bias into the experiment. Even if you have a perfect ...