TinkerDay 1 of 14.day 1 of 14 · A 8.8% · B 10.8%
Chapter 4 of 7
Peeking
The team is impatient. They check the scoreboard every morning and plan to stop the moment one checkout wins.
This chapter: What does stopping on a good day do to false wins?
About this chapter
You will learn
- Peeking: checking a running test and stopping on a win
- Why each look is another chance for luck
- Fix the length first, or use methods built for watching
Words you’ll meet
- Peeking
- Checking a running test and stopping as soon as it looks significant.
- Fixed horizon
- A test length set in advance, read once at the end.
Step 1 of 6
Another A/A test: both checkouts identical. means checking every morning and stopping on a win.
Move day by day until it calls a winner.