I needed sixty participants and I got eleven
A study design that survives contact with students who have exams.
The design was clean: two weeks, a nightly sleep log, a five-minute attention task each morning, sixty participants. I pre-registered the hypothesis before collecting anything, which I am still glad about.
What happened
I got eleven people to finish. Twenty-nine started.
The dropouts did not stop because of the study. They stopped because the morning task required opening a laptop before their first lecture, and students do not open laptops before their first lecture.
| Stage | People |
|---|---|
| Signed up | 47 |
| Completed day 1 | 29 |
| Completed day 7 | 16 |
| Completed day 14 | 11 |
What eleven is good for
Nothing I planned. The effect I was looking for would need something like forty to show up at all. With eleven, I can report that the measurement is possible and nothing else.
So that is what I am reporting. The study failed to collect enough data to test its hypothesis. That sentence is allowed, and writing it is better than quietly lowering the bar until eleven looks like enough.
Round two
The task moves to the phone, and it drops from five minutes to ninety seconds. I expect that to cost me some precision. I would rather have a noisier measurement from forty people than a clean one from eleven.