Starship
Nuit

I needed sixty participants and I got eleven

A study design that survives contact with students who have exams.

The design was clean: two weeks, a nightly sleep log, a five-minute attention task each morning, sixty participants. I pre-registered the hypothesis before collecting anything, which I am still glad about.

What happened

I got eleven people to finish. Twenty-nine started.

The dropouts did not stop because of the study. They stopped because the morning task required opening a laptop before their first lecture, and students do not open laptops before their first lecture.

StagePeople
Signed up47
Completed day 129
Completed day 716
Completed day 1411

What eleven is good for

Nothing I planned. The effect I was looking for would need something like forty to show up at all. With eleven, I can report that the measurement is possible and nothing else.

So that is what I am reporting. The study failed to collect enough data to test its hypothesis. That sentence is allowed, and writing it is better than quietly lowering the bar until eleven looks like enough.

Round two

The task moves to the phone, and it drops from five minutes to ninety seconds. I expect that to cost me some precision. I would rather have a noisier measurement from forty people than a clean one from eleven.

5 reactions

One project a week, in your inbox

What was built, the numbers it produced, and what did not work. No other email, and one click to leave.