Experiments in the Classroom: Part I

Last semester, I decided to run a few experiments with the students in the introductory economics class I was teaching. The first had to do with the power of chocolate in improving test scores. This theory arose from my mother-in-law, who always gave her daughter a chocolate on days when she had to take an important test at school.

To begin with, I offered the students two choices of sweets before their in-class test â€“ a chocolate and a non-chocolate option. I asked them to mark their choice on their test paper.

After the in-class test, it transpired that there was no difference between the grades of chocolate-eaters and non-chocolate eaters. But we were worried. What if the choice of chocolate was correlated with something about the student? Perhaps chocolate did help test performance, but this effect was washed out by the propensity of lazy students to eat more chocolate?

To solve the problem, we decided to implement a unique solution: the world’s first (so far as I know) chocolate-test-taking randomised trial. Alternate test papers were marked on the back “chocolate” or “non-chocolate”. Before starting the test, students could grab a sweet. Afterwards, we tabulated the results.

Chocolate group â€“ mean of 12.8
Non-chocolate group â€“ mean of 13.2

There was no statistically significant difference between the groups, indicating that the small difference in means was likely to have just been statistical noise.

Our conclusion: theories about the effect of chocolate on test-taking performance are not supported by the evidence. The only reason to eat chocolate before a test is that you like the taste.