Based on (critical) responses that I received, and discussions that I had after this post, I have added some footnotes to elaborate on certain aspects. The main criticisms are that pre-registration is not necessarily as rigid as I depict it to be (which may be true), and that questioning statistical guidelines is dangerous (which is certainly true, but also a moralistic fallacy: something can be correct and dangerous to say at the same time). Also, see my (sort of) follow-up post The Black Swan and NeuroSkeptic’s response.
In response to the many recent cases of scientific fraud, a debate has ignited about how science can be made more transparent, and how some of the public trust can be regained. Suggestions include …
- making all research data publicly available, not just the summarized results.
- making all scientific papers publicly available (i.e. open access).
- investing more time in replicating results, those of others as well as your own (e.g., the reproducibility project).
- and pre-registering all studies.
A slightly mysterious, but influential voice in this debate is Neuroskeptic. In a recent post, Neuroskeptic interviews Jona Sassenhagen, a neurolinguist from the University of Marburg, who decided to pre-register his EEG study. So what does it mean to pre-register a study, and why would anyone do this?
The idea behind pre-registration is simple: Before you conduct your experiment, you publicly list exactly what kind of experiment you are going to conduct, how many participants you will test, and what the …