
Source: Scargle, 2000
“The literature of social sciences contains horror stories of journal editors and others who consider a study worthwhile only if it reaches a statistically significant, positive conclusion; that is, an equally significant rejection of a hypothesis is not considered worthwhile” (Scargle, 2000).
This is a footnote in Jeffrey D. Scargle’s, an astrophysicist working for NASA, article about the publication bias in scientific journals. Usually, the psychologist in me would go all defensive of our precious little social science, but then one discovers this: a couple of researchers trying to publish a paper debunking Bem’s research on ESP (in layman terms, ESP means predicting the future). More precisely, their woes while trying to publish a paper with nonsignificant results. How many papers have you read that have nonsignificant results, that accept the null hypothesis? I have a feeling you have the same answer as me, and it’s frighteningly converging on zero. What happens to those papers? And what’s the implication of such a bias in publishing for science at large?
Continue reading →
Ivan Flis is a PhD student in History and Philosophy of Science at the Descartes Centre, Utrecht University; and has a degree in psychology from the University of Zagreb, Croatia. His research focuses on quantitative methodology in psychology, its history and application, and its relation to theory construction in psychological research. He had been an editor of JEPS for three years in the previous mandates.
More Posts