Tag Archives: file-drawer problem

Bias in psychology: Bring in all significant results

You have invested an uncountable amount of hours completing your research, and even have been lucky enough (!) with your results confirming the previously stated hypotheses deriving from an extensive literature search. Besides being already happy enough, the next step to consider would be the publication in a journal, the higher the impact factor the better. The hardworking (and fortunate) even complete this enduring step and can rejoice in receiving considerable attention from other scholars in the field. Passionate researchers know what I am talking about. But what about all those researchers that fail to confirm their hypotheses. Do they receive as much attention? The answer to this rhetorical question must presumably be: NO.

Results that are perceived as not advancing our through science constructed knowledge might never reach public attention.  This tendency to report almost only positive findings in scientific journals is a common point of contention, especially in the social sciences. Continue reading

Sina Scherer

Sina Scherer

Sina Scherer, studying at University of Münster, Germany, and University of Padova, Italy. I have previously worked as JEPS Bulletin Editor and am active in a NMUN project simulating the political work of the United Nations as voluntary work. I am interested in cognitive neuroscience and intercultural psychology, anthropology and organizational psychology (aspects of work-life balance, expatriation).

More Posts

Facebooktwitterrss

What happens to studies that accept the null hypothesis?

Source: Scargle, 2000

“The literature of social sciences contains horror stories of journal editors and others who consider a study worthwhile only if it reaches a statistically significant, positive conclusion; that is, an equally significant rejection of a hypothesis is not considered worthwhile” (Scargle, 2000).

This is a footnote in Jeffrey D. Scargle’s, an astrophysicist working for NASA, article about the publication bias in scientific journals. Usually, the psychologist in me would go all defensive of our precious little social science, but then one discovers this: a couple of researchers trying to publish a paper debunking Bem’s research on ESP (in layman terms, ESP means predicting the future). More precisely, their woes while trying to publish a paper with nonsignificant results. How many papers have you read that have nonsignificant results, that accept the null hypothesis? I have a feeling you have the same answer as me, and it’s frighteningly converging on zero. What happens to those papers? And what’s the implication of such a bias in publishing for science at large?

Continue reading

Ivan Flis

Ivan Flis is a PhD student in History and Philosophy of Science at the Descartes Centre, Utrecht University; and has a degree in psychology from the University of Zagreb, Croatia. His research focuses on quantitative methodology in psychology, its history and application, and its relation to theory construction in psychological research. He had been an editor of JEPS for three years in the previous mandates.

More Posts

Facebooktwitterrss