Cognitive Science 42 (S4):1075-1100 (2018)

Given the replication crisis in cognitive science, it is important to consider what researchers need to do in order to report results that are reliable. We consider three changes in current practice that have the potential to deliver more realistic and robust claims. First, the planned experiment should be divided into two stages, an exploratory stage and a confirmatory stage. This clear separation allows the researcher to check whether any results found in the exploratory stage are robust. The second change is to carry out adequately powered studies. We show that this is imperative if we want to obtain realistic estimates of effects in psycholinguistics. The third change is to use Bayesian data-analytic methods rather than frequentist ones; the Bayesian framework allows us to focus on the best estimates we can obtain of the effect, rather than rejecting a strawman null. As a case study, we investigate number interference effects in German. Number feature interference is predicted by cue-based retrieval models of sentence processing, but it has shown inconsistent results. We show that by implementing the three changes mentioned, suggestive evidence emerges that is consistent with the predicted number interference effects.
Keywords Bayesian hierarchical modeling  Cue‐based retrieval  Exploratory and confirmatory analyses  German  Number interference  Sentence processing  Similarity‐based interference  Working memory
Categories (categorize this paper)
DOI 10.1111/cogs.12589
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

PhilArchive copy

Upload a copy of this paper     Check publisher's policy     Papers currently archived: 52,919
Through your library

References found in this work BETA

Paradigms and Processes in Reading Comprehension.Marcel A. Just, Patricia A. Carpenter & Jacqueline D. Woolley - 1982 - Journal of Experimental Psychology: General 111 (2):228-238.

View all 9 references / Add more references

Citations of this work BETA

Add more citations

Similar books and articles

Where is the Classic Interference Theory for Sleep and Memory?Anton Coenen - 2005 - Behavioral and Brain Sciences 28 (1):67-68.


Added to PP index

Total views
18 ( #538,452 of 2,343,668 )

Recent downloads (6 months)
2 ( #332,548 of 2,343,668 )

How can I increase my downloads?


My notes