Responding to recent concerns about the reliability of the published literature in psychology and other disciplines, we formed the X-Phi Replicability Project to estimate the reproducibility of experimental philosophy. Drawing on a representative sample of 40 x-phi studies published between 2003 and 2015, we enlisted 20 research teams across 8 countries to conduct a high-quality replication of each study in order to compare the results to the original published findings. We found that x-phi studies – as represented in our sample (...) – successfully replicated about 70% of the time. We discuss possible reasons for this relatively high replication rate in the field of experimental philosophy and offer suggestions for best research practices going forward. (shrink)

Developmental psychology currently faces a deep puzzle: most children before 4 years of age fail elicited-response false-belief tasks, but preverbal infants demonstrate spontaneous false-belief understanding. Two main strategies are available: cultural constructivism and early-belief understanding. The latter view assumes that failure at elicited-response false-belief tasks need not reflect the inability to understand false beliefs. The burden of early-belief understanding is to explain why elicited-response false-belief tasks are so challenging for most children under 4 years of age. The goal of this (...) article is to offer a pragmatic framework whose purpose is to discharge this burden. (shrink)

It has long been known that scientists have a tendency to conduct experiments in a way that brings about the expected outcome. Here, we provide the first direct demonstration of this type of experimenter bias in experimental philosophy. Opposed to previously discovered types of experimenter bias mediated by face-to-face interactions between experimenters and participants, here we show that experimenters also have a tendency to create stimuli in a way that brings about expected outcomes. We randomly assigned undergraduate experimenters to receive (...) two different hypotheses about folk intuitions of consciousness, and then asked them to design experiments based on their hypothesis. Specifically, experimenters generated sentences ascribing intentional and phenomenal mental states to groups, which were later rated by online participants for naturalness. We found a significant interaction between experimenter hypothesis and participant ratings indicating a general tendency for experimenters to obtain the result that they expected. These results indicate that experimenter bias is a real problem in experimental philosophy since the methods and design employed here mirror the predominant survey methods of the field as a whole. The bearing of the current results on Knobe and Prinz�s :67�83, 2008) group mind hypothesis is discussed, and new methods for avoiding experimenter bias are proposed. (shrink)

Three studies provided evidence that syntax influences intentionality judgments. In Experiment 1, participants made either speeded or unspeeded intentionality judgments about ambiguously intentional subjects or objects. Participants were more likely to judge grammatical subjects as acting intentionally in the speeded relative to the reflective condition (thus showing an intentionality bias), but grammatical objects revealed the opposite pattern of results (thus showing an unintentionality bias). In Experiment 2, participants made an intentionality judgment about one of the two actors in a partially (...) symmetric sentence (e.g., “John exchanged products with Susan”). The results revealed a tendency to treat the grammatical subject as acting more intentionally than the grammatical object. In Experiment 3 participants were encouraged to think about the events that such sentences typically refer to, and the tendency was significantly reduced. These results suggest a privileged relationship between language and central theory-of-mind concepts. More specifically, there may be two ways of determining intentionality judgments: (1) an automatic verbal bias to treat grammatical subjects (but not objects) as intentional (2) a deeper, more careful consideration of the events typically described by a sentence. (shrink)

The underlying structures that are common to the world's languages bear an intriguing connection with early emerging forms of “core knowledge”, which are frequently studied by infant researchers. In particular, grammatical systems often incorporate distinctions that reflect those made in core knowledge. Here, I argue that this connection occurs because non-verbal core knowledge systematically biases processes of language evolution. This account potentially explains a wide range of cross-linguistic grammatical phenomena that currently lack an adequate explanation. Second, I suggest that developmental (...) researchers and cognitive scientists interested in knowledge representation can exploit this connection to language by using observations about cross-linguistic grammatical tendencies to inspire hypotheses about core knowledge. (shrink)

Appendix 1 was incomplete in the initial online publication. The original article has been corrected.

The notion of agency has been explored within research in moral psychology and, quite separately, within research in linguistics. Moral psychologists have suggested that agency attributions play a role in moral judgments, while linguists have argued that agency attributions play a role in syntactic intuitions. -/- To explore the connection between these two lines of research, we report the results of an experiment in which we manipulate syntactic cues for agency and show a corresponding impact on moral judgments. This result (...) suggests that the two effects observed previously — in morality and in syntax — might each be a reflection of a more general capacity to understand event structure. (shrink)

We argue that the most ambitious version of the mental files theory of singular thought, according to which mental files are a wide-ranging psychological natural kind underlying all and only singular thinking, is unsupported by the available psychological data. Nevertheless, critical examination of the theory from a psychological perspective opens up promising avenues for research, especially concerning the relationship between our perceptual capacity to individuate and track basic individuals, and our higher level capacities for singular thought.

In studying how lay people evaluate arguments, psychologists have typically focused on logical form and content. This emphasis has masked an important yet underappreciated aspect of everyday argument evaluation: social cues to argument strength. Here we focus on the ways in which observers evaluate arguments by the reaction they evoke in an audience. This type of evaluation is likely to occur either when people are not privy to the content of the arguments or when they are not expert enough to (...) appropriately evaluate it. Four experiments explore cues that participants might take into account in evaluating arguments from the reaction of the audience. They demonstrate that participants can use audience motivation, expertise, and size as clues to argument quality. By contrast we find no evidence that participants take audience diversity into account. (shrink)