Responding to recent concerns about the reliability of the published literature in psychology and other disciplines, we formed the X-Phi Replicability Project to estimate the reproducibility of experimental philosophy. Drawing on a representative sample of 40 x-phi studies published between 2003 and 2015, we enlisted 20 research teams across 8 countries to conduct a high-quality replication of each study in order to compare the results to the original published findings. We found that x-phi studies – as represented in our sample (...) – successfully replicated about 70% of the time. We discuss possible reasons for this relatively high replication rate in the field of experimental philosophy and offer suggestions for best research practices going forward. (shrink)

Developmental psychology currently faces a deep puzzle: most children before 4 years of age fail elicited-response false-belief tasks, but preverbal infants demonstrate spontaneous false-belief understanding. Two main strategies are available: cultural constructivism and early-belief understanding. The latter view assumes that failure at elicited-response false-belief tasks need not reflect the inability to understand false beliefs. The burden of early-belief understanding is to explain why elicited-response false-belief tasks are so challenging for most children under 4 years of age. The goal of this (...) article is to offer a pragmatic framework whose purpose is to discharge this burden. (shrink)

It has long been known that scientists have a tendency to conduct experiments in a way that brings about the expected outcome. Here, we provide the first direct demonstration of this type of experimenter bias in experimental philosophy. Opposed to previously discovered types of experimenter bias mediated by face-to-face interactions between experimenters and participants, here we show that experimenters also have a tendency to create stimuli in a way that brings about expected outcomes. We randomly assigned undergraduate experimenters to receive (...) two different hypotheses about folk intuitions of consciousness, and then asked them to design experiments based on their hypothesis. Specifically, experimenters generated sentences ascribing intentional and phenomenal mental states to groups, which were later rated by online participants for naturalness. We found a significant interaction between experimenter hypothesis and participant ratings indicating a general tendency for experimenters to obtain the result that they expected. These results indicate that experimenter bias is a real problem in experimental philosophy since the methods and design employed here mirror the predominant survey methods of the field as a whole. The bearing of the current results on Knobe and Prinz’s :67–83, 2008) group mind hypothesis is discussed, and new methods for avoiding experimenter bias are proposed. (shrink)

We argue that the most ambitious version of the mental files theory of singular thought, according to which mental files are a wide-ranging psychological natural kind underlying all and only singular thinking, is unsupported by the available psychological data. Nevertheless, critical examination of the theory from a psychological perspective opens up promising avenues for research, especially concerning the relationship between our perceptual capacity to individuate and track basic individuals, and our higher level capacities for singular thought.

The underlying structures that are common to the world's languages bear an intriguing connection with early emerging forms of “core knowledge”, which are frequently studied by infant researchers. In particular, grammatical systems often incorporate distinctions that reflect those made in core knowledge. Here, I argue that this connection occurs because non-verbal core knowledge systematically biases processes of language evolution. This account potentially explains a wide range of cross-linguistic grammatical phenomena that currently lack an adequate explanation. Second, I suggest that developmental (...) researchers and cognitive scientists interested in knowledge representation can exploit this connection to language by using observations about cross-linguistic grammatical tendencies to inspire hypotheses about core knowledge. (shrink)

This special issue on what some regard as a crisis of replicability in cognitive science (i.e. the observation that a worryingly large proportion of experimental results across a number of areas cannot be reliably replicated) is informed by three recent developments. -/- First, philosophers of mind and cognitive science rely increasingly on empirical research, mainly in the psychological sciences, to back up their claims. This trend has been noticeable since the 1960s (see Knobe, 2015). This development has allowed philosophers to (...) draw on a wider range of relevant resources, but it also makes them vulnerable to relying on claims that may not survive further scrutiny. If we have reasons to believe that a large proportion of findings in the psychological sciences cannot be reliably replicated, this would be a problem for philosophers who use such findings in their work. Second, philosophers are increasingly designing and carrying out their own experiments to back up claims, or to test claims earlier made from the armchair, for example, on the perceived permissibility of diverting trolleys or on the nature of free will. This growing field of experimental philosophy has diversified the intellectual field in philosophy, but may also be vulnerable to issues of replicability that philosophers did not face before. -/- Third, the recent evidence of apparently widespread non-replicability in the social sciences (and other fields) has forced philosophers of science to grapple with long standing questions from their field from a new perspective. To what extent does replicability matter for theory construction? How do the notions of replicability and scientific progress interact? How can normative insights from philosophy of science be used in order to improve scientific practice? -/- It is with these three developments in mind—the increasing importance of empirically-informed philosophy, of experimental philosophy, and of philosophy of science around replicability—that this special issue has been conceived. (shrink)

From an early age, humans intuitively expect physical objects to obey core principles, including continuity (objects follow spatiotemporally continuous paths) and solidity (two solid objects cannot occupy the same space at the same time). These 2 principles are sometimes viewed as deriving from a single overarching “persistence” principle. Indeed, violations of solidity where one solid object seemingly passes through another could theoretically be interpreted as a violation of continuity, with an object “teleporting” to switch places rather than passing through a (...) solid obstacle. However, it is an empirical issue whether the two principles are processed distinctly or identically to one another. Here, adult participants tracked objects during dynamic events in a novel location detection task, which sometimes involved violations of the principles of continuity or solidity. Although participants explicitly noticed both types of violations and reported being equally surprised at both, they made more errors and answered more slowly after continuity violations than after solidity violations. Our results demonstrate that the two principles show different signature patterns and are thus represented distinctly in the mind. (shrink)

Appendix 1 was incomplete in the initial online publication. The original article has been corrected.

Three studies provided evidence that syntax influences intentionality judgments. In Experiment 1, participants made either speeded or unspeeded intentionality judgments about ambiguously intentional subjects or objects. Participants were more likely to judge grammatical subjects as acting intentionally in the speeded relative to the reflective condition (thus showing an intentionality bias), but grammatical objects revealed the opposite pattern of results (thus showing an unintentionality bias). In Experiment 2, participants made an intentionality judgment about one of the two actors in a partially (...) symmetric sentence (e.g., “John exchanged products with Susan”). The results revealed a tendency to treat the grammatical subject as acting more intentionally than the grammatical object. In Experiment 3 participants were encouraged to think about the events that such sentences typically refer to, and the tendency was significantly reduced. These results suggest a privileged relationship between language and central theory-of-mind concepts. More specifically, there may be two ways of determining intentionality judgments: (1) an automatic verbal bias to treat grammatical subjects (but not objects) as intentional (2) a deeper, more careful consideration of the events typically described by a sentence. (shrink)

The notion of agency has been explored within research in moral psychology and, quite separately, within research in linguistics. Moral psychologists have suggested that agency attributions play a role in moral judgments, while linguists have argued that agency attributions play a role in syntactic intuitions. -/- To explore the connection between these two lines of research, we report the results of an experiment in which we manipulate syntactic cues for agency and show a corresponding impact on moral judgments. This result (...) suggests that the two effects observed previously — in morality and in syntax — might each be a reflection of a more general capacity to understand event structure. (shrink)

The idea that the form of a word reflects information about its meaning has its roots in Platonic philosophy, and has been experimentally investigated for concrete, sensory-based properties since the early 20th century. Here, we provide evidence for an abstract property of ‘boundedness’ that introduces a systematic, iconic bias on the phonological expectations of a novel lexicon. We show that this abstract property is general across events and objects. In Experiment 1, we show that subjects are systematically more likely to (...) associate sign language signs that end with a gestural boundary with telic verbs (denoting events with temporal boundaries, e.g., die, arrive) and with count nouns (denoting objects with spatial boundaries, e.g., ball, coin). In Experiments 2–3, we show that this iconic mapping acts on conceptual representations, not on grammatical features. Specifically, the mapping does not carry over to psychological nouns (e.g. people are not more likely to associate a gestural boundary with idea than with knowledge). Although these psychological nouns are still syntactically encoded as either count or mass, they do not denote objects that are conceived of as having spatial boundaries. The mapping bias thus breaks down. Experiments 4–5 replicate these findings with a new set of stimuli. Finally, in Experiments 6–11, we explore possible extensions to a similar bias for spoken language stimuli, with mixed results. Generally, the results here suggest that ‘boundedness’ of words' referents (in space or time) has a powerful effect on intuitions regarding the form that the words should take. (shrink)

The extant literature on discourse comprehension distinguishes between two types of texts: narrative and expository. Narrative discourse tells readers a story by giving them an account of events; the narration informs and/or persuades the readership by using textual elements such as theme, plot, and characters. Expository discourse explains or informs the readership by using concepts and techniques such as definition, sequence, categorization, and cause-effect relations. The present study is based on two experiments. In Experiment 1, we compared the two discourse (...) types to examine if college students would be better at extracting the meanings of novel words from one of the two types of discourse structure than from the other. The findings indicated that participants were significantly better at inferring the meaning of novel words from narrative compared to expository discourse. In Experiment 2, we examined the number of situation models that a reader is required to mentally construct, as a possible characteristic that influences the difficulty of learning new word meaning within narrative discourse. Contrary to intuition, fewer novel words were learned in a single-situation, as opposed to a multi-situation model condition, suggesting that the additional inferencing needed to construct multiple models also promotes word learning. Results are discussed with respect to how the structure of written discourse can facilitate word learning in a reader’s native language. Implications for education and assessment are also discussed. (shrink)

In studying how lay people evaluate arguments, psychologists have typically focused on logical form and content. This emphasis has masked an important yet underappreciated aspect of everyday argument evaluation: social cues to argument strength. Here we focus on the ways in which observers evaluate arguments by the reaction they evoke in an audience. This type of evaluation is likely to occur either when people are not privy to the content of the arguments or when they are not expert enough to (...) appropriately evaluate it. Four experiments explore cues that participants might take into account in evaluating arguments from the reaction of the audience. They demonstrate that participants can use audience motivation, expertise, and size as clues to argument quality. By contrast we find no evidence that participants take audience diversity into account. (shrink)