Can morality be so demanding that we have reason not to follow its dictates? According to many, it can, if that morality is a consequentialist one. We take the plausibility and coherence of this objection – the Demandingness Objection – as a given and are also not concerned with finding the best response to the Objection. Instead, our main aim is to explicate the intuitive background of the Objection and to see how this background could be investigated. This double aim (...) leads to different albeit connected threads of inquiry. We first outline the Objection, its different forms and how intuition figures in them. After this, we move on to consider the ongoing debate about the use of intuitions in (moral) philosophy with a focus on two challenges: what intuitions are and how we can detect them. To answer these challenges, we propose an account according to which moral intuitions are seemings that are characterized by being non-inferential, spontaneous, non-doxastic, phenomenologically distinctive, non-sensory, intrinsically motivating, and stable. Armed with these seven “markers” of moral intuition, we put a forward a complex experimental methodology and raise and respond to possible problems with it. (shrink)

In experimental economics one can confront a “don’t!”, as in “do not deceive your participants!”, as well as a “do!”, as in “incentivize choice making!”. Neither exists in experimental psychology. Further controversies exist in data collection methods, e.g., play strategy (vector) method in game experiments, and how to guarantee external and internal validity by describing experimental scenarios by field-related vignettes or by abstract, often formal, rules as it is used in decision and game theory. We emphasize that (...) differences between the experimental methodology of the two disciplines are minor rather than substantial and suggest that such differences should be resolved, as much as possible, through empirical research. Rather than focusing on familiar debates, we suggest to substitute the revealed-motive approach in experimental economics by designs whose data not only inform about choice, but also about the reasoning dynamics. (shrink)

The paper provides a commentary on B.G. Yudin's paper devoted to the relationship between technoscience and contemporary human enhancement technologies. In order to discuss these issues I address to T. Kuhn's conception of two traditions in the development of modern science. I show that technoscience belongs to the tradition that Kuhn calls the Baconian or ”experimental" sciences in contrast to the ”mathematical" sciences. I argue that technoscience creates an experimental environment for the study of a human being as (...) an integral part of this environment. (shrink)

Hertwig and Ortmann suggest methodological practices from economics (script enactment, repeated measures, performance based payments, and absence of deception) for psychology. Such prescriptive methodologies may be unrepresentative of real world behaviors because people are not: always behaving with complete information, monetarily rewarded for important activities, repeating tasks to perfection, aware of all contributing variables. These proscriptions, while useful in economics, may obfuscate important psychological phenomena.

The Bayesian model is used in psychology as the reference for the study of dynamic probability judgment. The main limit induced by this model is that it confines the study of revision of degrees of belief to the sole situations of revision in which the universe is static (revising situations). However, it may happen that individuals have to revise their degrees of belief when the message they learn specifies a change of direction in the universe, which is considered as changing (...) with time (updating situations). We analyze the main results of the experimental literature with regard to elementary qualitative properties of these two situations of revision. First, the order effect phenomenon is confronted with the commutative property. Second, an apparent new phenomenon is presented: the redundancy effect that is confronted with the idempotence property. Finally, results obtained in this kind of experimental situations are reinterpreted in the light of pragmatic analysis. (shrink)

The paper discuss the application of qualitative and quantitative techniques in political studies. It describes the classical proposal of Johan Galtung, known as trilateral science, which invites to the permanent contrast to confirm, validate and accept facts and ideas; then it explores Grounded Theory as a mechanism to achieve and explore data in order to identify a possible dialogue with experimental methodology. Finally, it shows social capital as a case study to demonstrate the relevance of multi-methodological applications. El (...) propósito de este texto es discutir la aplicación de técnicas cualitativas y cuantitativas en los estudios políticos. Para ello, se describe la propuesta clásica de Johan Galtung, conocida como trilateralismo, que invita al contraste permanente con el fin de confirmar, validar y aceptar hechos e ideas; luego, se busca explorar la Grounded Theory como mecanismo de consecución y exploración de datos con el fin de identificar un posible diálogo con la metodología experimental. Por último, se aborda el capital social como objeto de estudio que demuestra la pertinencia de aplicaciones multimetodológicas. (shrink)

Henrich et al.'s findings are generally consistent with the findings of other experimental field studies. However, the methodological variations deployed across field sites produced several systematic biases in their results. Hence, although the project is destined to become a watershed study, their results should be interpreted prudently.

The paper provides a commentary on B.G. Yudin's paper devoted to the relationship between technoscience and contemporary human enhancement technologies. In order to discuss these issues I address to T. Kuhn's conception of two traditions in the development of modern science. I show that technoscience belongs to the tradition that Kuhn calls the Baconian or ”experimental" sciences in contrast to the ”mathematical" sciences. I argue that technoscience creates an experimental environment for the study of a human being as (...) an integral part of this environment. (shrink)

The experimental approach in economics is a driving force behind some of the most exciting developments in the field. The 'experimental revolution' was based on a series of bold philosophical premises which have remained until now mostly unexplored. This book provides the first comprehensive analysis and critical discussion of the methodology of experimental economics, written by a philosopher of science with expertise in the field. It outlines the fundamental principles of experimental inference in order to (...) investigate their power, scope and limitations. The author demonstrates that experimental economists have a lot to gain by discussing openly the philosophical principles that guide their work, and that philosophers of science have a lot to learn from their ingenious techniques devised by experimenters in order to tackle difficult scientific problems. (shrink)

This article offers a critique of research practices typical of experimental philosophy. To that end, it presents a review of methodological issues that have proved crucial to the quality of research in the biobehavioral sciences. It discusses various shortcomings in the experimental philosophy literature related to (1) the credibility of self-report questionnaires, (2) the validity and reliability of measurement, (3) the adherence to appropriate procedures for sampling, random assignment, and handling of participants, and (4) the meticulousness of study (...) reporting. It argues that the future standing of experimental philosophy will hinge upon improvements in research methods. (shrink)

Until recently, experimental philosophy has been associated with the questionnaire-based study of intuitions; however, experimental philosophers now adapt a wide range of empirical methods for new philosophical purposes. New methods include paradigms for behavioural experiments from across the social sciences as well as computational methods from the digital humanities that can process large bodies of text and evidence. This book offers an accessible overview of these exciting innovations. The volume brings together established and emerging research leaders from several (...) areas of experimental philosophy to explore how new empirical methods can contribute to philosophical debates. Each chapter presents one or several methods new to experimental philosophy, demonstrating their application in a key area of philosophy and discussing their strengths and limitations. Methods covered include eye tracking, virtual reality technology, neuroimaging, statistical learning, and experimental economics as well as corpus linguistics, visualisation techniques and data and text mining. The volume explores their use in moral philosophy and moral psychology, epistemology, philosophy of science, metaphysics, philosophy of language, philosophy of mind and the history of ideas. Methodological Advances in Experimental Philosophy is essential reading for undergraduates, graduate students and researchers working in experimental philosophy. (shrink)

Must philosophers incorporate tools of experimental science into their methodological toolbox? I argue here that they must. Tallying up all the resources that are now part of standard practice in analytic philosophy, we see the problem that they do not include adequate resources for detecting and correcting for their own biases and proclivities towards error. Methodologically sufficient resources for error- detection and error-correction can only come, in part, from the deployment of specific methods from the sciences. However, we need (...) not imagine that the resulting methodological norms will be so empirically demanding as to require that all appeals to intuition must first be precertified by a thorough vetting by teams of scientists. Rather, I sketch a set of more moderate methodological norms for how we might best include these necessary tools of experimental philosophy. (shrink)

Experimental research is commonly held up as the paradigm of "good" science. Although experiment plays many roles in science, its classical role is testing hypotheses in controlled laboratory settings. Historical science is sometimes held to be inferior on the grounds that its hypothesis cannot be tested by controlled laboratory experiments. Using contemporary examples from diverse scientific disciplines, this paper explores differences in practice between historical and experimental research vis-à-vis the testing of hypotheses. It rejects the claim that historical (...) research is epistemically inferior. For as I argue, scientists engage in two very different patterns of evidential reasoning and, although there is overlap, one pattern predominates in historical research and the other pattern predominates in classical experimental research. I show that these different patterns of reasoning are grounded in an objective and remarkably pervasive time asymmetry of nature. (shrink)

This paper discusses methodological issues of two recent experiments conducted by Christopher Bartel, and Elzė S. Mikalonytė and Vilius Dranseika, respectively, about the repeatability and individuation of musical works. I argue, first, that the reliability of their results about people’s intuitions in our everyday musical practices can be questioned due to the use of descriptions instead of musical stimuli of the works and performances involved in the cases tested. This procedure is prone to place participants in an epistemic situation in (...) which their mental capacities for their everyday judgments are not deployed and makes their judgments more vulnerable to the problem of “filling in”. I provide empirical data of an experiment that implements musical stimuli, obtaining large effect sizes regarding the results obtained by Bartel, Mikalonytė and Dranseika. In addition, I argue that the results of three scenarios of the experiment conducted by Mikalonytė and Dranseika are suspicious of being influenced by presentation effects that favor the contextualist intuition that the composer is a relevant parameter in work-individuation. Formal and superficial aspects of the description of their cases would cause these effects. I supply empirical data of an experiment that neutralizes those effects, obtaining moderate and large effect sizes regarding the results of Mikalonytė and Dranseika. (shrink)

Understanding the nature of pain depends, at least partly, on recognizing its subjectivity (thus, its first-person epistemology). This in turn requires using a first-person experiential method in addition to third-person experimental approaches to study it. This paper is an attempt to spell out what the former approach is and how it can be integrated with the latter. We start our discussion by examining some foundational issues raised by the use of introspection. We argue that such a first-person method in (...) the scientific study of pain (as in the study of any experience) is in fact indispensable by demonstrating that it has in fact been consistently used in conjunction with conventional third-person methodologies, and this for good reasons. We show that, contrary to what appears to be a widespread opinion, there is absolutely no reason to think that the use of such a first-person approach is scientifically and methodologically suspect. We distinguish between two uses of introspective methods in scientific experiments: one draws on the subjects’ introspective reports where any investigator has equal and objective access. The other is where the investigator becomes a subject of his own study and draws on the introspection of his own experiences. We give examples using and/or approximating both strategies that include studies of second pain summation and its relationship to neural activities, and brain imaging- psychophysical studies wherein sensory and affective qualities of pain are correlated with cerebral cortical activity. We explain what we call the experiential or phenomenological approach that has its origins in the work of Price and Barrell (1980). This approach capitalizes on the scientific prospects and benefits of using the introspection of the investigator. We distinguish between its vertical and horizontal applications. Finally, we conclude that integrating such an approach to standard third-person methodologies can only help us in having a fuller understanding of pain and of conscious experience in general. (shrink)

This target article is concerned with the implications of the surprisingly different experimental practices in economics and in areas of psychology relevant to both economists and psychologists, such as behavioral decision making. We consider four features of experimentation in economics, namely, script enactment, repeated trials, performance-based monetary payments, and the proscription against deception, and compare them to experimental practices in psychology, primarily in the area of behavioral decision making. Whereas economists bring a precisely defined “script” to experiments for (...) participants to enact, psychologists often do not provide such a script, leaving participants to infer what choices the situation affords. By often using repeated experimental trials, economists allow participants to learn about the task and the environment; psychologists typically do not. Economists generally pay participants on the basis of clearly defined performance criteria; psychologists usually pay a flat fee or grant a fixed amount of course credit. Economists virtually never deceive participants; psychologists, especially in some areas of inquiry, often do. We argue that experimental standards in economics are regulatory in that they allow for little variation between the experimental practices of individual researchers. The experimental standards in psychology, by contrast, are comparatively laissez-faire. We believe that the wider range of experimental practices in psychology reflects a lack of procedural regularity that may contribute to the variability of empirical findings in the research fields under consideration. We conclude with a call for more research on the consequences of methodological preferences, such as the use on monetary payments, and propose a “do-it-both-ways” rule regarding the enactment of scripts, repetition of trials, and performance-based monetary payments. We also argue, on pragmatic grounds, that the default practice should be not to deceive participants. Key Words: behavioral decision making; cognitive illusions; deception; experimental design; experimental economics; experimental practices; financial incentives; learning; role playing. (shrink)

According to the methodological principle called ‘robustness’, empirical evidence is more reliable when it is generated using multiple, independent (experimental) routes that converge on the same result. As it happens, robustness as a methodological strategy is quite popular amongst philosophers. However, despite its popularity, my goal here is to criticize the value of this principle on historical grounds. My historical reasons take into consideration some recent history of astroparticle physics concerning the search for WIMPs (weakly interacting massive particles), one (...) of the main candidates for cosmic dark matter. On the basis of these reasons, I assert that robustness, at least in this historical case we are considering, has less value than usually assumed by philosophers. (shrink)

Experimental philosophy is a comparatively new field of research, and it is only natural that many of the key methodological questions have not even been asked, much less answered. In responding to the comments of our critics, we therefore find ourselves brushing up against difficult questions about the aims and techniques of our whole enterprise. We will do our best to address these issues here, but the field is progressing at a rapid clip, and we suspect that it will (...) be possible to provide more adequate answers a few years down the line. (shrink)

This paper discusses two methodological notions, the concepts Gegenprobe (countercheck) and Gegenversuch (counter-trial), which were widely applied, discussed, relied upon, and defended in German-language writings about empirical inquiry. In the decades around 1800, they were common in physiology; medicine; agriculture; chemistry; various technologies, such as printing, metallurgy, and mining; accounting; and legal and political argumentation. The ubiquity of those concepts signals a broad concern with securing empirical findings and empirical knowledge. Gegenproben and Gegenversuche – the terms as well as the (...) practices – are evidence for the close connection among explicitly knowledge-seeking endeavors and crafts and technologies. Physiological experiments, chemical analyses, agricultural or vaccination trials were indebted to applied and practical procedures of making and assaying. What united these different fields was the fact that the problems that had to be solved were very complex yet at the same time of immediate relevance to everyday lives (like diseases or crops) or highly controversial (like vital forces or spontaneous generation). We know that late eighteenth-century and early nineteenth-century practices of inquiry were firmly embedded in applied, technical contexts; this essay shows that methodological notions were anchored in applied, technical contexts as well. (shrink)

The growing acceptance and success of experimental economics has increased the interest of researchers in tackling philosophical and methodological challenges to which their work increasingly gives rise. I sketch some general issues that call for the combined expertise of experimental economists and philosophers of science, of experiment, and of inductive‐statistical inference and modeling. †To contact the author, please write to: 235 Major Williams, Virginia Tech, Blacksburg, VA 24061‐0126; e‐mail: [email protected].

New Methodological Perspectives on Observation and Experimentation in Science deals with a classic topic that is seen from new angles.

Filósofos, especialmente aqueles que se autodenominam como naturalistas, parecem cada vez mais interessados em realizar pesquisas empíricas. Um caso típico é o da Filosofia Experimental, um campo emergente que faz uso de dados empíricos colhido por meio de inquéritos seguindo os mesmos métodos empregados nas ciências empíricas, nomeadamente na psicologia, a fim de apresentar provas em pesquisas ou argumentos filosóficos. Outro exemplo é oferecido pela participação ativa dos filósofos em grupos de pesquisa interdisciplinares nas neurociências. No entanto, os filósofos (...) não são especialistas em metodologia de pesquisa empírica. Isso é transparente nos estudos mais representativos em filosofia experimental. Neste artigo, faremos algumas observações de advertência sobre as complexidades da metodologia das ciências empíricas. A recomendação final é de que é sábia a atitude de envolver-se em grupos de pesquisa interdisciplinares, buscando dominar as peculiaridades dos mais diversos delineamentos de pesquisa empírica nas diferentes áreas da ciência. (shrink)

The rise of experimental philosophy is generating pressing methodological questions for philosophers. Can findings from experimental studies hold any significance for philosophy as a discipline? Can philosophical theorizing be improved through consideration of such studies? Do these studies threaten traditional philosophical methodology?

This response reinforces the major themes of our target article. The impact of key methodological variables should not be taken for granted. Rather, we suggest grounding experimental practices in empirical evidence. If no evidence is available, decisions about design and implementation ought to be subjected to systematic experimentation. In other words, we argue against empirically blind conventions and against methodological choices based on beliefs, habits, or rituals. Our approach will neither inhibit methodological diversity nor constrain experimental creativity. More (...) likely, it will promote both goals. (shrink)

Experimental psychologists in the learning tradition stress the importance of three of the authors' four key variables of experimental design. We review research investigating the roles played by these variables in studies of choice from our laboratory. Supporting the authors' claims, these studies show that the effects of these variables are not fixed and should not be taken for granted.

Features of experimental design impose auxiliary hypotheses on experimenters. Hertwig & Ortmann rightly argue that the ways some variables are implemented in psychology cloud results, whereas the different implementations in economics provide for more robust results. However, not all design variables support this general conclusion. The repetition of trials may confuse results depending on what theory is being tested. We explore this in the case of simple bargaining games.

In the late 19th century, physiologists such as David Ferrier, Eduard Hitzig, and Hermann Munk argued that cerebral brain functions are localized in discrete structures. By the early 20th century, this became the dominant position. However, another prominent physiologist, Friedrich Goltz, rejected theories of cerebral localization and argued against these physiologists until his death in 1902. I argue in this paper that previous historical accounts have failed to comprehend why Goltz rejected cerebral localization. I show that Goltz adhered to a (...) falsificationist methodology, and I reconstruct how he designed his experiments and weighted different kinds of evidence. I then draw on the exploratory experimentation literature from recent philosophy of science to trace one root of the debate to differences in how the German localizers designed their experiments and reasoned about evidence. While Goltz designed his experiments to test hypotheses about the functions of predetermined cerebral structures, the localizers explored new functions and structures in the process of constructing new theories. I argue that the localizers relied on untested background conjectures to justify their inferences about functional organization. These background conjectures collapsed a distinction between phenomena they produced direct evidence for (localized symptoms) and what they reached conclusions about (localized functions). (shrink)

My main argument is that the advice offered to experimental psychologists by Hertwig & Ortmann overlooks fundamental differences between the goals of researchers in psychology and economics. Furthermore, it is argued that the reduction of data variability is not always an end to be sought by psychologists. Variability that originates in individual differences constitutes valuable data for psychological research.

The target article suggests that many practices of experimental economists are preferable to those used by psychologists studying judgment and decision making. The advantages of the psychological approach become clear when the focus of research shifts from choice output to choice processes. I illustrate this point with an example from research on similarity comparisons.

For a variety of reasons, including the common use of deception in psychology experiments, participants often disbelieve experimenters' assertions about important task parameters. This can lead researchers to conclude incorrectly that participants are behaving non- normatively. The problem can be overcome by deriving and testing normative models that do not assume full belief in key task parameters. A real experimental example is discussed.

Hertwig and Ortmann suggest greater standardization of procedures in experimental psychology to help with problems of replicability and consistency of findings. It is argued that, this view is inconsistent with their other interesting proposals, and heterogeneity of method is appropriate in psychology.

Experimental Philosophy (X-Phi) is now a fully-fledged methodological project with applications in almost all areas of analytic philosophy, including, as of recently, aesthetics. Another methodological project which has been attracting attention in the last few years is conceptual engineering (CE). Its areas of implementation are now diverse, but as was the case initially with experimental philosophy, aesthetics has unfortunately been left out (or perhaps aestheticians have failed to pay attention to CE) until now. In this paper, I argue (...) that if conceptual engineers are interested in expanding their project to the field of aesthetics, which would greatly benefit the field, then they should rely on the existing experimental work of aestheticians. Experimental philosophers have only recently started to join forces with conceptual engineers in various fields, as well as to explore the methodological implications of such an alliance. This paper goes a step further by not only arguing that CE has potential in aesthetics, but that the way to realize this potential is to piggyback, so to speak, on the work of experimental aestheticians. In other words, instead of building a CE project in aesthetics from the ground up, this paper describes the support that CE can and should derive from current experimental aesthetics, thereby making the former’s development more efficiently realizable. Furthermore, I argue that doing so would also be beneficial to experimental aesthetics. Currently, the integration of X-Phi to the wider field of aesthetics is losing ground because certain objections—notably, the objection that X-Phi cannot be of relevance to normative questions—have not been properly refuted. By pairing up with a normative programme like CE, though, experimental aestheticians should finally be able to put these objections to rest. (shrink)

The use of high hypothetical payoffs has been justified by the realism and relevance of large monetary consequences and by the impracticality of making high cash payments. We argue that subjects may not be able to imagine how they would behave in high payoff situations.

Hertwig and Ortmann suggest paying participants contingent upon performance in order to increase the thoroughness they devote to a decision task. We argue that monetary incentives can yield a number of unintended effects including distortions of the subjective representation of the task and impaired performance. Therefore, we conclude that performance-contingent payment should not be generally employed in judgment and decision research.

A methodological imperative, reproducibility, is proposed for experimental research. This is motivated by recent discussions of normative naturalism as well as the recent interest in the philosophical implications of experimental research. The role of this norm is examined in the context of the routine research procedures in a high-energy scattering experiment. The specific details of the experimental analysis of resonance production in the interaction π +P→ Pπ + π + π - π 0 at 18.5 Ge V/c (...) are discussed in light of the importance of reproducing experimental results. In this context, a more complex meaning of this norm emerges. It is suggested that this type of empirical evaluation of hypothetical imperatives should be at the core of the normative naturalist's program. (shrink)

This essay proposes that subcultural practices such as gossip and fan writing are feminist epistemologies that can form radical archive inquiry and knowledge production, and creative outputs. Drawing on feminist new materialism and archive theory, I develop a set of principles for practice-based research methodologies that incorporate a researcher's intersubjective relationship with archive matter (e.g. records, documents, classification systems, social-material contexts) and consider the production of knowledge from such research as forms of tabulation. Fabulation here is seen as part of (...) a critically transgressive epistemological stance that expands feminist critiques of universalising master narratives and archive orthodoxies. My proposition, formed in part through a residency in the Woman's Art Library in London, is to name such research gestures ‘archive fanfiction’, where experimental and practice-oriented method moves with feminist politics and activism. (shrink)

The Handbook of Experimental Economic Methodology, edited by Guillaume R. Fréchette and Andrew Schotter, aims to confront and debate the issues faced by the growing field of experimental economics. For example, as experimental work attempts to test theory, it raises questions about the proper relationship between theory and experiments. As experimental results are used to inform policy, the utility of these results outside the lab is questioned, and finally, as experimental economics tries to integrate (...) ideas from other disciplines like psychology and neuroscience, the question of their proper place in the discipline of economics becomes less clear.This book contains papers written by some of the most accomplished scholars working at the intersection of experimental, behavioral, and theoretical economics talking about methodology. It is divided into four sections, each of which features a set of papers and a set of comments on those papers. The intention of the volume is to offer a place where ideas about methodology could be discussed and even argued. Some of the papers are contentious---a healthy sign of a dynamic discipline---while others lay out a vision for how the authors think experimental economics should be pursued. This exciting and illuminating collection of papers brings light to a topic at the core of experimental economics. Researchers from a broad range of fields will benefit from the exploration of these important questions. (shrink)

“This book aims to show that methodology is important and useful for experimental economists, but also that philosophers of science can learn from experimental economics”. With these words Francesco Guala makes clear right from the start what moved him to write this important book. The book is divided into two parts. The first part is dedicated to the theme of “inferences within the experiment,” and the second to “inferences from the experiment.” Each part is divided into five (...) chapters. (shrink)

One of the most influential methodological contributions of twentieth‐century philosophy was the approach known as conceptual analysis. The majority of experimental philosophy papers are doing cognitive science. They are revealing surprising new effects and then offering explanations those effects in terms of certain underlying cognitive processes. The best way to get a sense for actual research programs in experimental philosophy is to look in detail at one particular example. This chapter considers the effect of moral considerations on intuitions (...) about intentional action, as an example. Working in conceptual analysis aimed to develop analyses of concepts, and in that context, the obvious proposal would be that people should be aiming for simple analyses of concepts. The chapter also focuses on the study of intuitions about knowledge. Experimental philosophy has sought to capture the patterns in people's intuitions through theories about underlying cognitive processes. (shrink)