Hostname: page-component-8448b6f56d-c4f8m Total loading time: 0 Render date: 2024-04-23T19:34:57.881Z Has data issue: false hasContentIssue false

ON NORMATIVITY AND EPISTEMIC INTUITIONS: FAILURE OF REPLICATION

Published online by Cambridge University Press:  08 December 2014

Abstract

The field of experimental philosophy has received considerable attention, essentially for producing results that seem highly counter-intuitive and at the same time question some of the fundamental methods used in philosophy. One of the earlier influential papers that gave rise to the experimental philosophy movement titled ‘Normativity and Epistemic Intuitions’ by Jonathan M. Weinberg, Shaun Nichols and Stephen Stich (2001), reported that respondents displayed different epistemic intuitions depending on their ethnic background as well as socioeconomic status. These findings, if robust, would have important implications for philosophical methodology in general and epistemology in particular. Because of the important implication of its findings, Weinberg et al. (2001) has been very influential – currently with more than four hundred citations – and the subject of extensive debate. Despite the paper's significance and despite all the debates this paper has generated, there has not been a replication attempt of its experiments. We collected data from four different sources (two on-line and two in-person) to replicate the experiments. Despite several different data sets and in various cases larger sample sizes, we failed to detect significant differences between the above-mentioned groups. Our results suggest that epistemic intuitions are more uniform across ethnic and socioeconomic groups than Weinberg et al. (2001) indicates. Given our data, we believe that the notion of differences in epistemic intuitions among different ethnic and socioeconomic groups advanced by Weinberg et al. (2001) and accepted by many researchers needs to be corrected.

Type
Articles
Copyright
Copyright © Cambridge University Press 2014 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Alexander, J. 2012. Experimental Philosophy: An Introduction: Cambridge: Polity Press.Google Scholar
Alexander, J., Mallon, R., and Weinberg, J. M. 2010. ‘Accentuate the Negative.’ Review of Philosophy and Psychology, 1: 297314.CrossRefGoogle Scholar
Alexander, J. and Weinberg, J. M. 2007. ‘Analytic Epistemology and Experimental Philosophy.’ Philosophy Compass, 2: 5680.CrossRefGoogle Scholar
Amir, Y. and Sharon, I. 1991. ‘Replication Research: A ‘Must’ for the Scientific Advancement of Psychology.’ In Neuliep, J. W. (ed.), Replication Research in the Social Sciences, pp. 5171. Newbury Park, CA: Sage.Google Scholar
Bakker, M., van Dijk, A., and Wicherts, J. M. 2012. ‘The Rules of the Game Called Psychological Science.’ Perspectives on Psychological Science, 7: 543–54.Google Scholar
Bealer, G. 1996. ‘A Priori Knowledge and the Scope of Philosophy.’ Philosophical Studies, 81(2–3), 121–42.CrossRefGoogle Scholar
Bealer, G. 2000. ‘A Theory of the A Priori.’ Pacific Philosophical Quarterly, 81: 130.Google Scholar
Beebe, J. R. and Buckwalter, W. 2010. ‘The Epistemic Side-Effect Effect.’ Mind and Language, 25: 474–98.CrossRefGoogle Scholar
Bishop, M. and Trout, J. 2005. ‘The Pathologies of Standard Analytic Epistemology.’ Nous, 39: 696714.CrossRefGoogle Scholar
Bozarth, J. D. and Roberts, R. R. 1972. ‘Signifying Significant Significance.’ American Psychologist, 27: 774–5.Google Scholar
Braude, S. E. 1979. ESP and Psychokinesis: A Philosophical Examination. Philadelphia, PA: Temple University Press.Google Scholar
Buckwalter, W. 2010. ‘Knowledge isn't Closed on Saturday: A Study in Ordinary Language.’ Review of Philosophy and Psychology, 1: 395406.Google Scholar
Buckwalter, W. and Stich, S. Forthcoming. ‘Gender and Philosophical Intuition.’ In Knobe, J. and Nichols, S. (eds), Experimental Philosophy (Vol. 2). Oxford: Oxford University Press.Google Scholar
Burnyeat, M. 1990. The Theaetetus of Plato. Indianapolis, IN: Hackett Publishing.Google Scholar
Cappelen, H. 2012. Philosophy without Intuitions. Oxford: Oxford University Press.CrossRefGoogle Scholar
Chudnoff, E. 2011. ‘The Nature of Intuitive Justification.’ Philosophical Studies, 153: 313–33.CrossRefGoogle Scholar
Collins, H. M. 1992. Changing Order: Replication and Induction in Scientific Practice. Chicago, IL: University of Chicago Press.Google Scholar
Colaço, D.Buckwalter, W.Stich, S. and Machery, E. (2014). Epistemic intuitions in fake-barn thought experiments. Episteme, 11(02), 199212. doi: doi:10.1017/epi.2014.7CrossRefGoogle Scholar
Cullen, S. 2010. ‘Survey-driven Romanticism.’ Review of Philosophy and Psychology, 1: 275–96.CrossRefGoogle Scholar
Cummins, R. 1998. ‘Reflection on Reflective Equilibrium.’ In DePaul, M. R. & Ramsey, W. (eds), Rethinking Intuition: The Psychology of Intuition and its Role in Philosophical Inquiry, pp. 113–29. Lanham, MD: Rowman & Littlefield.Google Scholar
Deutsch, M. 2009. ‘Experimental Philosophy and the Theory of Reference.’ Mind and Language, 24: 445–66.Google Scholar
Deutsch, M. 2010. ‘Intuitions, Counter-examples, and Experimental Philosophy.’ Review of Philosophy and Psychology, 1: 447–60.Google Scholar
Doris, J. M. 2005. ‘Replies: Evidence and Sensibility.’ Philosophy and Phenomenological Research, 71: 656–77.Google Scholar
Dowell, J. 2008. ‘Empirical Metaphysics: The Role of Intuitions about Possible Cases in Philosophy.’ Philosophical Studies, 140: 1946.Google Scholar
Evans, K., Rotello, C. M., Li, X., and Rayner, K. 2009. ‘Scene Perception and Memory Revealed by Eye Movements and Receiver-operating Characteristic Analyses: Does a Cultural Difference Truly Exist?Quarterly Journal of Experimental Psychology, 62: 276–85.CrossRefGoogle ScholarPubMed
Feltz, A. 2008. ‘Problems with the Appeal to Intuition in Epistemology.’ Philosophical Explorations, 11: 131–41.CrossRefGoogle Scholar
Feltz, A. 2009. ‘Experimental Philosophy.’ Analyse und Kritik – Zeitschrift fur Sozialwissenschaften, 31: 201.CrossRefGoogle Scholar
Francis, G. 2012. ‘The Psychology of Replication and Replication in Psychology.’ Perspectives on Psychological Science, 7: 585–94.CrossRefGoogle ScholarPubMed
Gendler, T. S. 2007. ‘Philosophical Thought Experiments, Intuitions, and Cognitive Equilibrium.’ Midwest Studies in Philosophy, 31: 6889.CrossRefGoogle Scholar
Gettier, E. L. 1963. ‘Is Justified True Belief Knowledge?Analysis, 23: 121–3.Google Scholar
Goldman, A. I. 2007. ‘Philosophical Intuitions: Their Target, their Source, and their Epistemic Status.’ Grazer Philosophische Studien, 74: 126.Google Scholar
Goldman, A. and Pust, J. 1998. ‘Philosophical Theory and Intuitional Evidence.’ In DePaul, M. R. and Ramsey, W. (eds), Rethinking Intuition: The Psychology of Intuition and its Role in Philosophical Inquiry, pp. 179201. Lanham, MD: Rowman & Littlefield.Google Scholar
Gopnik, A. and Schwitzgebel, E. 1998. ‘Whose Concepts are They, Anyway? The Role of Philosophical Intuition in Empirical Psychology.’ In DePaul, M. R. and Ramsey, W. (eds), Rethinking Intuition: The Psychology of Intuition and its Role in Philosophical Inquiry, pp. 7595. Lanham, MD: Rowman & Littlefield.Google Scholar
Grundmann, T. 2010. ‘Some Hope for Intuitions: A Reply to Weinberg.’ Philosophical Psychology, 23: 481509.Google Scholar
Gutting, G. 1998. ‘‘Rethinking intuition’: A Historical and Metaphilosophical Introduction.’ In DePaul, M. R. and Ramsey, W. (eds), Rethinking Intuition: The Psychology of Intuition and its Role in Philosophical Inquiry, pp. 317. Lanham, MD: Rowman & Littlefield.Google Scholar
Hendrick, C. 1991. ‘Replications, Strict Replications, and Conceptual Replications: Are They Important?’ In Neuliep, J. W. (ed.), Replication Research in the Social Sciences, pp. 4151. Newbury Park, CA: Sage.Google Scholar
Ichikawa, J. 2014. ‘Who needs Intuitions? Two Experimentalist Critiques.’ In Booth, A. and Rowbottom, D. (eds), Intuitions. Oxford: Oxford University Press.Google Scholar
Ioannidis, J. P. A. 2005. ‘Why Most Published Research Findings are False.’ PloS Medicine, 2: 696701.Google Scholar
Ioannidis, J. P. A. 2012. ‘Why Science Is Not Necessarily Self-Correcting.’ Perspectives on Psychological Science, 7: 645–54.Google Scholar
Knobe, J. 2007. ‘Experimental Philosophy.’ Philosophy Compass, 2: 8192.Google Scholar
Knobe, J. and Nichols, S. 2008. Experimental Philosophy. Oxford: Oxford University Press.Google Scholar
Koole, S. L. and Lakens, D. 2012. ‘Rewarding Replications: A Sure and Simple Way to Improve Psychological Science.’ Perspectives on Psychological Science, 7: 608–14.Google Scholar
Koppl, R. 2011. ‘Against Representative Agent Methodology.’ Review of Austrian Economics, 24: 4355.CrossRefGoogle Scholar
Kornblith, H. 1998. ‘The Role of Intuition in Philosophical Inquiry: An Account with no Unnatural Ingredients.’ In DePaul, M. R. and Ramsey, W. (eds), Rethinking Intuition: The Psychology of Intuition and its Role in Philosophical Inquiry, pp. 129–43. Lanham, MD: Rowman & Littlefield.Google Scholar
Lamal, P. A. 1991. ‘On the Importance of Replication.’ In Neuliep, J. W. (ed.), Replication Research in the Social Sciences, pp. 31–7. Newbury Park, CA: Sage.Google Scholar
Levin, J. 2005. ‘The Evidential Status of Philosophical Intuition.’ Philosophical Studies, 121: 193224.Google Scholar
Liao, S. M. 2008. ‘A Defense of Intuitions.’ Philosophical Studies, 140: 247–62.Google Scholar
Löwe, B., Müller, T., and Müller-Hill, E. 2009. ‘Mathematical Knowledge: A Case Study in Empirical Philosophy of Mathematics.’ In Van Kerkhove, B., De Vuyst, J., and Van Bendegem, J. P. (eds), Philosophical Perspectives on Mathematical Practice. London: College Publications.Google Scholar
Lu, Z., Daneman, M., and Reingold, E. M. 2008. ‘Cultural Differences in Cognitive Processing Styles: Evidence from Eye Movements during Scene Perception.’ In Love, B. C., McRae, K., and Sloutsky, V. M. (eds), Proceedings of the 30th Annual Conference of the Cognitive Science Society, pp. 24282432. Austin, TX: Cognitive Science Society.Google Scholar
Machery, E., Mallon, R., Nichols, S., and Stich, S. P. 2004. ‘Semantics, Cross-cultural Style.Cognition, 92(3): B1B12.Google Scholar
Makel, M. C., Plucker, J. A., and Hegarty, B. 2012. ‘Replications in Psychology Research: How Often Do They Really Occur?Perspectives on Psychological Science, 7: 537–42.Google Scholar
Mallon, R., Machery, E., Nichols, S., and Stich, S. 2009. ‘Against Arguments from Reference.’ Philosophy and Phenomenological Research, 79: 332–56.Google Scholar
Miellet, S., Zhou, X., He, L., Rodger, H., and Caldara, R. 2010. ‘Investigating Cultural Diversity for Extrafoveal Information Use in Visual Scenes.’ Journal of Vision, 10(6): 21.Google Scholar
Minsun, K., and Yuan, Y. Manuscript. No Cross-Cultural Differences in Gettier Car Case Intuition: A Replication Study of Weinberg et al. 2001.Google Scholar
Nadelhoffer, T. and Nahmias, E. 2007. ‘The Past and Future of Experimental Philosophy.’ Philosophical Explorations, 10: 123–49.CrossRefGoogle Scholar
Nagel, J. 2012. ‘Intuitions and Experiments: A Defense of the Case Method in Epistemology.’ Philosophy and Phenomenological Research, 85: 495527.Google Scholar
Nagel, J. 2013. ‘Defending the Evidential Value of Epistemic Intuitions: A Reply to Stich.’ Philosophy and Phenomenological Research, 87: 179–99.Google Scholar
Nagel, J., Juan, V. S., and Mar, R. A. 2013. ‘Lay Denial of Knowledge for Justified True Beliefs.’ Cognition, 129: 652–61.Google Scholar
Neuliep, J. W. and Crandall, R. 1991. ‘Editorial Bias Against Replication Research.’ In Neuliep, J. W. (ed.), Replication Research in the Social Sciences, pp. 31–7. Newbury Park, CA: Sage.Google Scholar
Nichols, S. 2004. ‘Folk Concepts and Intuitions: From Philosophy to Cognitive Science.’ Trends in Cognitive Sciences, 8: 514–18.Google Scholar
Nisbett, R. E., Peng, K., Choi, I., and Norenzayan, A. 2001. ‘Culture and Systems of Thought: Holistic versus Analytic Cognition.’ Psychological Review, 108: 291.Google Scholar
Nosek, B. A. 2012. ‘Reproducibility Project.’ https://openscienceframework.org/project/EZcUj/statistics.Google Scholar
Nosek, B. A., Spies, J. R., and Motyl, M. 2012. ‘Scientific Utopia: II. Restructuring Incentives and Practices to Promote Truth Over Publishability.’ Perspectives on Psychological Science, 7: 615–31.CrossRefGoogle ScholarPubMed
Osbeck, L. M. 1999. ‘Conceptual Problems in the Development of a Psychological Notion of ‘Intuition’.’ Journal for the Theory of Social Behaviour, 29: 229–49.Google Scholar
Pardo, M. S. 2005. ‘The Field of Evidence and the Field of Knowledge.’ Law and Philosophy, 24: 321–92.Google Scholar
Pashler, H. and Harris, C. R. 2012. ‘Is the Replicability Crisis Overblown? Three Arguments Examined.’ Perspectives on Psychological Science, 7: 531–6.Google Scholar
Pashler, H. and Wagenmakers, E. J. 2012. ‘Editors' Introduction to the Special Section on Replicability in Psychological Science: A Crisis of Confidence?Perspectives on Psychological Science, 7: 528–30.Google Scholar
Popper, K. R. 2002. The Logic of Scientific Discovery. London: Routledge.Google Scholar
Ramsey, W. 1992. ‘Prototypes and Conceptual Analysis.’ Topoi, 11: 5970.Google Scholar
Rayner, K., Li, X., Williams, C. C., Cave, K. R., and Well, A. D. 2007. ‘Eye Movements During Information Processing Tasks: Individual Differences and Cultural Effects.’ Vision Research, 47: 2714–26.Google Scholar
Rayner, K., Castelhano, M. S., and Yang, J. 2009. ‘Eye Movements when Looking at Unusual/Weird Scenes: Are There Cultural Differences?Journal of Experimental Psychology: Learning, Memory, and Cognition, 35: 254.Google Scholar
Ritchie, S. J., Wiseman, R., and French, C. C. 2012. ‘Replication, Replication, Replication.’ Psychologist, 25: 346–8.Google Scholar
Shafir, E. 1998. Philosophical intuitions and cognitive mechanisms. In DePaul, M. R. and Ramsey, W. (eds), Rethinking Intuition: The Psychology of Intuition and its Role in Philosophical Inquiry, pp. 5975. Lanham, MD: Rowman & Littlefield.Google Scholar
Shieber, J. 2010. ‘On the Nature of Thought Experiments and a Core Motivation of Experimental Philosophy.’ Philosophical Psychology, 23: 547–64.Google Scholar
Smith, N. C. 1970. ‘Replication Studies: A Neglected Aspect of Psychological Research.’ American Psychologist, 25: 970.Google Scholar
Sosa, D. 2006. ‘Scepticism about Intuition.’ Philosophy, 318: 633.Google Scholar
Sosa, E. 1998. Minimal Intuition. In DePaul, M. R. and Ramsey, W. (eds), Rethinking Intuition: The Psychology of Intuition and its Role in Philosophical Inquiry, pp. 257–71. Lanham, MD: Rowman & Littlefield.Google Scholar
Sosa, E. 2007. ‘Experimental Philosophy and Philosophical Intuition.’ Philosophical Studies, 132: 99107.Google Scholar
Sosa, E. 2009. ‘A Defense of the Use of Intuitions in Philosophy.’ In Bishop, M. and Murphy, D. (eds), Stich and His Critics, pp. 101–12. Oxford: Blackwell.Google Scholar
Starmans, C. and Friedman, O. 2012. ‘The Folk Conception Of Knowledge.’ Cognition, 124: 272–83.Google Scholar
Stich, S. 1988. ‘Reflective Equilibrium, Analytic Epistemology and the Problem of Cognitive Diversity.’ Synthese, 74: 391413.Google Scholar
Stich, S. 2001. ‘Plato's Method Meets Cognitive Science.’ http://www.rci.rutgers.edu/~stich/Publications/Papers/Plato_Method.pdf.Google Scholar
Symons, J. 2008. ‘Intuition and Philosophical Methodology.’ Axiomathes, 18: 6789.Google Scholar
Turri, J. 2013. A Conspicuous Art: Putting Gettier to the Test. Ann Arbor, MI: Michigan Publishing, University of Michigan Library.Google Scholar
Weatherson, B. 2003. ‘What Good are Counterexamples?Philosophical Studies, 115: 131.Google Scholar
Weinberg, J. M., Nichols, S., and Stich, S. 2001. ‘Normativity and Epistemic Intuitions.’ Philosophical Topics, 29: 429–60.Google Scholar
Wild, K. W. 1938. Intuition. Cambridge: Cambridge University Press.Google Scholar
Williamson, T. 2004. ‘Philosphical ‘Intuitions’ and Scepticism about Judgement.' Dialectica, 58: 109–53.Google Scholar
Williamson, T. 2011. ‘Philosophical Expertise and the Burden of Proof.’ Metaphilosophy, 42: 215–29.Google Scholar
Wisniewski, E. J. 1998. ‘The Psychology of Intuition.’ In DePaul, M. R. & Ramsey, W. (eds), Rethinking Intuition: The Psychology of Intuition and its Role in Philosophical Inquiry, pp. 4559. Lanham, MD: Rowman and Littlefield.Google Scholar
Wright, J. C. 2010. ‘On Intuitional Stability: The Clear, the Strong, and the Paradigmatic.’ Cognition, 115: 491503.Google Scholar
Zamzow, J. L. and Nichols, S. 2009. ‘Variations in Ethical Intuitions.’ Philosophical Issues, 19: 368–88.Google Scholar
Zhou, J., Gotch, C., Zhou, Y., and Liu, Z. 2008. ‘Perceiving an object in its context: Is the Context Cultural or Perceptual?Journal of Vision, 8: 2.15.Google Scholar