David Bourget (Western Ontario)
David Chalmers (ANU, NYU)
Rafael De Clercq
Jack Alan Reynolds
Learn more about PhilPapers
Topics in Cognitive Science 4 (1):151-163 (2012)
We apply a cognitive modeling approach to the problem of measuring expertise on rank ordering problems. In these problems, people must order a set of items in terms of a given criterion (e.g., ordering American holidays through the calendar year). Using a cognitive model of behavior on this problem that allows for individual differences in knowledge, we are able to infer people's expertise directly from the rankings they provide. We show that our model-based measure of expertise outperforms self-report measures, taken both before and after completing the ordering of items, in terms of correlation with the actual accuracy of the answers. These results apply to six general knowledge tasks, like ordering American holidays, and two prediction tasks, involving sporting and television competitions. Based on these results, we discuss the potential and limitations of using cognitive models in assessing expertise
|Keywords||Wisdom of crowds Prediction Ordering problem Model‐based measurement Knowledge Expertise Ranking problem|
|Categories||categorize this paper)|
Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
|Through your library|
References found in this work BETA
Richard M. Shiffrin, Michael D. Lee, Woojae Kim & Eric‐Jan Wagenmakers (2008). A Survey of Model Evaluation Approaches With a Tutorial on Hierarchical Bayesian Methods. Cognitive Science 32 (8):1248-1284.
Citations of this work BETA
No citations found.
Similar books and articles
Zoltan P. Majdik & William M. Keith (2011). The Problem of Pluralistic Expertise: A Wittgensteinian Approach to the Rhetorical Basis of Expertise. Social Epistemology 25 (3):275 - 290.
Damien Smith Pfister (2011). Networked Expertise in the Era of Many-to-Many Communication: On Wikipedia and Invention. Social Epistemology 25 (3):217 - 231.
Harry Collins & Martin Weinel (2011). Transmuted Expertise: How Technical Non-Experts Can Assess Experts and Expertise. [REVIEW] Argumentation 25 (3):401-413.
Harry Collins (2004). Interactional Expertise as a Third Kind of Knowledge. Phenomenology and the Cognitive Sciences 3 (2):125-143.
Zoltan P. Majdik & William M. Keith (2011). Expertise as Argument: Authority, Democracy, and Problem-Solving. [REVIEW] Argumentation 25 (3):371-384.
George J. Agich (2009). The Issue of Expertise in Clinical Ethics. Diametros 22:3-20.
Jason Borenstein (2002). Authenticating Expertise. International Journal of Applied Philosophy 16 (1):85-102.
Harry Collins (2013). Three Dimensions of Expertise. Phenomenology and the Cognitive Sciences 12 (2):253-273.
Harry Collins (2004). The Trouble with Madeleine. Phenomenology and the Cognitive Sciences 3 (2):165-170.
Bruce D. Weinstein (1994). The Possibility of Ethical Expertise. Theoretical Medicine and Bioethics 15 (1):1-187.
Robert C. Reed (2013). Euthyphro's Elenchus Experience: Ethical Expertise and Self-Knowledge. [REVIEW] Ethical Theory and Moral Practice 16 (2):245-259.
Michael Harré, Terry Bossomaier & Allan Snyder (2011). The Development of Human Expertise in a Complex Environment. Minds and Machines 21 (3):449-464.
Timothy Williamson (2011). Philosophical Expertise and the Burden of Proof. Metaphilosophy 42 (3):215-229.
Gregory J. Feist (2013). The Nature and Nurture of Expertise: A Fourth Dimension. [REVIEW] Phenomenology and the Cognitive Sciences 12 (2):275-288.
Evan Selinger & John Mix (2004). On Interactional Expertise: Pragmatic and Ontological Considerations. Phenomenology and the Cognitive Sciences 3 (2):145-163.
Added to index2012-01-18
Total downloads15 ( #155,553 of 1,696,615 )
Recent downloads (6 months)6 ( #95,357 of 1,696,615 )
How can I increase my downloads?