Topics in Cognitive Science 4 (1):151-163 (2012)
We apply a cognitive modeling approach to the problem of measuring expertise on rank ordering problems. In these problems, people must order a set of items in terms of a given criterion (e.g., ordering American holidays through the calendar year). Using a cognitive model of behavior on this problem that allows for individual differences in knowledge, we are able to infer people's expertise directly from the rankings they provide. We show that our model-based measure of expertise outperforms self-report measures, taken both before and after completing the ordering of items, in terms of correlation with the actual accuracy of the answers. These results apply to six general knowledge tasks, like ordering American holidays, and two prediction tasks, involving sporting and television competitions. Based on these results, we discuss the potential and limitations of using cognitive models in assessing expertise
|Keywords||Wisdom of crowds Prediction Ordering problem Model‐based measurement Knowledge Expertise Ranking problem|
|Categories||categorize this paper)|
References found in this work BETA
A Survey of Model Evaluation Approaches With a Tutorial on Hierarchical Bayesian Methods.Richard M. Shiffrin, Michael D. Lee, Woojae Kim & Eric‐Jan Wagenmakers - 2008 - Cognitive Science 32 (8):1248-1284.
Citations of this work BETA
No citations found.
Similar books and articles
The Problem of Pluralistic Expertise: A Wittgensteinian Approach to the Rhetorical Basis of Expertise.Zoltan P. Majdik & William M. Keith - 2011 - Social Epistemology 25 (3):275 - 290.
Networked Expertise in the Era of Many-to-Many Communication: On Wikipedia and Invention.Damien Smith Pfister - 2011 - Social Epistemology 25 (3):217 - 231.
Transmuted Expertise: How Technical Non-Experts Can Assess Experts and Expertise. [REVIEW]Harry Collins & Martin Weinel - 2011 - Argumentation 25 (3):401-413.
Interactional Expertise as a Third Kind of Knowledge.Harry Collins - 2004 - Phenomenology and the Cognitive Sciences 3 (2):125-143.
Expertise as Argument: Authority, Democracy, and Problem-Solving. [REVIEW]Zoltan P. Majdik & William M. Keith - 2011 - Argumentation 25 (3):371-384.
Authenticating Expertise.Jason Borenstein - 2002 - International Journal of Applied Philosophy 16 (1):85-102.
Three Dimensions of Expertise.Harry Collins - 2013 - Phenomenology and the Cognitive Sciences 12 (2):253-273.
The Trouble with Madeleine.Harry Collins - 2004 - Phenomenology and the Cognitive Sciences 3 (2):165-170.
The Possibility of Ethical Expertise.Bruce D. Weinstein - 1994 - Theoretical Medicine and Bioethics 15 (1):1-187.
Euthyphro's Elenchus Experience: Ethical Expertise and Self-Knowledge. [REVIEW]Robert C. Reed - 2013 - Ethical Theory and Moral Practice 16 (2):245-259.
The Development of Human Expertise in a Complex Environment.Michael Harré, Terry Bossomaier & Allan Snyder - 2011 - Minds and Machines 21 (3):449-464.
Philosophical Expertise and the Burden of Proof.Timothy Williamson - 2011 - Metaphilosophy 42 (3):215-229.
The Nature and Nurture of Expertise: A Fourth Dimension. [REVIEW]Gregory J. Feist - 2013 - Phenomenology and the Cognitive Sciences 12 (2):275-288.
On Interactional Expertise: Pragmatic and Ontological Considerations.Evan Selinger & John Mix - 2004 - Phenomenology and the Cognitive Sciences 3 (2):145-163.
Added to index2012-01-18
Total downloads60 ( #83,160 of 2,143,472 )
Recent downloads (6 months)27 ( #11,363 of 2,143,472 )
How can I increase my downloads?
There are no threads in this forum
Nothing in this forum yet.