Topics in Cognitive Science 4 (1):151-163 (2012)

Abstract
We apply a cognitive modeling approach to the problem of measuring expertise on rank ordering problems. In these problems, people must order a set of items in terms of a given criterion (e.g., ordering American holidays through the calendar year). Using a cognitive model of behavior on this problem that allows for individual differences in knowledge, we are able to infer people's expertise directly from the rankings they provide. We show that our model-based measure of expertise outperforms self-report measures, taken both before and after completing the ordering of items, in terms of correlation with the actual accuracy of the answers. These results apply to six general knowledge tasks, like ordering American holidays, and two prediction tasks, involving sporting and television competitions. Based on these results, we discuss the potential and limitations of using cognitive models in assessing expertise
Keywords Wisdom of crowds  Prediction  Ordering problem  Model‐based measurement  Knowledge  Expertise  Ranking problem
Categories (categorize this paper)
DOI 10.1111/j.1756-8765.2011.01175.x
Options
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

PhilArchive copy


Upload a copy of this paper     Check publisher's policy     Papers currently archived: 55,825
Through your library

References found in this work BETA

Add more references

Citations of this work BETA

Can You Read My Mindprint?Lisa S. Pearl & Igii Enverga - 2014 - Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systemsinteraction Studies / Social Behaviour and Communication in Biological and Artificial Systemsinteraction Studies 15 (3):359-387.

Add more citations

Similar books and articles

Interactional Expertise as a Third Kind of Knowledge.Harry Collins - 2004 - Phenomenology and the Cognitive Sciences 3 (2):125-143.
Three Dimensions of Expertise.Harry Collins - 2013 - Phenomenology and the Cognitive Sciences 12 (2):253-273.
The Trouble with Madeleine.Harry Collins - 2004 - Phenomenology and the Cognitive Sciences 3 (2):165-170.
The Possibility of Ethical Expertise.Bruce D. Weinstein - 1994 - Theoretical Medicine and Bioethics 15 (1):1-187.
The Nature and Nurture of Expertise: A Fourth Dimension. [REVIEW]Gregory J. Feist - 2013 - Phenomenology and the Cognitive Sciences 12 (2):275-288.
On Interactional Expertise: Pragmatic and Ontological Considerations.Evan Selinger & John Mix - 2004 - Phenomenology and the Cognitive Sciences 3 (2):145-163.

Analytics

Added to PP index
2012-01-18

Total views
191 ( #48,529 of 2,401,553 )

Recent downloads (6 months)
16 ( #45,045 of 2,401,553 )

How can I increase my downloads?

Downloads

My notes