Inferring Expertise in Knowledge and Prediction Ranking Tasks

Topics in Cognitive Science 4 (1):151-163 (2012)
Abstract
We apply a cognitive modeling approach to the problem of measuring expertise on rank ordering problems. In these problems, people must order a set of items in terms of a given criterion (e.g., ordering American holidays through the calendar year). Using a cognitive model of behavior on this problem that allows for individual differences in knowledge, we are able to infer people's expertise directly from the rankings they provide. We show that our model-based measure of expertise outperforms self-report measures, taken both before and after completing the ordering of items, in terms of correlation with the actual accuracy of the answers. These results apply to six general knowledge tasks, like ordering American holidays, and two prediction tasks, involving sporting and television competitions. Based on these results, we discuss the potential and limitations of using cognitive models in assessing expertise
Keywords Wisdom of crowds  Prediction  Ordering problem  Model‐based measurement  Knowledge  Expertise  Ranking problem
Categories (categorize this paper)
DOI 10.1111/j.1756-8765.2011.01175.x
Options
 Save to my reading list
Follow the author(s)
My bibliography
Export citation
Find it on Scholar
Edit this record
Mark as duplicate
Revision history
Request removal from index
Download options
Our Archive


Upload a copy of this paper     Check publisher's policy     Papers currently archived: 25,645
Through your library
References found in this work BETA

Add more references

Citations of this work BETA

No citations found.

Add more citations

Similar books and articles
Interactional Expertise as a Third Kind of Knowledge.Harry Collins - 2004 - Phenomenology and the Cognitive Sciences 3 (2):125-143.
Authenticating Expertise.Jason Borenstein - 2002 - International Journal of Applied Philosophy 16 (1):85-102.
Three Dimensions of Expertise.Harry Collins - 2013 - Phenomenology and the Cognitive Sciences 12 (2):253-273.
The Trouble with Madeleine.Harry Collins - 2004 - Phenomenology and the Cognitive Sciences 3 (2):165-170.
The Possibility of Ethical Expertise.Bruce D. Weinstein - 1994 - Theoretical Medicine and Bioethics 15 (1):1-187.
The Nature and Nurture of Expertise: A Fourth Dimension. [REVIEW]Gregory J. Feist - 2013 - Phenomenology and the Cognitive Sciences 12 (2):275-288.
On Interactional Expertise: Pragmatic and Ontological Considerations.Evan Selinger & John Mix - 2004 - Phenomenology and the Cognitive Sciences 3 (2):145-163.

Monthly downloads

Added to index

2012-01-18

Total downloads

60 ( #83,160 of 2,143,472 )

Recent downloads (6 months)

27 ( #11,363 of 2,143,472 )

How can I increase my downloads?

My notes
Sign in to use this feature


Discussion
Order:
There  are no threads in this forum
Nothing in this forum yet.

Other forums