Inferring Expertise in Knowledge and Prediction Ranking Tasks

Topics in Cognitive Science 4 (1):151-163 (2012)
Abstract
We apply a cognitive modeling approach to the problem of measuring expertise on rank ordering problems. In these problems, people must order a set of items in terms of a given criterion (e.g., ordering American holidays through the calendar year). Using a cognitive model of behavior on this problem that allows for individual differences in knowledge, we are able to infer people's expertise directly from the rankings they provide. We show that our model-based measure of expertise outperforms self-report measures, taken both before and after completing the ordering of items, in terms of correlation with the actual accuracy of the answers. These results apply to six general knowledge tasks, like ordering American holidays, and two prediction tasks, involving sporting and television competitions. Based on these results, we discuss the potential and limitations of using cognitive models in assessing expertise
Keywords Wisdom of crowds  Prediction  Ordering problem  Model‐based measurement  Knowledge  Expertise  Ranking problem
Categories (categorize this paper)
Options
 Save to my reading list
Follow the author(s)
My bibliography
Export citation
Find it on Scholar
Edit this record
Mark as duplicate
Revision history Request removal from index
 
Download options
PhilPapers Archive


Upload a copy of this paper     Check publisher's policy on self-archival     Papers currently archived: 11,825
External links
Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library
References found in this work BETA
Citations of this work BETA

No citations found.

Similar books and articles
Harry Collins (2004). Interactional Expertise as a Third Kind of Knowledge. Phenomenology and the Cognitive Sciences 3 (2):125-143.
Jason Borenstein (2002). Authenticating Expertise. International Journal of Applied Philosophy 16 (1):85-102.
Harry Collins (2013). Three Dimensions of Expertise. Phenomenology and the Cognitive Sciences 12 (2):253-273.
Harry Collins (2004). The Trouble with Madeleine. Phenomenology and the Cognitive Sciences 3 (2):165-170.
Bruce D. Weinstein (1994). The Possibility of Ethical Expertise. Theoretical Medicine and Bioethics 15 (1).
Analytics

Monthly downloads

Added to index

2012-01-18

Total downloads

9 ( #163,591 of 1,100,083 )

Recent downloads (6 months)

6 ( #51,435 of 1,100,083 )

How can I increase my downloads?

My notes
Sign in to use this feature


Discussion
Start a new thread
Order:
There  are no threads in this forum
Nothing in this forum yet.