Inferring Expertise in Knowledge and Prediction Ranking Tasks

Topics in Cognitive Science 4 (1):151-163 (2012)
We apply a cognitive modeling approach to the problem of measuring expertise on rank ordering problems. In these problems, people must order a set of items in terms of a given criterion (e.g., ordering American holidays through the calendar year). Using a cognitive model of behavior on this problem that allows for individual differences in knowledge, we are able to infer people's expertise directly from the rankings they provide. We show that our model-based measure of expertise outperforms self-report measures, taken both before and after completing the ordering of items, in terms of correlation with the actual accuracy of the answers. These results apply to six general knowledge tasks, like ordering American holidays, and two prediction tasks, involving sporting and television competitions. Based on these results, we discuss the potential and limitations of using cognitive models in assessing expertise
Keywords Wisdom of crowds  Prediction  Ordering problem  Model‐based measurement  Knowledge  Expertise  Ranking problem
Categories (categorize this paper)
DOI 10.1111/j.1756-8765.2011.01175.x
 Save to my reading list
Follow the author(s)
My bibliography
Export citation
Find it on Scholar
Edit this record
Mark as duplicate
Revision history Request removal from index
Download options
PhilPapers Archive

Upload a copy of this paper     Check publisher's policy on self-archival     Papers currently archived: 16,667
External links
Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library
References found in this work BETA

Add more references

Citations of this work BETA

No citations found.

Add more citations

Similar books and articles
Harry Collins (2004). Interactional Expertise as a Third Kind of Knowledge. Phenomenology and the Cognitive Sciences 3 (2):125-143.
Jason Borenstein (2002). Authenticating Expertise. International Journal of Applied Philosophy 16 (1):85-102.
Harry Collins (2013). Three Dimensions of Expertise. Phenomenology and the Cognitive Sciences 12 (2):253-273.
Harry Collins (2004). The Trouble with Madeleine. Phenomenology and the Cognitive Sciences 3 (2):165-170.
Bruce D. Weinstein (1994). The Possibility of Ethical Expertise. Theoretical Medicine and Bioethics 15 (1):1-187.

Monthly downloads

Added to index


Total downloads

15 ( #175,574 of 1,726,249 )

Recent downloads (6 months)

2 ( #289,836 of 1,726,249 )

How can I increase my downloads?

My notes
Sign in to use this feature

Start a new thread
There  are no threads in this forum
Nothing in this forum yet.