Theory and Decision 88 (4):541-565 (2020)

Michael Morreau
University of Tromsø
The method of supergrading is introduced for deriving a ranking of items from scores or grades awarded by several people. Individual inputs may come in different languages of grades. Diversity in grading standards is an advantage, enabling rankings derived by this method to separate more items from one another. A framework is introduced for studying grading on the basis of observations. Measures of accuracy, reliability and discrimination are developed within this framework. Ability in grading is characterized for individuals and groups as the capacity to grade reliably, accurately and at a high level of discrimination. It is shown that the collective ability of a supergrading group with diverse standards can be greater than that of a less diverse group whose members have greater ability.
Keywords social choice  diversity beats expertise  scoring and grading  collective intelligence
Categories (categorize this paper)
DOI 10.1007/s11238-019-09738-z
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

Our Archive
External links

Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library

References found in this work BETA

Studies in the Way of Words.D. E. Over - 1990 - Philosophical Quarterly 40 (160):393-395.

Add more references

Citations of this work BETA

No citations found.

Add more citations

Similar books and articles

How Common Standards Can Diminish Collective Intelligence: A Computational Study.Michael Morreau & Aidan Lyon - 2016 - Journal of Evaluation in Clinical Practice 22 (4):483-489.
Nurses' Collective Responsibility and the Strike Weapon.James L. Muyskens - 1982 - Journal of Medicine and Philosophy 7 (1):101-112.
Ethics: An Indispensable Dimension in the University Rankings.Ali Khaki Sedigh - 2017 - Science and Engineering Ethics 23 (1):65-80.
Grading Religions.Noriaki Iwasa - 2011 - Sophia 50 (1):189-209.
Ranking Functions and Rankings on Languages.Franz Huber - 2006 - Artificial Intelligence 170:462-471.
Assessing the Construct Validity of the Global 100 Sustainability Ranking for Schools of Business.Gerald W. McLaughlin & Josetta S. McLaughlin - 2011 - Proceedings of the International Association for Business and Society 22:274-286.


Added to PP index

Total views
35 ( #272,227 of 2,326,762 )

Recent downloads (6 months)
20 ( #31,810 of 2,326,762 )

How can I increase my downloads?


My notes