Jury Theorems for Peer Review

British Journal for the Philosophy of Science (forthcoming)
  Copy   BIBTEX

Abstract

Peer review is often taken to be the main form of quality control on academic research. Usually journals carry this out. However, parts of maths and physics appear to have a parallel, crowd-sourced model of peer review, where papers are posted on the arXiv to be publicly discussed. In this paper we argue that crowd-sourced peer review is likely to do better than journal-solicited peer review at sorting papers by quality. Our argument rests on two key claims. First, crowd-sourced peer review will lead on average to more reviewers per paper than journal-solicited peer review. Second, due to the wisdom of the crowds, more reviewers will tend to make better judgments than fewer. We make the second claim precise by looking at the Condorcet Jury Theorem as well as two related jury theorems developed specifically to apply to peer review.

Similar books and articles

The Principles and Practices of Peer Review.Ronald N. Kostoff - 1997 - Science and Engineering Ethics 3 (1):19-34.
Commensuration Bias in Peer Review.Carole J. Lee - 2015 - Philosophy of Science 82 (5):1272-1283,.
Peer Review: A Critical Inquiry.David Shatz - 2004 - Rowman & Littlefield Publishers.
A Method for Improving the Integrity of Peer Review.Mehdi Dadkhah, Mohsen Kahani & Glenn Borchardt - 2018 - Science and Engineering Ethics 24 (5):1603-1610.
Is Peer Review a Good Idea?Remco Heesen & Liam Kofi Bright - 2021 - British Journal for the Philosophy of Science 72 (3):635-663.
The Problem of Humiliation in Peer Review.Debra R. Comer & Michael Schwartz - 2014 - Ethics and Education 9 (2):141-156.
Advances in Peer Review Research: An Introduction.Arthur E. Stamps Iii - 1997 - Science and Engineering Ethics 3 (1):3-10.

Analytics

Added to PP
2019-05-06

Downloads
130 (#94,900)

6 months
47 (#21,309)

Historical graph of downloads
How can I increase my downloads?

Author Profiles

Liam Kofi Bright
London School of Economics
Remco Heesen
London School of Economics
Marcus Arvan
University of Tampa

Citations of this work

No citations found.

Add more citations

References found in this work

Epistemology of Disagreement: The Good News.David Christensen - 2007 - Philosophical Review 116 (2):187-217.
Reflection and Disagreement.Adam Elga - 2007 - Noûs 41 (3):478–502.
Is Peer Review a Good Idea?Remco Heesen & Liam Kofi Bright - 2021 - British Journal for the Philosophy of Science 72 (3):635-663.

View all 32 references / Add more references