The Group Calibration Index: a group-based approach for assessing forecasters' expertise when external outcome data are missing
Theory and Decision (forthcoming)
| Abstract | The Group Calibration Index (GCI) provides a means of assessing the quality of forecasters’ predictions in situations that lack external feedback or outcome data. The GCI replaces the missing outcome data with aggregated ratings of a well-defined reference group. A simulation study and two experiments show how the GCI classifies forecaster performance and distinguishes between forecasters with restricted information and those with complete information. The results also show that under certain circumstances, where members of the reference group have high-quality information, the new GCI will outperform expert classification that is based on traditional calibration indices. | |||||||||
| Keywords | No keywords specified (fix it) | |||||||||
| Categories | No categories specified (fix it) | |||||||||
| Options |
|
|||||||||
Download options| PhilPapers Archive |
Upload a copy of this paper Check publisher's policy on self-archival Papers currently archived: 5,672 |
| External links |
 |
| Through your library | Configure |
Similar books and articlesRaimo Tuomela (1992). Group Beliefs. Synthese 91 (3):285-318.
George R. Young II, Kenneth H. Price & Cynthia Claybrook (2001). Small Group Predictions on an Uncertain Outcome: The Effect of Nondiagnostic Information. Theory and Decision 50 (2):149-167.
Alex de Waal (1997). Group Identity, Rationality, and the State. Critical Review 11 (2):279-289.
Loren Cannon (2011). Moral Taint. Philosophy in the Contemporary World 18 (1):19-30.
Christopher Woodard (2003). Group-Based Reasons for Action. Ethical Theory and Moral Practice 6 (2):215-229.
Geoff Rayner-Canham (forthcoming). Periodic Patterns: The Group (N) and Group (N + 10) Linkage. Foundations of Chemistry.
Sheron Fraser-Burgess (2011). Group Identity, Deliberative Democracy and Diversity in Education. Educational Philosophy and Theory 44 (5):480-499.
David Killoren & Bekka Williams (2013). Group Agency and Overdetermination. Ethical Theory and Moral Practice 16 (2):295-307.
Teddy Seidenfeld (1985). Calibration, Coherence, and Scoring Rules. Philosophy of Science 52 (2):274-294.
Samir Okasha & Cedric Paternotte (2012). Group Adaptation, Formal Darwinism and Contextual Analysis. Journal of Evolutionary Biology 25 (6):1127–1139.
Samir Okasha (2003). The Concept of Group Heritability. Biology and Philosophy 18 (3).
Analytics
Monthly downloads |
Added to index2011-08-18Total downloads2 ( #232,382 of 549,065 )Recent downloads (6 months)0How can I increase my downloads? |
My notes
Discussion
