Graduate studies at Western
|Abstract||Stochastic forecasts in complex environments can beneﬁt from combining the estimates of large groups of forecasters (“judges”). But aggregating multiple opinions faces several challenges. First, human judges are notoriously incoherent when their forecasts involve logically complex events. Second, individual judges may have specialized knowledge, so diﬀerent judges may produce forecasts for diﬀerent events. Third, the credibility of individual judges might vary, and one would like to pay greater attention to more trustworthy forecasts. These considerations limit the value of simple aggregation methods like linear averaging. In this paper, a new algorithm is proposed for combining probabilistic assessments from a large pool of judges. Two measures of a judge’s likely credibility are introduced and used in the algorithm to determine the judge’s weight in aggregation. The algorithm was tested on a data set of nearly half a million probability estimates of events related to the 2008 U.S. presidential election (∼ 16000 judges).|
|Keywords||No keywords specified (fix it)|
No categories specified
(categorize this paper)
|Through your library||Only published papers are available at libraries|
Similar books and articles
Guanchun Wang, Sanjeev Kulkarni & Daniel N. Osherson, Improving Aggregated Forecasts of Probability.
Teddy Seidenfeld (1985). Calibration, Coherence, and Scoring Rules. Philosophy of Science 52 (2):274-294.
Joel Predd, Robert Seiringer, Elliott Lieb, Daniel Osherson, H. Vincent Poor & Sanjeev Kulkarni (2009). Probabilistic Coherence and Proper Scoring Rules. IEEE Transactions on Information Theory 55 (10):4786-4792.
Robert S. Goldfarb, H. O. Stekler & Joel David (2005). Methodological Issues in Forecasting: Insights From the Egregious Business Forecast Errors of Late 1930. Journal of Economic Methodology 12 (4):517-542.
Peter Ayton, Alice Pott & Najat Elwakili (2007). Affective Forecasting: Why Can't People Predict Their Emotions? Thinking and Reasoning 13 (1):62 – 80.
Keith Lehrer (1983). Rationality as Weighted Averaging. Synthese 57 (3):283 - 295.
Added to index2010-12-22
Total downloads10 ( #114,476 of 739,539 )
Recent downloads (6 months)1 ( #61,680 of 739,539 )
How can I increase my downloads?