Abstract
In his discussion of minimax decision rules, Savage (The foundations of statistics, Dover Publications Inc., Mineola 1954, p. 170) presents an example purporting to show that minimax applied to negative expected utility (referred to by Savage as “negative income”) is an inadequate decision criterion for statistics; he suggests the application of a minimax regret rule instead. The crux of Savage’s objection is the possibility that a decision maker would choose to ignore even “extensive” information. More recently, Parmigiani (Theor Decis 33:241–252, 1992) has suggested that minimax regret suffers from the same flaw. He demonstrates the existence of “relevant” experiments that a minimax regret agent would never pay a positive cost to observe. On closer inspection, I find that minimax regret is more resilient to this critique than would first appear. In particular, there are cases in which no experiment has any value to an agent employing the minimax negative income rule, while we may always devise a hypothetical experiment for which a minimax regret agent would pay. The force of Parmigiani’s critique is further blunted by the observation that “relevant” experiments exist for which a Bayesian agent would never pay. I conclude with a discussion of pessimism in the context of minimax decision rules.
Similar content being viewed by others
Notes
Consistency in this context means that the estimator will converge in probability to the true parameter value. A pair comprised of a prior distribution on the parameter space, and a true value of the parameter, is consistent if that particular prior will converge in probability to that particular parameter value as the amount of available data increases. Freedman (1965) gives an example with countably many parameters where the set of consistent prior-parameter pairs is of category 1. More generally, as a consequence of well-known results in measure theory (see Parasarathy 1967, p. 29) and topology (see Schaefer 1966, p. 23), all measures on complete, separable metric spaces are tight, and hence put probability one on a countable union of compact sets. Moreover, all locally compact Hausdorff topological vector spaces are finite dimensional. This implies that all measures on an infinite-dimensional Hausdorff topological vector space assign probability one to a category 1 (“meagre”) set. Therefore, with infinitely many parameters, a Bayesian estimator is inconsistent outside an insignificant portion of the parameter space.
References
Freedman, D. (1965). On the asymptotic behavior of Bayes estimates in the discrete case II. The Annals of Mathematical Statistics, 36(2), 454–456.
Hodges, J., & Lehmann, E. (1950). Some problems in minimax point estimation. Annals of Mathematical Statistics, 21, 182–197.
Manski, C. (2004). Statistical treatment rules for heterogeneous populations. Econometrica, 72, 1221–1246.
Manski, C. (2007). Minimax-regret treatment choice with missing outcome data. Journal of Econometrics, 139, 105–115.
Parasarathy, K. (1967). Probability measures on metric spaces. New York: Academic Press.
Parmigiani, G. (1992). Minimax, information, and ultrapessimism. Theory and Decision, 33, 241–252.
Radner, R., & Marschak, J. (1954). Note on some proposed decision criteria. In R. Thrall, C. Coombs, & R. Davis (Eds.), Decision processes (pp. 61–69). New York: Wiley.
Savage, L. (1954). The foundations of statistics (2nd ed.) Mineola: Dover Publications Inc. (2nd ed. published 1972).
Schaefer, H. (1966). Topological vector spaces. New York: MacMillan.
Stoye, J. (2009). Minimax regret treatment choice with finite samples. Journal of Econometrics, 151, 70–81.
Stoye, J. (2011). Statistical decisions under ambiguity. Theory and Decision, 70, 129–148.
Stoye, J. (2012). Minimax regret treatment choice with covariates or with limited validity of experiments. Journal of Econometrics, 166, 138–156.
Wald, A. (1950). Statistical decision functions. New York: Wiley.
Acknowledgments
I am grateful to Roy Radner for calling my attention to this problem as well as for numerous fruitful discussions. I also thank Jörg Stoye for pointing me to useful references and providing comments on an earlier version. Any errors are mine alone.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sadler, E. Minimax and the value of information. Theory Decis 78, 575–586 (2015). https://doi.org/10.1007/s11238-014-9442-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11238-014-9442-3