Abstract
This essay intends to define the role of entropy, in particular, the role of the maximum entropy criterion with respect to decision analysis and information economics. By considering the average opportunity loss interpretation, the basic hypothesis for Shannon's derivation can be derived from properties of decision problems. Using the representation Bayes Boundary it is possible to show that selecting a single probability from a set by the Maximum Entropy Criterion corresponds to a minimax criterion for decision-making. Since problems of randomly accessing and storing information as well as communicating information can often be stated in terms of coding problems, this result might be used to develop strategies for minimizing retrieval time or communication costs.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abramson, N.: 1963, Information Theory and Coding, McGraw-Hill, New York.
Ash, R.: 1967, Information Theory, Interscience-Wiley, New York.
De Groot, M. H.: 1970, Optimal Statistical Decisions, McGraw-Hill, New York.
Gottinger, H. W.: 1980, Elements of Statistical Analysis, de Gruyter: Berlin.
Ho, Y. C., Blau, I., Basar, T. and Hexner, G.: 1974, Notes on Decision and Control III, Div. of Engineering and Applied Physics, Harvard Univ., Techn. Report No. 651, Nov.
Howard, R. A.: 1968, ‘The Foundations of Decision Analysis’, IEEE Transactions on Systems Science and Cybernetics SSC4, 3, Sept.
Howard, R. A.: 1966, ‘Information Value Theory’, IEEE Transactions on Systems Science and Cybernetics SSC2, August.
Huffman, D. A.: 1952, ‘A Method for the Construction of Minimum Redundancy Codes’, Proc. IRE 40 (10), 1098–1101.
Jaynes, E. T.: 1968, ‘Prior Probabilities’, IEEE Transactions on Systems Science and Cybernetics SS4, 3.
MacQueen, J. and Marschak, J.: 1975, ‘Partial Knowledge Entropy and Estimation’, Proc. Nat. Acad. Sci. 12 (10), 3819–3824.
Malueg, D. A.: 1980, ‘An Introduction to Information Structures’, Center for Math. Studies in Economics and Mgt. Sciences, Northwestern Univ., Evanston, III., Disc Paper No. 416, March.
Marschak, J.: 1971, ‘Economics of Information Systems’, J. American Statistical Association 66, 192–216.
Raiffa, H., and Schlaifer, R.: 1961, Applied Statistical Decision Theory, Graduate School of Business, Harvard University.
Savage, L. J.: 1954, The Foundations of Statistics, Wiley, New York.
Shannon, C. E.: 1948, ‘The Mathematical Theory of Communication’, Bell System Technical Journal 27, July and October.
Wald, A.: 1950, Statistical Decision Functions, Wiley and Sons, New York.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Gottinger, H.W. Decision problems under uncertainty based on entropy functionals. Theor Decis 28, 143–172 (1990). https://doi.org/10.1007/BF00160933
Issue Date:
DOI: https://doi.org/10.1007/BF00160933