Abstract
Expected utility maximization problem is one of the most useful tools in mathematical finance, decision analysis and economics. Motivated by statistical model selection, via the principle of expected utility maximization, Friedman and Sandow (J Mach Learn Res 4:257–291, 2003a) considered the model performance question from the point of view of an investor who evaluates models based on the performance of the optimal strategies that the models suggest. They interpreted their performance measures in information theoretic terms and provided new generalizations of Shannon entropy and Kullback–Leibler relative entropy and called them U-entropy and U-relative entropy. In this article, a utility-based criterion for independence of two random variables is defined. Then, Markov’s inequality for probabilities is extended from the U-entropy viewpoint. Moreover, a lower bound for the U-relative entropy is obtained. Finally, a link between conditional U-entropy and conditional Renyi entropy is derived.
Similar content being viewed by others
References
Abbas, A. (2003). Entropy methods in decision analysis. Ph.D. Thesis, Department of Management Science and Engineering, Stanford University.
Abdellaoui M. (2002) A genuine rank-dependent generalization of the von Neumann–Morgenstern expected utility theorem. Econometrica 70: 717–736
Aczel J., Daroczy Z. (1975) On measures of information and their characterization. Academic Press, New York
Akaike H. (1973) Information theory and an extension of the maximum likelihood principle. In: Petrov B.N., Csaki F. (eds) Second international symposium on information theory. Budapest, Akademiai Kiado, pp 267–281
Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, AC-19, 716–723.
Amendinger J., Imkeller P., Schweizer M. (1998) Additional logarithmic utility of an insider. Stochastic Processes and Their Applications 75: 263–286
Arimitsu T., Arimitsu N. (2000) Tsallis statistics and fully developed turbulence. Journal of Physics A: Mathematical and General 33(27): L235–L241
Arimitsu T., Arimitsu N. (2001) Analysis of turbulence by statistics based on generalized entropies. Physica A 295: 177–194
Burnham K., Anderson D. (2002) Model selection and multimodel inference (2nd ed.). Springer, New York
Cachin, C. (1997). Entropy measures and unconditional security in cryptography. Ph.D. Thesis, Swiss Federal Institute of Technology, Zurich.
Campbell L. L. (1965) A coding theorem and Renyis entropy. Information and Control 8: 423–429
Cressie N., Read T. (1984) Multinomial goodness of fit tests. Journal of the Royal Statistical Society Series B 46(3): 440–464
Debreu G. (1960) Topological methods in cardinal utility theory. In: Arrow K.J., Karlin S., Suppes P. (eds) Mathematical methods in the social sciences. Stanford University Press, Stanford CA, pp 16–26
Dragomir S. S. (2003) On the p-Logarithmic and α-Power divergence measures in information theory. Panamerican Mathematics Journal 13(3): 1–10
Fishburn P. C. (1989) Non-transitive measurable utility for decision under uncertainty. Journal of Mathematical Economics 18: 187–207
Friedman C., Sandow S. (2003a) Learning probabilistic models: An expected utility maximization approach. Journal of Machine Learning Research 4: 257–291
Friedman C., Sandow S. (2003b) Model performance measures for expected utility maximizing investors. International Journal of Theoretical and Applied Finance 6(4): 355
Friedman C., Huang J., Sandow S. (2004) Model performance measures for leveraged investors. International Journal of Theoretical and Applied Finance 7(5): 541
Frittelli M., Biagni S. (2005) Utility maximization in incomplete markets for unbounded processes. Finance and Stochastics 9: 493–517
Friedman C., Huang J., Sandow S. (2007) A utility-based approach to some information measures. Entropy 9: 1–26
Gundel A. (2005) Robust utility maximization for complete and incomplete market models. Finance and Stochastics 9: 151–176
Herstein I. N., Milnor J. (1953) An axiomatic approach to measurable utility. Econometrica 21: 291–297
Hoseinzadeh A. R., Mohtashami Borzadaran G. R., Yari G. H. (2009) A view on extension of utility-based on links with information measures. Communications of the Korean Statistical Society 16(5): 1–8
Ingersoll J. (1987) Theory of financial decision making. Rowman and Littlefield, New York
Kullback S., Leibler R. A. (1951) On information and sufficiency. Annals of Mathematical Statistics 22: 79–86
Lavenda B. H. (1998) The analogy between coding theory and multifractals. Journal of Physics A: Mathematical and General 31: 5651–5660
Liese F., Vajda I. (1987) Convex statistical distances. Teubner, Leipzig
Morningstar. (2002). The new morningstar ratingTM methodology. http://www.morningstar.dk/downloads/MRARdefined.pdf.
Nakamura Y. (1995) Rank dependent utility for arbitrary consequence spaces. Mathematical Social Science 29: 103–129
Pikovsky I., Karatzas I. (1996) Anticipative portfolio optimization. Advances in Applied Probability 28: 1095–1122
Shannon C. E. (1948) A mathematical theory of communication. Bell System Technical Journal 27: 379–423
Taneja I. J., Kumar P. (2004) Relative information of type s, Csiszar’s f-divergence, and information inequalities. Information Sciences 166: 105–125
Ullah A. (1996) Entropy, divergence and distance measures with econometric applications. Journal of the Statistical Planning and Inference 49: 137–162
Verdu S. (1998) Fifty Years of Shannon Theory. IEEE Transactions on Information Theory, Special Commemorative Issue 44(6): 2057–2078
Von-Neumann, J., & Morgenstern, O. (1944). Theory of games and economic behavior (2nd ed., 1947; 3rd ed., 1953). Princeton, NJ: Princeton University Press
Author information
Authors and Affiliations
Corresponding author
Additional information
G. R. Mohtashami Borzadaran is a member of Ordered and Spatial Data Center of Excellence of Ferdowsi University of Mashhad, Iran.
Rights and permissions
About this article
Cite this article
Hoseinzadeh, A.R., Mohtashami Borzadaran, G.R. & Yari, G.H. Aspects concerning entropy and utility. Theory Decis 72, 273–285 (2012). https://doi.org/10.1007/s11238-010-9232-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11238-010-9232-5