Abstract
This paper concerns the question of how to draw inferences common sensically from uncertain knowledge. Since the early work of Shore and Johnson (1980), Paris and Vencovská (1990), and Csiszár (1989), it has been known that the Maximum Entropy Inference Process is the only inference process which obeys certain common sense principles of uncertain reasoning. In this paper we consider the present status of this result and argue that within the rather narrow context in which we work this complete and consistent mode of uncertain reasoning is actually characterised by the observance of just a single common sense principle (or slogan).
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
REFERENCES
Csiszár, I.: 1989, 'Why Least Squares and Maximum Entropy? An Axiomatic Approach to Inverse Problems', Mathematics Institute of the Hungarian Academy of Sciences, Preprint No. 19/1989.
Kern-Isberner, G.: forthcoming, 'Characterising the Principle of Minimum Cross-Entropy within a Conditional-Logical Framework', to appear in Artificial Intelligence.
Maung, I. and J. B. Paris: 1990, 'A Note on the Infeasibility of Some Inference Processes', International Journal of Intelligent Systems 5, 595-604.
Paris, J. B.: 1994, The Uncertain Reasoner's Companion — A Mathematical Perspective, Cambridge University Press, Cambridge, UK.
Paris, J. B. and A. Vencovská: 1989, 'Maximum Entropy and Inductive Inference', in J. Skilling (ed.), Maximum Entropy and Bayesian Methods, Kluwer Academic Publishers, pp. 397-403.
Paris, J. B. and A. Vencovská: 1990, 'A Note on the Inevitability of Maximum Entropy', International Journal of Approximate Reasoning 4, 183-224.
Paris, J. B. and A. Vencovská: 1996a, 'Principles of Uncertain Reasoning', in A. Clark et al. (eds.), Philosophy and Cognitive Science, Kluwer Academic Press, pp. 221-59.
Paris, J. B. and A. Vencovská: 1996b, 'Some Observations on the Maximum Entropy Inference Process', Technical Report L1-96, Department of Mathematics, Manchester University, UK.
Paris, J. B. and A. Vencovská: 1997, 'In Defence of the Maximum Entropy Inference Process', International Journal of Approximate Reasoning 17, 77-103.
Shore, J. E. and R. W. Johnson: 1980, 'Axiomatic Derivation of the Principle of Maximum Entropy and the Principle of Minimum Cross-Entropy', IEEE Transactions on Information Theory IT-26(1), 26-37.
Van Fraasssen, Bas.: 1989, Laws and Symmetry, Clarendon Press, Oxford, UK.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Paris, J. Common Sense and Maximum Entropy. Synthese 117, 75–93 (1998). https://doi.org/10.1023/A:1005081609010
Issue Date:
DOI: https://doi.org/10.1023/A:1005081609010