Skip to main content
Log in

The psychology of dynamic probability judgment: order effect, normative theories, and experimental methodology

  • Symposium Article
  • Published:
Mind & Society Aims and scope Submit manuscript

Abstract

The Bayesian model is used in psychology as the reference for the study of dynamic probability judgment. The main limit induced by this model is that it confines the study of revision of degrees of belief to the sole situations of revision in which the universe is static (revising situations). However, it may happen that individuals have to revise their degrees of belief when the message they learn specifies a change of direction in the universe, which is considered as changing with time (updating situations). We analyze the main results of the experimental literature with regard to elementary qualitative properties of these two situations of revision. First, the order effect phenomenon is confronted with the commutative property. Second, an apparent new phenomenon is presented: the redundancy effect that is confronted with the idempotence property. Finally, results obtained in this kind of experimental situations are reinterpreted in the light of pragmatic analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. However, a lot of other rules than Bayes’ rule are possible in the situation of revising. These rules are justified by cognitive rationality principles (see Wallizer and Zwirn 2002).

  2. The property of idempotence corresponds to the situation where a message D is repeated at times t and t + 1. Contrary to Bayes' rule, Lewis' rule does not respect a property which is akin to idempotence, and occurs in a situation where the individual receives a message D at time t, then an updating message E at time t + 1 which causes a change in the universe, and finally again the message D. In such a case, applying Lewis' rule has the consequence that the repetition of D may entail a change in belief.

References

  • Adelman L, Bresnick TA (1992) Examining the effect of information sequence on patriot air defense officers’ judgments. Organ Behav Hum Dec 53:204–228

    Article  Google Scholar 

  • Adelman L, Bresnick TA, Black PK, Marvin FF, Sak SG (1996) Research with patriot air defense officers: examining information order effects. Hum Factors 38:250–261

    Article  Google Scholar 

  • Adelman L, Tolcott MA, Bresnick TA (1993) Examining the effect of information order on expert judgment. Organ Behav Hum Dec 56:348–369

    Article  Google Scholar 

  • Anderson NH (1968) Application of a linear-serial model to a personality-impression task using serial presentation. J Pers Soc Psychol 64:1–8

    Google Scholar 

  • Adler JE (1991) An optimist’s pessimism conversation and conjunction. In: Eells E, Maruszewski T (eds) Probability and rationality: studies on L. Jonathan Cohen’s philosophy of science. Rodopi, Amsterdam, Atlanta, GA, pp 251–282

    Google Scholar 

  • Baratgin J (1999) Psychologie du raisonnement probabiliste dynamique. Recherches historiques, pragmatiques et expérimentales sur la règle de Bayes. [The psychology of dynamic probabilistic reasoning. Historical, pragmatic, and experimental research on Bayes’ rule]. Unpublished doctorate dissertation. Ecole Polytechnique, France

    Google Scholar 

  • Baratgin J (2002) Is the human mind definitely not Bayesian? A review of the various arguments. Cah Psychol Cogn 21:653–680

    Google Scholar 

  • Baratgin J, Politzer G (2006) Is the mind Bayesian? The case for agnosticism. Mind Soc 21:653–680

    Google Scholar 

  • Bar-Hillel M, Falk R (1982) Some teasers concerning conditional probabilities. Cognition 11:109–122

    Article  Google Scholar 

  • Baumann M, Krems JF (2002) Frequency learning and order effects in belief updating. In: Sedlmeier P, Betsch T (eds) Frequency processing and cognition. Oxford University Press, Oxford

    Google Scholar 

  • Birbaum MH, Mellers BA (1983) Bayesian inference: combining base rates with opinions of sources who vary in credibility. J Pers Soc Psychol 45:792–803

    Article  Google Scholar 

  • Curley SP, Golden JI (1994) Using belief functions to represent degree of belief. Organ Behav Hum Dec 58:271–303

    Article  Google Scholar 

  • de Finetti B (1964) Foresight: its logical laws, its subjective sources. In: Kyburg HE Jr, Smokler HE (eds) Studies in subjective probability. Wiley, New York, pp 53–118 (1st edn, 1937)

    Google Scholar 

  • Dubois D, Prade H (1988) Modelling uncertainty and inductive inference: a survey of recent non-additive probability systems. Acta Psychol 68:53–78

    Article  Google Scholar 

  • Dubois D, Prade H (1992) Evidence, knowledge, and belief Function. Int J Approx Reason 6:295–319

    Article  Google Scholar 

  • Falk R (1992) A closer look at the probabilities of the notorious three prisoners. Cognition 43:197–223

    Article  Google Scholar 

  • Funder DC (1987) Errors and mistakes: evaluating the accuracy of social judgment. Psychol Bull 101:75–90

    Article  Google Scholar 

  • Gardner M (1959a) Mathematical games: how three mathematicians disproved a celebrated conjecture of Leonard Euler. Sci Am 201(5):181–188

    Google Scholar 

  • Gardner M (1959b) Mathematical games: problems involving questions of probability and ambiguity. Sci Am 201(4):174–182

    Google Scholar 

  • Gärdenfors P (1988) Knowledge in flux, modeling the dynamics of epistemic states. The MIT Press, Cambridge, MA

    Google Scholar 

  • Hacking I (1975) The emergence of probability: a philosophy study of early ideas about probability, induction, and statistical inference. Cambridge University Press, Cambridge

    Google Scholar 

  • Hammond KR, McClelland GH, Mumpower J (1980) Human judgment and decision making. Theories, methods, and procedures. Hemisphere Publishing Corporation/Praeger, New York

    Google Scholar 

  • Hilton DJ (1995) The social context of reasoning: Conversational inference and rational judgment. Psychol Bull 118:248–271

    Article  Google Scholar 

  • Hinsz VB, Tindale RS, Nagao DH, Davis JH, Robertson BA (1988) The influence of the accuracy of individuating information on the use of base rate information in probability judgment. J Exp Soc Psychol 24:127–145

    Article  Google Scholar 

  • Hoffrage U, Gigerenzer G, Krauss S, Martignon L (2002) Representation facilitates reasoning: what natural frequencies are and what they are not. Cognition 84:343–352

    Article  Google Scholar 

  • Hogarth RM (1975) Cognitive processes and the assessment of subjective probability distributions. J Am Stat Assoc 70:271–289

    Article  Google Scholar 

  • Hogarth RM, Einhorn HJ (1992) Order effects in belief updating: the belief-adjustment model. Cognitive Psychol 24:1–55

    Article  Google Scholar 

  • Jeffrey R (1988) Conditioning, kinematics and exchangeability. In: Skyrms B, Harper W (eds) Causation, chance and credence, vol I. D. Reidel Publishing Company, Dordrecht, pp 221–255

  • Kahneman D, Tversky A (1973) On the psychology of prediction. Psychol Rev 80:237–251

    Article  Google Scholar 

  • Katsuno H, Mendelzon AO (1992) On the difference between updating a knowledge base and revising it. In: Gärdenfors P (ed) Belief revision. Cambridge University Press, Cambridge, pp 183–203

    Google Scholar 

  • Klar Y (1990) Linking structures and sensitivity to judgment-relevant information in statistical and logical reasoning tasks. J Pers Soc Psychol 59:841–858

    Article  Google Scholar 

  • Koehler JJ (1996) The base rate fallacy reconsidered: descriptive, normative and methodological challenges. Behav Brain Sci 19:1–53

    Article  Google Scholar 

  • Krauss S, Wang XT (2003) The psychology of the Monty Hall problem: discovering psychological mechanisms for solving a tenacious brain teaser. J Exp Psychol Gen 132:3–22

    Article  Google Scholar 

  • Krosnick JA, Li F, Lehman DR (1990) Conversational conventions, order of information acquisition, and the effect of base rates and individuating information on social judgments. J Pers Soc Psychol 39:1140–1152

    Google Scholar 

  • Kruglanski AW, Ajzen I (1983) Bias and error in human judgment. Eur J Soc Psychol 13:1–44

    Article  Google Scholar 

  • Lewis D (1976) Probabilities of conditionals and conditional probabilities. Philos Rev 3:297–315

    Article  Google Scholar 

  • Lynch JG, Ofir C (1989) Effects of cue consistency and value on base-rate utilisation. J Pers Soc Psychol 56:170–181

    Article  Google Scholar 

  • Marks DF, Clarkson KR (1972) An explanation of conservatism in the bookbag-and-pokerchip situation. Acta Psychol 36:145–160

    Article  Google Scholar 

  • Mosteller F (1965) Fifty challenging problems in probability with solutions. Addison Wesley, New York

    Google Scholar 

  • Nathan A (1984) Discussion: how not to solve it. Philos Sci 53:114–119

    Article  Google Scholar 

  • Nickerson RS (1996) Ambiguities and unstated assumptions in probabilistic reasoning. Psychol Bull 120(3):410–433

    Article  Google Scholar 

  • Ofir C (1988) Pseudodiagnosticity in judgment under uncertainty. Organ Behav Hum Perf 42:343–363

    Article  Google Scholar 

  • Pearl J (2000) Causality: models, reasoning, and inference. Cambridge University Press, Cambridge

    Google Scholar 

  • Politzer G (1991) L’informativité des énoncés: contraintes sur le jugement et le raisonnement. [The informativeness of statements: Constraints on judgment and reasoning]. Intellectica 11:11–147

    Google Scholar 

  • Politzer G, Macchi L (2000) Reasoning and pragmatics. Mind Soc 1(1):73–94

    Article  Google Scholar 

  • Ramsey FP (1926) Truth and probability. Later in Braithwaite RB (ed) (1931) The foundations of mathematics and other logical essays. Routledge and Kegan Paul, London, pp 156–198

  • Robinson LB, Hastie R (1985) Revision of beliefs when a hypothesis is eliminated from consideration. J Exp Psychol Hum 11:443–456

    Article  Google Scholar 

  • Ruble DN, Feldman NS (1976) Order of consensus, distinctiveness, and consistency information, and causal attribution. J Pers Soc Psychol 34:930–937

    Article  Google Scholar 

  • Schlottmann A, Anderson NH (1995) Belief revision in children: serial judgment in social and decision-making domains. J Exp Psychol Learn 21:1349–1364

    Article  Google Scholar 

  • Schum DA, Martin AW (1982) Formal and empirical research on cascaded inference in jurisprudence. Law Soc Rev 17:105–151

    Article  Google Scholar 

  • Shafer G (1976) A mathematical theory of evidence. Princeton University Press, Princeton, NJ

    Google Scholar 

  • Shafer G (1985) Conditional probability. Int Stat Rev 53:261–277

    Article  Google Scholar 

  • Shimojo S, Ichikawa I (1989) Intuitive reasoning about probability: theoretical and experimental analyses of the “problem of three prisoners”. Cognition 43:197–223

    Google Scholar 

  • Slovic P (1966) Cue consistency and cue utilization in judgment. Am J Psychol 79:427–434

    Article  Google Scholar 

  • Sperber D, Wilson D (1995) Relevance: communication and cognition. Blackwell, Oxford (1st edn, 1986)

    Google Scholar 

  • Teigen KH (1983) Studies in subjective probability. III. The unimportance of alternatives. Scand J Psychol 24:97–105

    Google Scholar 

  • Tubbs RM, Gaeth GJ, Levin IP, Van Osdol LA (1993) Order effect in belief updating with consistent and inconsistent evidence. J Behav Dec Making 6:257–269

    Google Scholar 

  • Walley P (1991) Statistical reasoning with imprecise probabilities. Chapman and Hall, London

    Google Scholar 

  • Walliser B, Zwirn D (2002) Can Bayes’ rule be justified by cognitive rationality principles. Theor Dec 53:95–135

    Article  Google Scholar 

  • Wang H, Zhang J, Johnson TR (2000) Order effects in human belief revision. In: Proceedings of the 22nd annual conference of the cognitive science society. Lawrence Erlbaum Associates, Hillsdale, NJ, pp 547–552

  • Van Wallendael LR (1989) The quest for limits on noncomplementarity in opinion revision. Organ Behav Hum Dec 43:385–405

    Article  Google Scholar 

  • Van Wallendael LR, Hastie R (1990) Tracing the footsteps of Sherlock Holmes: cognitive representations of hypothesis testing. Mem Cogn 18:240–250

    Google Scholar 

  • Wolfe CR (1995) Information seeking on Bayesian conditional probability problems: a fuzzy-trace theory account. J Behav Dec Making 8:85–108

    Google Scholar 

  • Zhang J, Johnson TR, Wang H (1998) The relation between order effects and frequency learning in tactical decision-making. Thinking Reason 4:123–145

    Article  Google Scholar 

Download references

Acknowledgments

The authors thank Laura Macchi for her comments on a first draft of this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jean Baratgin.

Appendices

Appendix 1. The “Bayesian solution” is the solution computed using Bayes’ rule

Let the prior probabilities be P(freed A), P(freed B) and P(freed C); they are equal to 1/3 (“all three equally likely”). The likelihoods are: P(“executed B”|freed A) = 1/2 because if A is freed, the warder can indicate that either B or C will be executed and we are supposing that the warder has no preference between B and C; P(“executed B”|freed B) = 0 because if B is freed, the warder cannot indicate B executed) and: P(“executed B”|freed C) = 1 because if C is freed, the warder can only indicate B executed).

Bayes’ rule gives:

$$\begin{aligned}{} & P{\left( {{}_{{{\text{freed}}}}A|``{}_{{{\text{executed}}}}B\hbox{''}} \right)} \\ & \quad = \frac{{P({}_{{{\text{freed}}}}A) \times P(``{}_{{{\text{executed}}}}B\hbox{''}|{}_{{{\text{freed}}}}A)}}{{P({}_{{{\text{freed}}}}A) \times P(``{}_{{{\text{executed}}}}B\hbox{''}|{}_{{{\text{freed}}}}A) + P(_{{{\text{freed}}}} B) \times P(``{}_{{{\text{sex}}\,{\text{executed}}}}B\hbox{''}|{}_{{{\text{freed}}}}B) + P({}_{{{\text{freed}}}}C) \times P(``{}_{{{\text{executed}}}}B\hbox{''}|{}_{{{\text{freed}}}}C)}},\quad \quad P({}_{{{\text{freed}}}}A|``{}_{{{\text{executed}}}}B\hbox{''}) \\ & \quad = \frac{{1/3 \times 1/2}}{{1/3 \times 1/2 + 1/3 \times 0 + 1/3 \times 1}} \\ & \quad = 1/3\quad {\text{and}}\;{\text{similarly}}\;P({}_{{{\text{freed}}}}C|``{}_{{{\text{executed}}}}B\hbox{''}) = 2/3. \\ \end{aligned}$$

This solution is called the Bayesian solution in the literature (for example: Falk 1992). In fact, from the Bayesian point of view there is no such a thing as a unique solution to a problem. The important notion is that judgement of probability must respect the coherence axioms. Thus, participants who respond, for example, 1/2 to the three prisoners problem because they think that the warder is not honest and that P(“executed B”|freed A) = 1 (if A is freed, the warder says that B will be executed because he prefers B to C), or any other solution because they have some other prior degree of belief than 1/3, can genuinely be Bayesian. Thus, we use “Bayesian solution” in quotation marks.

Appendix 2

The standard version of “three prisoners” can be found in Shimojo and Ichikawa (1989, p. 2).

Three men, A, B and C, were in jail. A knew that one of them was to be set free and the other two were to be executed. But he didn’t know who was the one to be spared. To the jailer who did know, A said, “since two out of the three will be executed, it is certain that either B or C will be, at least. You will give me no information about my own chances if you give me the name of one man, B or C, who is going to be executed”. Accepting this argument after some thinking, the jailer said “B will be executed”. Thereupon A felt happier because now either he or C would go free, so his chance had increased from 1/3 to 1/2. This prisoner’s happiness may or may not be reasonable. What do you think?

The version we used in the experiment was similar to Shimojo and Ichikawas (1989)’ version. The main difference is that we asked participants to give two judgements of probability. A first judgment took place before the warder released his message. This step was meant to know which prior degrees of belief participants used, and to see if they were equal to 1/3 as assumed by the experimenter. A second judgement was asked after the release of the warder’s message in order to analyse participants’ dynamic process of revision.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Baratgin, J., Politzer, G. The psychology of dynamic probability judgment: order effect, normative theories, and experimental methodology. Mind & Society 6, 53–66 (2007). https://doi.org/10.1007/s11299-006-0025-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11299-006-0025-z

Keywords

Navigation