Over the last decades, understanding the sources of the difficulty of Bayesian problem solving has been an important research goal, with the effects of numerical format and individual numeracy being widely studied. However, the focus on the comprehension of probability numbers has overshadowed the relational reasoning demand of the Bayesian task. This is particularly the case when the statistical data are verbally described since the requested quantitative relation (posterior ratio) is misaligned with the presented ones (prior and likelihood ratios). In (...) this regard, here I develop the proposal that research on Bayesian reasoning might improve by considering the notational alignment framework of mathematical problem-solving. Specifically, this framework can help to understand the sources of the main difficulties underlying Bayesian inferences based on verbal descriptions. In essence, the present proposal supports the general claim in math education regarding the need to foster relational comprehension to avoid misleading alignments and improve problem solving. (shrink)

The Monty Hall Dilemma (MHD) is a two-step decision problem involving counterintuitive conditional probabilities. The first choice is made among three equally probable options, whereas the second choice takes place after the elimination of one of the non-selected options which does not hide the prize. Differing from most Bayesian problems, statistical information in the MHD has to be inferred, either by learning outcome probabilities or by reasoning from the presented sequence of events. This often leads to suboptimal decisions and erroneous (...) probability judgments. Specifically, decision makers commonly develop a wrong intuition that final probabilities are equally distributed, together with a preference for their first choice. Several studies have shown that repeated practice enhances sensitivity to the different reward probabilities, but does not facilitate correct Bayesian reasoning. However, modest improvements in probability judgments have been observed after guided explanations. To explain these dissociations, the present review focuses on two types of causes producing the observed biases: Emotional-based choice biases and cognitive limitations in understanding probabilistic information. Among the latter, we identify a crucial cause for the universal difficulty in overcoming the equiprobability illusion: Incomplete representation of prior and conditional probabilities. We conclude that repeated practice and/or high incentives can be effective for overcoming choice biases, but promoting an adequate partitioning of possibilities seems to be necessary for overcoming cognitive illusions and improving Bayesian reasoning. (shrink)

In criminal trials, evidence often involves a degree of uncertainty and decision-making includes moving from the initial presumption of innocence to inference about guilt based on that evidence. The jurors’ ability to combine evidence and make accurate intuitive probabilistic judgments underpins this process. Previous research has shown that errors in probabilistic reasoning can be explained by a misalignment of the evidence presented with the intuitive causal models that people construct. This has been explored in abstract and context-free situations. However, less (...) is known about how people interpret evidence in context-rich situations such as legal cases. The present study examined participants’ intuitive probabilistic reasoning in legal contexts and assessed how people’s causal models underlie the process of belief updating in the light of new evidence. The study assessed whether participants update beliefs in line with Bayesian norms and if errors in belief updating can be explained by the causal structures underpinning the evidence integration process. The study was based on a recent case in England where a couple was accused of intentionally harming their baby but was eventually exonerated because the child’s symptoms were found to be caused by a rare blood disorder. Participants were presented with a range of evidence, one piece at a time, including physical evidence and reports from experts. Participants made probability judgments about the abuse and disorder as causes of the child’s symptoms. Subjective probability judgments were compared against Bayesian norms. The causal models constructed by participants were also elicited. Results showed that overall participants revised their beliefs appropriately in the right direction based on evidence. However, this revision was done without exact Bayesian computation and errors were observed in estimating the weight of evidence. Errors in probabilistic judgments were partly accounted for, by differences in the causal models representing the evidence. Our findings suggest that understanding causal models that guide people’s judgments may help shed light on errors made in evidence integration and potentially identify ways to address accuracy in judgment. (shrink)

Topics in Cognitive Science, Volume 14, Issue 3, Page 528-549, July 2022.

We are neither as pessimistic nor as optimistic as Elqayam & Evans (E&E). The consequences of normativism have not been uniformly disastrous, even among the examples they consider. However, normativism won't be going away any time soon and in the literature on causal Bayes nets new debates about normativism are emerging. Finally, we suggest that to concentrate on expert reasoners as an antidote to normativism may limit the contribution of research on thinking to basic psychological science.

(2013). Legal idioms: a framework for evidential reasoning. Argument & Computation: Vol. 4, Formal Models of Reasoning in Cognitive Psychology, pp. 46-63. doi: 10.1080/19462166.2012.682656.

Conviction Narrative Theory (CNT) is a theory of choice underradical uncertainty– situations where outcomes cannot be enumerated and probabilities cannot be assigned. Whereas most theories of choice assume that people rely on (potentially biased) probabilistic judgments, such theories cannot account for adaptive decision-making when probabilities cannot be assigned. CNT proposes that people usenarratives– structured representations of causal, temporal, analogical, and valence relationships – rather than probabilities, as the currency of thought that unifies our sense-making and decision-making faculties. According to CNT, (...) narratives arise from the interplay between individual cognition and the social environment, with reasoners adopting a narrative that feels “right” to explain the available data; using that narrative to imagine plausible futures; and affectively evaluating those imagined futures to make a choice. Evidence from many areas of the cognitive, behavioral, and social sciences supports this basic model, including lab experiments, interview studies, and econometric analyses. We identify 12 propositions to explain how the mental representations (narratives) interact with four inter-related processes (explanation, simulation, affective evaluation, and communication), examining the theoretical and empirical basis for each. We conclude by discussing how CNT can provide a common vocabulary for researchers studying everyday choices across areas of the decision sciences. (shrink)

Humans have long been characterized as poor probabilistic reasoners when presented with explicit numerical information. Bayesian word problems provide a well-known example of this, where even highly educated and cognitively skilled individuals fail to adhere to mathematical norms. It is widely agreed that natural frequencies can facilitate Bayesian reasoning relative to normalized formats (e.g. probabilities, percentages), both by clarifying logical set-subset relations and by simplifying numerical calculations. Nevertheless, between-study performance on “transparent” Bayesian problems varies widely, and generally remains rather unimpressive. (...) We suggest there has been an over-focus on this representational facilitator (i.e. transparent problem structures) at the expense of the specific logical and numerical processing requirements and the corresponding individual abilities and skills necessary for providing Bayesian-like output given specific verbal and numerical input. We further suggest that understanding this task-individual pair could benefit from considerations from the literature on mathematical cognition, which emphasizes text comprehension and problem solving, along with contributions of online executive working memory, metacognitive regulation, and relevant stored knowledge and skills. We conclude by offering avenues for future research aimed at identifying the stages in problem solving at which correct versus incorrect reasoners depart, and how individual difference might influence this time point. (shrink)

The appeal to expert opinion is an argument form that uses the verdict of an expert to support a position or hypothesis. A previous scheme-based treatment of the argument form is formalized within a Bayesian network that is able to capture the critical aspects of the argument form, including the central considerations of the expert's expertise and trustworthiness. We propose this as an appropriate normative framework for the argument form, enabling the development and testing of quantitative predictions as to how (...) people evaluate this argument, suggesting that such an approach might be beneficial to argumentation research generally. We subsequently present two experiments as an example of the potential for future research in this vein, demonstrating that participants' quantitative ratings of the convincingness of a proposition that has been supported with an appeal to expert opinion were broadly consistent with the predictions of the Bayesian model. (shrink)

Causal Bayes nets have been developed in philosophy, statistics, and computer sciences to provide a formalism to represent causal structures, to induce causal structure from data and to derive predictions. Causal Bayes nets have been used as psychological theories in at least two ways. They were used as rational, computational models of causal reasoning and they were used as formal models of mental causal models. A crucial assumption made by them is the Markov condition, which informally states that variables are (...) independent of other variables that are not their direct or indirect effects conditional on their immediate causes. Whether people’s inferences conform to the causal Markov and the faithfulness condition has recently been investigated empirically. A review of respective research indicates that inferences frequently violate these conditions. This finding challenges some uses of causal Bayes nets in psychology. They entail that causal Bayes nets may not be appropriate to derive predictions for causal model theories of causal reasoning. They also question whether causal Bayes nets as a rational model are empirically descriptive. They do not challenge, however, causal Bayes nets as normative models and their usage as formal models of causal reasoning. (shrink)

Normative theories can be useful in developing descriptive theories, as when normative subjective expected utility theory is used to develop descriptive rational choice theory and behavioral game theory. “Ought” questions are also the essence of theories of moral reasoning, a domain of higher mental processing that could not survive without normative considerations.

We report a series of experiments examining whether people ascribe knowledge for true beliefs based on probabilistic evidence. Participants were less likely to ascribe knowledge for beliefs based on probabilistic evidence than for beliefs based on perceptual evidence or testimony providing causal information. Denial of knowledge for beliefs based on probabilistic evidence did not arise because participants viewed such beliefs as unjustified, nor because such beliefs leave open the possibility of error. These findings rule out traditional philosophical accounts for why (...) probabilistic evidence does not produce knowledge. The experiments instead suggest that people deny knowledge because they distrust drawing conclusions about an individual based on reasoning about the population to which it belongs, a tendency previously identified by “judgment and decision making” researchers. Consistent with this, participants were more willing to ascribe knowledge for beliefs based on probabilistic evidence that is specific to a particular case. 2016 APA, all rights reserved). (shrink)

A Bayesian network (BN) is a graphical model of uncertainty that is especially well suited to legal arguments. It enables us to visualize and model dependencies between different hypotheses and pieces of evidence and to calculate the revised probability beliefs about all uncertain factors when any piece of new evidence is presented. Although BNs have been widely discussed and recently used in the context of legal arguments, there is no systematic, repeatable method for modeling legal arguments as BNs. Hence, where (...) BNs have been used in the legal context, they are presented as completed pieces of work, with no insights into the reasoning and working that must have gone into their construction. This means the process of building BNs for legal arguments is ad hoc, with little possibility for learning and process improvement. This article directly addresses this problem by describing a method for building useful legal arguments in a consistent and repeatable way. The method complements and extends recent work by Hepler, Dawid, and Leucari (2007) on object-oriented BNs for complex legal arguments and is based on the recognition that such arguments can be built up from a small number of basic causal structures (referred to as idioms). We present a number of examples that demonstrate the practicality and usefulness of the method. (shrink)

Real causal systems are complicated. Despite this, causal learning research has traditionally emphasized how causal relations can be induced on the basis of idealized events, i.e. those that have been mapped to binary variables and abstracted from time. For example, participants may be asked to assess the efficacy of a headache-relief pill on the basis of multiple patients who take the pill (or not) and find their headache relieved (or not). In contrast, the current study examines learning via interactions with (...) continuous dynamic systems, systems that include continuous variables that interact over time (and that can be continuously observed in real time by the learner). To explore such systems, we develop a new framework that represents a causal system as a network of stationary Gauss--Markov (``\OU'') processes and show how such \textit{OU networks} can express complex dynamic phenomena such as feedback loops and oscillations. To assess adult's abilities to learn such systems, we conducted an experiment in which participants were asked to identify the causal relationships of a number of OU networks, potentially carrying out multiple, temporally-extended interventions. We compared their judgments to a normative model for learning OU networks as well as a range of alternative and heuristic learning models from the literature. We found that, although participants exhibited substantial learning of such systems, they committed certain systematic errors. These successes and failures were best accounted for by a model that describes people as focusing on pairs of variables, rather than evaluating the evidence with respect to the full space of possible structural models. We argue that our approach provides both a principled framework for exploring the space of dynamic learning environments as well as new algorithmic insights into how people interact successfully with a continuous causal world. (shrink)

Causal reasoning is one of our most central cognitive competencies, enabling us to adapt to our world. Causal knowledge allows us to predict future events, or diagnose the causes of observed facts. We plan actions and solve problems using knowledge about cause-effect relations. Without our ability to discover and empirically test causal theories, we would not have made progress in various empirical sciences. In the past decades, the important role of causal knowledge has been discovered in many areas of cognitive (...) psychology. Despite the ubiquity of causal reasoning, textbooks of cognitive psychology have neglected this growing field. The goal of The Oxford Handbook of Causal Reasoning is to fill this gap. The handbook brings together the leading researchers in the field of causal reasoning and offers state-of-the-art presentations of theories and research. It provides introductions of competing theories of causal reasoning, and discusses its role in various cognitive functions and domains. The final section presents research from neighboring fields. 1. Causal Reasoning: An Introduction Michael R. Waldmann Part I: Theories of Causal Cognition 2. Associative Accounts of Causal Cognition Mike E. Le Pelley, Oren Griffiths, and Tom Beesley 3. Rules of Causal Judgment: Mapping Statistical Information Onto Causal Beliefs José C. Perales, Andrés Catena, Antonio Cándido, and Antonio Maldonado 4. The Inferential Reasoning Theory of Causal Learning: Toward a Multi- Process Propositional Account Yannick Boddez, Jan De Houwer, and Tom Beckers 5. Causal Invariance as an Essential Constraint for Creating a Causal Representation of the World: Generalizing the Invariance of Causal Power Patricia W. Cheng and Hongjing Lu 6. The Acquisition and Use of Causal Structure Knowledge Benjamin Margolin Rottman 7. Formalizing Prior Knowledge in Causal Induction Thomas L. Griffiths 8. Causal Mechanisms Samuel G. B. Johnson and Woo-kyoung Ahn 9. Force Dynamics and Causation Phillip Wolff and Robert Thorstad 10. Mental Models and Causation P. N. Johnson- Laird and Sangeet S. Khemlani 11. Pseudocontingencies Klaus Fiedler and Florian Kutzner 12. Singular Causation David Danks 13. Cognitive Neuroscience of Causal Reasoning Joachim T. Operskalski and Aron K. Barbey Part II: Basic Cognitive Functions 14. Visual Impressions of Causality Peter White 15. Goal-Directed Actions Bernhard Hommel 16. Planning and Control Magda Osman 17. Reinforcement Learning and Causal Models Samuel J. Gershman 18. Causation and the Probability of Causal Conditionals David E. Over 19. Causal Models and Conditional Reasoning Mike Oaksford and Nick Chater 20. Concepts as Causal Models: Categorization Bob Rehder 21. Concepts as Causal Models: Induction Bob Rehder 22. Causal Explanation Tania Lombrozo and Nadya Vasilyeva 23. Diagnostic Reasoning Björn Meder and Ralf Mayrhofer 24. Inferring Causal Relations by Analogy Keith J. Holyoak and Hee-Seung Lee 25. Causal Argument Ulrike Hahn, Roland Bluhm, and Frank Zenker 26. Causality in Decision- Making York Hagmayer and Philip M. Fernbach Part III: Domains of Causal Reasoning 27. Intuitive Theories Tobias Gerstenberg and Joshua B. Tenenbaum 28. Space, Time, and Causality Marc J. Buehner 29. Causation in Legal and Moral Reasoning David A. Lagnado and Tobias Gerstenberg 30. The Role of Causal Knowledge in Reasoning About Mental Disorders Woo-kyoung Ahn, Nancy S. Kim, and Matthew S. Lebowitz 31. Causality and Causal Reasoning in Natural Language Torgrim Solstad and Oliver Bott 32. Social Attribution and Explanation Denis Hilton Part IV: Development, Phylogeny, and Culture 33. The Development of Causal Reasoning Paul Muentener and Elizabeth Bonawitz 34. Causal Reasoning in Non-Human Animals Christian Schloegl and Julia Fischer 35. Causal Cognition and Culture Andrea Bender, Sieghard Beller, and Douglas L. Medin. (shrink)

Bayesian reasoning, defined here as the updating of a posterior probability following new information, has historically been problematic for humans. Classic psychology experiments have tested human Bayesian reasoning through the use of word problems and have evaluated each participant’s performance against the normatively correct answer provided by Bayes’ theorem. The standard finding is of generally poor performance. Over the past two decades, though, progress has been made on how to improve Bayesian reasoning. Most notably, research has demonstrated that the use (...) of frequencies in a natural sampling framework —as opposed to single-event probabilities—can improve participants’ Bayesian estimates. Furthermore, pictorial aids and certain individual difference factors also can play significant roles in Bayesian reasoning success. The mechanics of how to build tasks which show these improvements is not under much debate. The explanations for why naturally-sampled frequencies and pictures help Bayesian reasoning remain hotly contested, however, with many researchers falling into ingrained “camps” organized around two dominant theoretical perspectives. The present paper evaluates the merits of these theoretical perspectives, including the weight of empirical evidence, theoretical coherence, and predictive power. By these criteria, the ecological rationality approach is clearly better than the heuristics and biases view. Progress in the study of Bayesian reasoning will depend on continued research that honestly, vigorously, and consistently engages across these different theoretical accounts rather than staying “siloed” within one particular perspective. The process of science requires an understanding of competing points of view, with the ultimate goal being integration. (shrink)

The study tests the hypothesis that conditional probability judgments can be influenced by causal links between the target event and the evidence even when the statistical relations among variables are held constant. Three experiments varied the causal structure relating three variables and found that (a) the target event was perceived as more probable when it was linked to evidence by a causal chain than when both variables shared a common cause; (b) predictive chains in which evidence is a cause of (...) the hypothesis gave rise to higher judgments than diagnostic chains in which evidence is an effect of the hypothesis; and (c) direct chains gave rise to higher judgments than indirect chains. A Bayesian learning model was applied to our data but failed to explain them. An explanation-based hypothesis stating that statistical information will affect judgments only to the extent that it changes beliefs about causal structure is consistent with the results. (shrink)