Tenenbaum and Griffiths (2001) have proposed that their Bayesian model of generalisation unifies Shepard’s (1987) and Tversky’s (1977) similarity-based explanations of two distinct patterns of generalisation behaviours by reconciling them under a single coherent task analysis. I argue that this proposal needs refinement: instead of unifying the heterogeneous notion of psychological similarity, the Bayesian approach unifies generalisation by rendering the distinct patterns of behaviours informationally relevant. I suggest that generalisation as a Bayesian inference should be seen as (...) a complement to, instead of a replacement of, similarity-based explanations. Furthermore, I show that the unificatory powers of the Bayesian model of generalisation can contribute to the selection of one of these models of psychological similarity. (shrink)

Tenenbaum and Griffiths (Behavioral and Brain Sciences 24(4):629–640, 2001) have proposed that their Bayesian model of generalisation unifies Shepard’s (Science 237(4820): 1317–1323, 1987) and Tversky’s (Psychological Review 84(4): 327–352, 1977) similarity-based explanations of two distinct patterns of generalisation behaviours by reconciling them under a single coherent task analysis. I argue that this proposal needs refinement: instead of unifying the heterogeneous notion of psychological similarity, the Bayesian approach unifies generalisation by rendering the distinct patterns of behaviours informationally relevant. I (...) suggest that generalisation as a Bayesian inference should be seen as a complement to, instead of a replacement of, similarity-based explanations. Furthermore, I show that the unificatory powers of the Bayesian model of generalisation can contribute to the selection of one of these models of psychological similarity. (shrink)

Shepard has argued that a universal law should govern generalization across different domains of perception and cognition, as well as across organisms from different species or even different planets. Starting with some basic assumptions about natural kinds, he derived an exponential decay function as the form of the universal generalization gradient, which accords strikingly well with a wide range of empirical data. However, his original formulation applied only to the ideal case of generalization from a single encountered stimulus to a (...) single novel stimulus, and for stimuli that can be represented as points in a continuous metric psychological space. Here we recast Shepard's theory in a more general Bayesian framework and show how this naturally extends his approach to the more realistic situation of generalizing from multiple consequential stimuli with arbitrary representational structure. Our framework also subsumes a version of Tversky's set-theoretic model of similarity, which is conventionally thought of as the primary alternative to Shepard's continuous metric space model of similarity and generalization. This unification allows us not only to draw deep parallels between the set-theoretic and spatial approaches, but also to significantly advance the explanatory power of set-theoretic models. Key Words: additive clustering; Bayesian inference; categorization; concept learning; contrast model; features; generalization; psychological space; similarity. (shrink)

Two long-standing arguments in cognitive science invoke the assumption that holistic inference is computationally infeasible. The first is Fodor’s skeptical argument toward computational modeling of ordinary inductive reasoning. The second advocates modular computational mechanisms of the kind posited by Cosmides, Tooby and Sperber. Based on advances in machine learning related to Bayes nets, as well as investigations into the structure of scientific and ordinary information, I maintain neither argument establishes its architectural conclusion. Similar considerations also undermine Fodor’s decades-long diagnosis of (...) artificial intelligence research as confounded by an inability to circumscribe the amount of information relevant to inferential processes. This diagnosis is particularly inapposite with respect to Bayes nets, since one of their strengths as machine learning systems has been their capacity to reason probabilistically about large data sets whose size overwhelms the capacities of individual human reasoners. A general moral follows from these criticisms: Insights into artificial and human cognitive systems are likely to be cultivated by focusing greater attention on the structure and density of connections among items of information that are available to them. (shrink)

The previous two parts of the paper demonstrate that the interpretation of Fermat’s last theorem (FLT) in Hilbert arithmetic meant both in a narrow sense and in a wide sense can suggest a proof by induction in Part I and by means of the Kochen - Specker theorem in Part II. The same interpretation can serve also for a proof FLT based on Gleason’s theorem and partly similar to that in Part II. The concept of (probabilistic) measure of a subspace (...) of Hilbert space and especially its uniqueness can be unambiguously linked to that of partial algebra or incommensurability, or interpreted as a relation of the two dual branches of Hilbert arithmetic in a wide sense. The investigation of the last relation allows for FLT and Gleason’s theorem to be equated in a sense, as two dual counterparts, and the former to be inferred from the latter, as well as vice versa under an additional condition relevant to the Gödel incompleteness of arithmetic to set theory. The qubit Hilbert space itself in turn can be interpreted by the unity of FLT and Gleason’s theorem. The proof of such a fundamental result in number theory as FLT by means of Hilbert arithmetic in a wide sense can be generalized to an idea about “quantum number theory”. It is able to research mathematically the origin of Peano arithmetic from Hilbert arithmetic by mediation of the “nonstandard bijection” and its two dual branches inherently linking it to information theory. Then, infinitesimal analysis and its revolutionary application to physics can be also re-realized in that wider context, for example, as an exploration of the way for physical quantity of time (respectively, for time derivative in any temporal process considered in physics) to appear at all. Finally, the result admits a philosophical reflection of how any hierarchy arises or changes itself only thanks to its dual and idempotent counterpart. (shrink)

This paper discusses two senses in which a hypothesis may be said to unify evidence. One is the ability of the hypothesis to increase the mutual information of a set of evidence statements; the other is the ability of the hypothesis to explain commonalities in observed phenomena by positing a common origin for them. On Bayesian updating, it is only mutual information unification that contributes to the incremental support of a hypothesis by the evidence unified. This poses (...) a challenge for the view that explanation is a confirmatory virtue that contributes to such incremental support; its advocates must ground it in some relevant difference between humans and a Bayesian agent. (shrink)

In a seminal 1977 article, Rumelhart argued that perception required the simultaneous use of multiple sources of information, allowing perceivers to optimally interpret sensory information at many levels of representation in real time as information arrives. Building on Rumelhart's arguments, we present the Interactive Activation hypothesis—the idea that the mechanism used in perception and comprehension to achieve these feats exploits an interactive activation process implemented through the bidirectional propagation of activation among simple processing units. We then examine the interactive activation (...) model of letter and word perception and the TRACE model of speech perception, as early attempts to explore this hypothesis, and review the experimental evidence relevant to their assumptions and predictions. We consider how well these models address the computational challenge posed by the problem of perception, and we consider how consistent they are with evidence from behavioral experiments. We examine empirical and theoretical controversies surrounding the idea of interactive processing, including a controversy that swirls around the relationship between interactive computation and optimal Bayesian inference. Some of the implementation details of early versions of interactive activation models caused deviation from optimality and from aspects of human performance data. More recent versions of these models, however, overcome these deficiencies. Among these is a model called the multinomial interactive activation model, which explicitly links interactive activation and Bayesian computations. We also review evidence from neurophysiological and neuroimaging studies supporting the view that interactive processing is a characteristic of the perceptual processing machinery in the brain. In sum, we argue that a computational analysis, as well as behavioral and neuroscience evidence, all support the Interactive Activation hypothesis. The evidence suggests that contemporary versions of models based on the idea of interactive activation continue to provide a basis for efforts to achieve a fuller understanding of the process of perception. (shrink)

It is often claimed that the greatest value of the Bayesian framework in cognitive science consists in its unifying power. Several Bayesian cognitive scientists assume that unification is obviously linked to explanatory power. But this link is not obvious, as unification in science is a heterogeneous notion, which may have little to do with explanation. While a crucial feature of most adequate explanations in cognitive science is that they reveal aspects of the causal mechanism that produces the phenomenon (...) to be explained, the kind of unification afforded by the Bayesian framework to cognitive science does not necessarily reveal aspects of a mechanism. Bayesian unification, nonetheless, can place fruitful constraints on causal–mechanical explanation. 1 Introduction2 What a Great Many Phenomena Bayesian Decision Theory Can Model3 The Case of Information Integration4 How Do Bayesian Models Unify?5 Bayesian Unification: What Constraints Are There on Mechanistic Explanation?5.1 Unification constrains mechanism discovery5.2 Unification constrains the identification of relevant mechanistic factors5.3 Unification constrains confirmation of competitive mechanistic models6 ConclusionAppendix. (shrink)

A Bayesian account of the virtue of unification is given. On this account, the ability of a theory to unify disparate phenomena consists in the ability of the theory to render such phenomena informationally relevant to each other. It is shown that such ability contributes to the evidential support of the theory, and hence that preference for theories that unify the phenomena need not, on a Bayesian account, be built into the prior probabilities of theories.

In this article applied and theoretical epistemologies benefit each other in a study of the British legal case of R. vs. Clark. Clark's first infant died at 11 weeks of age, in December 1996. About a year later, Clark had a second child. After that child died at eight weeks of age, Clark was tried for murdering both infants. Statisticians and philosophers have disputed how to apply Bayesian analyses to this case, and thereby arrived at different judgments about it. (...) By dwelling on this applied case, I make theoretical gains: clarifying and defending pragmatic principles of inference that are important for estimating key probabilities in a range of cases. Then, partly by drawing on such principles, and uncovering overlooked data on post-partum psychosis, I make applied gains: improving the rationality of judgments about the Sally Clark case in particular, judgments important to future similar cases. (shrink)

This paper starts by considering an argument for thinking that predictive processing (PP) is representational. This argument suggests that the Kullback–Leibler (KL)-divergence provides an accessible measure of misrepresentation, and therefore, a measure of representational content in hierarchical Bayesian inference. The paper then argues that while the KL-divergence is a measure of information, it does not establish a sufficient measure of representational content. We argue that this follows from the fact that the KL-divergence is a measure of relative entropy, which (...) can be shown to be the same as covariance (through a set of additional steps). It is well known that facts about covariance do not entail facts about representational content. So there is no reason to think that the KL-divergence is a measure of (mis-)representational content. This paper thus provides an enactive, non-representational account of Bayesian belief optimisation in hierarchical PP. (shrink)

A diagnostic judgment of a teacher can be seen as an inference from manifest observable evidence on a student’s behavior to his or her latent traits. This can be described by a Bayesian model of in-ference: The teacher starts from a set of assumptions on the student (hypotheses), with subjective probabilities for each hypothesis (priors). Subsequently, he or she uses observed evidence (stu-dents’ responses to tasks) and knowledge on conditional probabilities of this evidence (likelihoods) to revise these assumptions. Many (...) systematic deviations from this model (biases, e.g. base-rate neglect, inverse fallacy) are reported in literature on Bayesian reasoning. In a teacher’s situation the information (hypotheses, priors, likelihoods) is usually not explicitly represented numerically (as in most research on Bayesian reasoning), but only by qualitative esti-mations in the mind of the teacher. In our study, we ask to which extent individuals (approximately) apply a rational Bayesian strategy or resort on other biased strategies of processing information for their diagnostic judgments. We explicitly pose this question with respect to non-numerical settings. To investigate this question, we developed a scenario that visually displays all relevant information (hypotheses, priors, likelihoods) in a graphically displayed hypothesis space (called “hypothegon”) – without recurring to numerical representations or mathematical procedures. 42 pre-service teach-ers were asked to judge the plausibility of different misconceptions of six students based on their responses to decimal comparison tasks (e.g. 3.39 > 3.4). Applying a Bayesian classification proce-dure, we identified three updating strategies: A Bayesian update strategy (BUS, processing all probabilities), a combined evidence strategy (CES, ignoring the prior probabilities but including all likelihoods), and a single evidence strategy (SES, only using the likelihood of the most probable hypothesis). In study 1, an instruction on the relevance of using all probabilities (priors and likelihoods) only weakly increased the processing of more information. In study 2, we found strong evidence that a visual explication of the prior-likelihood interaction led to an increase of processing the interaction of all relevant information. These results show that the phenomena found in general research on Bayesian reasoning in numerical settings extend to diagnostic judgments in non-numerical settings. (shrink)

We discuss two influential views of unification: mutual information unification (MIU) and common origin unification (COU). We propose a simple probabilistic measure for COU and compare it with Myrvold’s (2003, 2017) probabilistic measure for MIU. We then explore how well these two measures perform in simple causal settings. After highlighting several deficiencies, we propose causal constraints for both measures. A comparison with explanatory power shows that the causal version of COU is one step ahead in simple causal settings. However, (...) slightly increasing the complexity of the underlying causal structure shows that both measures can easily disagree with explanatory power. The upshot of this is that even sophisticated causally constrained measures for unification ultimately fail to track explanatory relevance. This shows that unification and explanation are not as closely related as many philosophers thought. (shrink)

The intuitive notion of a binary relation on information-bearers, comparingthem with respect to their closeness to the available information, is oftenconstrued in terms of comparing their symmetric difference with, orcompositional similarity to, the available information. This happens forinstance in some treatments of verisimilitude. We expound an abstractmathematical rendering of the relevant data-dependent relation in theframework of Boolean algebras. For every element t of a Boolean algebra B we construct the t-modulated Boolean algebra Btin which the order relation represents `is at (...) most as compatible with t as' or `is at best as similar to t as'. In the case of Lindenbaum-Tarskialgebras, t expresses the available information, and the compatibilityrelation turns out to be an entwinement of inferential and conjecturalrelations. It is just classical entailment when no information is available(i.e., when t is logically true) and becomes more boldly abductive themore information is available. The rich algebraic structures of a Boolean algebra –- including its Boolean group structures –- play a significant role in this combination of deduction and abduction and also induce cautious anddaring variants of the compatibility relation. Links with the literature onverisimilitude, abduction, and related topics are indicated. (shrink)

The intuitive notion of a binary relation on information-bearers, comparingthem with respect to their closeness to the available information, is oftenconstrued in terms of comparing their symmetric difference with, orcompositional similarity to, the available information. This happens forinstance in some treatments of verisimilitude. We expound an abstractmathematical rendering of the relevant data-dependent relation in theframework of Boolean algebras. For every element t of a Boolean algebra B we construct the t-modulated Boolean algebra Btin which the order relation represents `is at (...) most as compatible with t as'' or `is at best as similar to t as''. In the case of Lindenbaum-Tarskialgebras, t expresses the available information, and the compatibilityrelation turns out to be an entwinement of inferential and conjecturalrelations. It is just classical entailment when no information is available(i.e., when t is logically true) and becomes more boldly abductive themore information is available. The rich algebraic structures of a Boolean algebra –- including its Boolean group structures –- play a significant role in this combination of deduction and abduction and also induce cautious anddaring variants of the compatibility relation. Links with the literature onverisimilitude, abduction, and related topics are indicated. (shrink)

Can the output of human cognition be predicted from the assumption that it is an optimal response to the information-processing demands of the environment? A methodology called rational analysis is described for deriving predictions about cognitive phenomena using optimization assumptions. The predictions flow from the statistical structure of the environment and not the assumed structure of the mind. Bayesian inference is used, assuming that people start with a weak prior model of the world which they integrate with experience to (...) develop stronger models of specific aspects of the world. Cognitive performance maximizes the difference between the expected gain and cost of mental effort. Memory performance can be predicted on the assumption that retrieval seeks a maximal trade-off between the probability of finding the relevant memories and the effort required to do so; in categorization performance there is a similar trade-off between accuracy in predicting object features and the cost of hypothesis formation; in casual inference the trade-off is between accuracy in predicting future events and the cost of hypothesis formation; and in problem solving it is between the probability of achieving goals and the cost of both external and mental problem-solving search. The implemention of these rational prescriptions in neurally plausible architecture is also discussed. (shrink)

BackgroundBayesian estimation with informative priors permits updating previous findings with new data, thus generating cumulative knowledge. To reduce subjectivity in the process, the present study emphasizes how to systematically weigh and specify informative priors and highlights the use of different aggregation methods using an empirical example that examined whether observed mother-adolescent positive and negative interaction behavior mediate the associations between maternal and adolescent internalizing symptoms across early to mid-adolescence in a 3-year longitudinal multi-method design.MethodsThe sample consisted of 102 mother-adolescent dyads. (...) Mothers and adolescents reported on their internalizing symptoms and their interaction behaviors were observed during a conflict task. We systematically searched for previous studies and used an expert-informed weighting system to account for their relevance. Subsequently, we aggregated the priors using three methods: linear pooling, logarithmic pooling, and fitting a normal distribution to the linear pool by means of maximum likelihood estimation. We compared the impact of the three differently specified informative priors and default priors on the prior predictive distribution, shrinkage, and the posterior estimates.ResultsThe prior predictive distributions for the three informative priors were quite similar and centered around the observed data mean. The shrinkage results showed that the logarithmic pooled priors were least affected by the data. Most posterior estimates were similar across the different priors. Some previous studies contained extremely specific information, resulting in bimodal posterior distributions for the analyses with linear pooled prior distributions. The posteriors following the fitted normal priors and default priors were very similar. Overall, we found that maternal, but not adolescent, internalizing symptoms predicted subsequent mother-adolescent interaction behavior, whereas negative interaction behavior seemed to predict subsequent internalizing symptoms. Evidence regarding mediation effects remained limited.ConclusionA systematic search for previous information and an expert-built weighting system contribute to a clear specification of power priors. How information from multiple previous studies should be included in the prior depends on theoretical considerations, and may also be affected by pragmatic considerations regarding the impact of the previous results at hand. (shrink)

Infant language learners are faced with the difficult inductive problem of determining how new words map to novel or known objects in their environment. Bayesian inference models have been successful at using the sparse information available in natural child-directed speech to build candidate lexicons and infer speakers’ referential intentions. We begin by asking how a Bayesian model optimized for monolingual input generalizes to new monolingual or bilingual corpora and find that, especially in the case of the bilingual input, (...) the model shows a significant decrease in performance. In the next experiment, we propose the ME Model, a modified Bayesian model, which approximates infants’ mutual exclusivity bias to support the differential demands of monolingual and bilingual learning situations. The extended model is assessed using the same corpora of real child-directed speech, showing that its performance is more robust against varying input and less dependent than the Intentional Model on optimization of its parsimony parameter. We argue that both monolingual and bilingual demands on word learning are important considerations for a computational model, as they can yield significantly different results than when only one such context is considered. (shrink)

In this article, I consider some of the first appearances of a hypothesis of quantized energy between the years 1900 and 1913 and provide an analysis of the nature of the unificatory power of this hypothesis in a Bayesian framework. I argue that the best way to understand the unification here is in terms of informational relevance: on the assumption of the quantum hypothesis, phenomena that were previously thought to be unrelated turned out to yield information about (...) one another on the basis of agreeing measurements of the numerical value of Planck’s constant. (shrink)

We criticise Shepard's notions of “invariance” and “universality,” and the incorporation of Shepard's work on inference into the general framework of his paper. We then criticise Tenenbaum and Griffiths' account of Shepard (1987b), including the attributed likelihood function, and the assumption of “weak sampling.” Finally, we endorse Barlow's suggestion that minimum message length (MML) theory has useful things to say about the Bayesian inference problems discussed by Shepard and Tenenbaum and Griffiths. [Barlow; Shepard; Tenenbaum & Griffiths].

Shepard’s (1987) universal law of generalisation (ULG) illustrates that an invariant gradient of generalisation across species and across stimuli conditions can be obtained by mapping the probability of a generalisation response onto the representations of similarity between individual stimuli. Tenenbaum and Griffiths (2001) Bayesian account of generalisation expands ULG towards generalisation from multiple examples. Though the Bayesian model starts from Shepard’s account it refrains from any commitment to the notion of psychological similarity to explain categorisation. This chapter presents (...) the conceptual spaces theory (Gärdenfors 2000, 2014) as a mediator between Shepard’s and Tenenbaum & Griffiths’ conflicting views on the role of psychological similarity for a successful model of categorisation. It suggests that the conceptual spaces theory can help to improve the Bayesian model while finding an explanatory role for psychological similarity. (shrink)

Cognitive approaches contribute to our understanding of delusions by providing an explanatory framework that extends beyond the personal level to the sub personal level of information-processing systems. According to one influential cognitive approach, two factors are required to account for the content of a delusion, its initial adoption as a belief, and its persistence. This chapter reviews Bayesian developments of the two-factor framework.

The study tests the hypothesis that conditional probability judgments can be influenced by causal links between the target event and the evidence even when the statistical relations among variables are held constant. Three experiments varied the causal structure relating three variables and found that (a) the target event was perceived as more probable when it was linked to evidence by a causal chain than when both variables shared a common cause; (b) predictive chains in which evidence is a cause of (...) the hypothesis gave rise to higher judgments than diagnostic chains in which evidence is an effect of the hypothesis; and (c) direct chains gave rise to higher judgments than indirect chains. A Bayesian learning model was applied to our data but failed to explain them. An explanation-based hypothesis stating that statistical information will affect judgments only to the extent that it changes beliefs about causal structure is consistent with the results. (shrink)

Collaboration requires agents to coordinate their behavior on the fly, sometimes cooperating to solve a single task together and other times dividing it up into sub‐tasks to work on in parallel. Underlying the human ability to collaborate is theory‐of‐mind (ToM), the ability to infer the hidden mental states that drive others to act. Here, we develop Bayesian Delegation, a decentralized multi‐agent learning mechanism with these abilities. Bayesian Delegation enables agents to rapidly infer the hidden intentions of others by (...) inverse planning. We test Bayesian Delegation in a suite of multi‐agent Markov decision processes inspired by cooking problems. On these tasks, agents with Bayesian Delegation coordinate both their high‐level plans (e.g., what sub‐task they should work on) and their low‐level actions (e.g., avoiding getting in each other's way). When matched with partners that act using the same algorithm, Bayesian Delegation outperforms alternatives. Bayesian Delegation is also a capable ad hoc collaborator and successfully coordinates with other agent types even in the absence of prior experience. Finally, in a behavioral experiment, we show that Bayesian Delegation makes inferences similar to human observers about the intent of others. Together, these results argue for the centrality of ToM for successful decentralized multi‐agent collaboration. (shrink)

Wayne Norman argues that there should be more similarity or unity between the justifications for markets and the extra-legal norms that apply to market agents. I question two aspects of his claim. First, why does Norman refer to this view as a view about the self-regulation of market agents? Agents could self-regulate with many different norms, not necessarily norms informed by the justifications for markets. Second, asking for more similarity might create problems in terms of the liberty of market agents (...) to pursue other morally relevant objectives. How are we to balance these other relevant objectives and the objectives of markets? (shrink)

Watching another person take actions to complete a goal and making inferences about that person's knowledge is a relatively natural task for people. This ability can be especially important in educational settings, where the inferences can be used for assessment, diagnosing misconceptions, and providing informative feedback. In this paper, we develop a general framework for automatically making such inferences based on observed actions; this framework is particularly relevant for inferring student knowledge in educational games and other interactive virtual environments. Our (...) approach relies on modeling action planning: We formalize the problem as a Markov decision process in which one must choose what actions to take to complete a goal, where choices will be dependent on one's beliefs about how actions affect the environment. We use a variation of inverse reinforcement learning to infer these beliefs. Through two lab experiments, we show that this model can recover people's beliefs in a simple environment, with accuracy comparable to that of human observers. We then demonstrate that the model can be used to provide real-time feedback and to model data from an existing educational game. (shrink)

Information was a frequently used concept in many fields of investigation. However, this concept is still not really understood, when it is referred for instance to consciousness and its informational structure. In this paper it is followed the concept of information from philosophical to physics perspective, showing especially how this concept could be extended to matter in general and to the living in particular, as a result of the intimate interaction between matter and information, the human body appearing as (...) a bipolar informed-matter structure. It is detailed on this way how this concept could be referred to consciousness, and an informational modeling of consciousness as an informational system of the human body is presented. Based on the anatomic architecture of the organism and on the inference of the specific information concepts, it is shown that the informational system of the human body could be described by seven informational subsystems, which are reflected in consciousness as corresponding cognitive centers. These results are able to explain the main properties of consciousness, both the cognitive and extra-cognitive properties of the mind, like that observed during the near-death experiences and other similar phenomena. Moreover, the results of such a modeling are compared with the existing empirical concepts and models on the energetic architecture of the organism, showing their relevance for the understanding of consciousness. (shrink)

Richard Bradley’s Bayesian model of preference kinematics is compared with Sven Ove Hansson’s AGM-style model of preference revision. Both seek to model the revision of preference orders as a consequence of retaining consistency when some preferences change. Both models are often interpreted normatively, as giving advice on how an agent should revise her preferences. I raise four criticisms of the Bayesian model: it is unrealistic; it neglects an important change mechanism; it disregards endogenous information relevant to preference change, (...) in particular about similarity and incompleteness; and its representational framework, when expanded with similarity comparisons, may give misleading advice. These criticisms are based on a principle of conservatism, and on two proposals of similarity metrics for the Bayesian model. The performance of the Bayesian model, with and without the similarity metrics, is then tested in three different cases of preference change, and compared to the performance of the AGM model. (shrink)

Philosophical discussions on causal inference in medicine are stuck in dyadic camps, each defending one kind of evidence or method rather than another as best support for causal hypotheses. Whereas Evidence Based Medicine advocates the use of Randomised Controlled Trials and systematic reviews of RCTs as gold standard, philosophers of science emphasise the importance of mechanisms and their distinctive informational contribution to causal inference and assessment. Some have suggested the adoption of a pluralistic approach to causal inference, and an (...) inductive rather than hypothetico-deductive inferential paradigm. However, these proposals deliver no clear guidelines about how such plurality of evidence sources should jointly justify hypotheses of causal associations. We here develop such guidelines by first giving a philosophical analysis of the underpinnings of Hill’s viewpoints on causality. We then put forward an evidence-amalgamation framework adopting a Bayesian net approach to model causal inference in pharmacology for the assessment of harms. Our framework accommodates a number of intuitions already expressed in the literature concerning the EBM vs. pluralist debate on causal inference, evidence hierarchies, causal holism, relevance, and reliability. (shrink)

Cognitive approaches contribute to our understanding of delusions by providing an explanatory framework that extends beyond the personal level to the sub personal level of information-processing systems. According to one influential cognitive approach, two factors are required to account for the content of a delusion, its initial adoption as a belief, and its persistence. This chapter reviews Bayesian developments of the two-factor framework.

Visual aids can improve comprehension of risks associated with medical treatments, screenings, and lifestyles. Do visual aids also help decision makers accurately assess their risk comprehension? That is, do visual aids help them become well calibrated? To address these questions, we investigated the benefits of visual aids displaying numerical information and measured accuracy of self-assessment of diagnostic inferences (i.e., metacognitive judgment calibration) controlling for individual differences in numeracy. Participants included 108 patients who made diagnostic inferences about three medical tests on (...) the basis of information about the sensitivity and false-positive rate of the tests and disease prevalence. Half of the patients received the information in numbers without a visual aid, while the other half received numbers along with a grid representing the numerical information. In the numerical condition, many patients --especially those with low numeracy-- misinterpreted the predictive value of the tests and profoundly overestimated the accuracy of their inferences. Metacognitive judgment calibration mediated the relationship between numeracy and accuracy of diagnostic inferences. In contrast, in the visual aid condition, patients at all levels of numeracy showed high-levels of inferential accuracy and metacognitive judgment calibration. Results indicate that accurate metacognitive assessment may explain the beneficial effects of visual aids and numeracy --a result that accords with theory suggesting that metacognition is an essential part of risk literacy. We conclude that well-designed risk communications can inform patients about health-relevant numerical information while helping them assess the quality of their own risk comprehension. (shrink)

Medical research makes intensive use of statistics in order to support its claims. In this paper we make explicit an epistemological tension between the conduct of clinical trials and their interpretation: statistical evidence is sometimes discarded on the basis of an underlined Bayesian reasoning. We suggest that acknowledging the potentiality of Bayesian statistics might contribute to clarify and improve comprehension of medical research. Nevertheless, despite Bayesianism may provide a better account for scientific inference with respect to the standard (...) frequentist approach, Bayesian statistics is rarely adopted in clinical research. The main reason lies in the supposed subjective elements characterizing this perspective. Hence, we discuss this objection presenting the so-called Reference analysis, a formal method which has been developed in the context of objective Bayesian statistics in order to define priors which have a minimal or null impact on posterior probabilities. Furthermore, according to this method only available data are relevant sources of information, so that it resists the most common criticisms against Bayesianism. (shrink)

Methods for performing complex probabilistic reasoning tasks, often based on masses of different forms of evidence obtained from a variety of different sources, are being sought by, and developed for, persons in many important contexts including law, medical diagnosis, and intelligence analysis. The complexity of these tasks can often be captured and represented by graphical structures now called inference networks. These networks are directed acyclic graphs, consisting of nodes, representing relevant hypotheses, items of evidence, and unobserved variables, and arcs joining (...) some of the nodes, representing dependency relations among them. This chapter describes and comments on two different approaches to inference network construction. In the first approach, a DAG network structure is explicitly constructed as a vehicle for probabilistic analyses. Since the associated computations can be regarded as generalising the use of Bayes' rule, such networks are commonly called Bayesian networks. The second approach stems from the work of the American jurist John H. Wigmore who was the very first person to attempt a systematic study of inference networks. (shrink)

People often struggle with Bayesian reasoning. However, research showed that people’s performance (and rationality) can be supported by the way of representing the statistical information. First, research showed that using natural frequencies instead of probabilities as format of statistical information increases people’s performance in Bayesian situations thoroughly. Second, research also yielded that people’s performance increases through using visualization. We build our paper on existing research in this field. The main aim is to analyse people’s strategies in Bayesian (...) situations that are still erroneous although statistical information is represented by natural frequencies and visualizations. In particular, we compare two pairs of visualization with similar numerical information (tree diagram vs. unit square and double-tree diagram vs. 2x2-table) concerning their impact on people’s erroneous strategies in Bayesian situations. For this aim, we conducted an experiment with 540 university students. The students were randomly assigned to four conditions that are defined by the four different visualizations of statistical information. The students were asked to indicate a fraction as response in four Bayesian situations. We documented the numerator and the denominator of the students’ responses representing a basic set and a subset in a Bayesian situation. Our results show that people’s erroneous strategies are highly dependent on the visualization. A central finding is that the visualization’s characteristic of making the nested-sets structure of a Bayesian situation transparent has a facilitating effect on people’s Bayesian reasoning. For example, compared to the unit square, a tree diagram does not explicitly visualize the set-subset relations that are relevant in a Bayesian situation. Accordingly, compared to a unit square, a tree diagram partly hinders people to find the correct denominator in a Bayesian situation, and, in particular, triggers to select a wrong numerator. By analyzing people’s erroneous strategies in Bayesian situations, we contribute to investigating approaches to facilitate Bayesian reasoning and to further develop the teaching of Bayesian reasoning. (shrink)

We provide a new link between deductive and probabilistic reasoning fallacies. Illusory inferences from disjunction are a broad class of deductive fallacies traditionally explained by recourse to a matching procedure that looks for content overlap between premises. In two behavioral experiments, we show that this phenomenon is instead sensitive to real-world causal dependencies and not to exact content overlap. A group of participants rated the strength of the causal dependence between pairs of sentences. This measure is a near perfect predictor (...) of fallacious reasoning by an independent group of participants in illusory inference tasks with the same materials. In light of these results, we argue that all extant accounts of these deductive fallacies require non-trivial adjustments. Crucially, these novel _indirect_ illusory inferences from disjunction bear a structural similarity to seemingly unrelated _probabilistic reasoning_ problems, in particular the conjunction fallacy from the heuristics and biases literature. This structural connection was entirely obscure in previous work on these deductive problems, due to the theoretical and empirical focus on content overlap. We argue that this structural parallelism provides arguments against the need for rich descriptions and individuating information in the conjunction fallacy, and we outline a unified theory of deductive illusory inferences from disjunction and the conjunction fallacy, in terms of Bayesian confirmation theory. (shrink)

The idea is that, in a wide range of contexts, utterances of the sentences in (a) in each case will communicate the assumption in (b) in each case (or something closely akin to it, there being a certain amount of contextually governed variation in the speaker's propositional attitude and so the scope of the negation). These scalar inferences are taken to be one kind of (generalized) conversational implicature. As is the case with pragmatic inference quite generally, these inferences are defeasible (...) (cancellable), which distinguishes them from entailments, and they are nondetachable, which distinguishes them from conventional implicatures. The core idea is that the choice of a weaker element from a scale of elements ordered in terms of semantic strength (that is, numbers of entailments) tends to implicate that, as far as the speaker knows, none of the stronger elements in the scale holds in this instance. The pattern is quite clear in (1) and (2), where the weak/strong alternatives are some/all and five/six respectively. In the case of (3), the stronger expression must be intelligent and good-hearted which entails intelligent; what Y's utterance implicates is that Mary does not have the two properties: intelligence and good-heartedness, so that, given the proposition expressed (Mary is intelligent) it follows, deductively, that she is not good-hearted, in Y's opinion. The example in (4) involves a scale inversion due to the negation, so that the weak/strong alternatives are not necessarily/not possibly; the negation which the scalar inference generates creates a double negation, which is eliminated giving possibly. (shrink)

The Simplicity and Power (SP) theory (Wolff 2003a) provides support for Pothos's proposals by illustrating how the effect of “rules” and “similarity” may be achieved within an integrated model that makes no explicit provision for either concept. The theory is described here in outline with simple examples to show how rules and similarity can emerge as properties of the system in learning, reasoning, categorization, and the parsing of language.

Probability updating via Bayes' rule often entails extensive informational and computational requirements. In consequence, relatively few practical applications of Bayesian adaptive control techniques have been attempted. This paper discusses an alternative approach to adaptive control, Bayesian in spirit, which shifts attention from the updating of probability distributions via transitional probability assessments to the direct updating of the criterion function, itself, via transitional utility assessments. Results are illustrated in terms of an adaptive reinvestment two-armed bandit problem.

Categorical loudness scaling (CLS) measures provide useful information about an individual’s loudness perception across the dynamic range of hearing. A probability model of CLS categories has previously been described as a multi-category psychometric function (MCPF). In the study, a representative “catalog” of potential listener MCPFs was used in conjunction with maximum-likelihood estimation to derive CLS functions for participants with normal hearing and with hearing loss. The approach of estimating MCPFs for each listener has the potential to improve the accuracy of (...) the CLS measurements, particularly when a relatively low number of data points are available. The present study extends the MCPF approach by using Bayesian inference to select stimulus parameters that are predicted to yield maximum expected information (MEI) during data collection. The accuracy and reliability of the MCPF-MEI approach were compared to the standardized CLS measurement procedure (ISO16832:2006). A non-adaptive, fixed-level, paradigm served as a “gold-standard” for this comparison. The test time required to obtain measurements in the standard procedure is a major barrier to its clinical uptake. Test time was reduced from approximately 15 minutes to approximately 3 minutes with the MEI-adaptive procedure. Results indicated that the test-retest reliability and accuracy of the MCPF-MEI adaptive procedures were similar to the standardized CLS procedure. Computer simulations suggest that the reliability and accuracy of the MEI procedure were limited by intrinsic uncertainty of the listeners represented in the MCPF catalog. In other words, the MCPF provided insufficient predictive power to significantly improve adaptive-tracking efficiency under practical conditions. Concurrent optimization of both the MCPF catalog and the MEI-adaptive procedure have the potential to produce better results. Regardless of the adaptive-tracking method used in the CLS procedure, the MCPF catalog remains clinically useful for enabling maximum-likelihood determination of loudness categories. (shrink)

A central component to scientific practice is the construction and use of scientific models. Scientists believe that the success of a model justifies making claims that go beyond the model itself. However, philosophical analysis of models suggests that drawing inferences about the world from successful models is more complex. In this dissertation I develop a framework that can help disentangle the related strands of evaluation of model success, model extendibility, and the ability to draw ampliative inferences about the world from (...) models. I present and critically assess two leading accounts of model assessment, arguing that neither is sufficient to provide a complete understanding of model evaluation. I introduce a more powerful framework incorporating elements of the two views, which can help answer these three questions: What is the target of evaluation in model assessment? How does that evaluation proceed? What licenses us in making inferences about the real world, based on the evaluation of our models as successful? The framework identifies two distinct targets of model evaluation: representational similarity between the model and target system, and the adequacy of the model as a tool to answer questions. Both assessments must be relativized to a purpose, of which there are three general kinds: descriptive, predictive, and explanatory. These purposes differ in the way they inform the similarity relation, which is relevant for the similarity assessment, and the output they produce, which is relevant for the adequacy assessment. Any model can be assessed relative to any purpose, however a model encodes certain decisions made during the model’s construction, which impact its ability to be applied to a new purpose or new domain. My framework shows that extending a model, and drawing inferences from it, depends on its representational similarity. I apply this framework to several examples taken from astrophysics showing in detail how it can help illuminate the structure of the models, as well as make the justification for inferences made from them clear. The final chapter is a detailed analysis of a contemporary debate surrounding the use of models in astrophysics, between proponents of MOND and the standard ΛCDM model. (shrink)

I discuss the design of the method of entropic inference as a general framework for reasoning under conditions of uncertainty. The main contribution of this discussion is to emphasize the pragmatic elements in the derivation. More specifically: (1) Probability theory is designed as the uniquely natural tool for representing states of incomplete information. (2) An epistemic notion of information is defined in terms of its relation to the Bayesian beliefs of ideally rational agents. (3) The method of updating from (...) a prior to a posterior probability distribution is designed through an eliminative induction process that singles out the logarithmic relative entropy as the unique tool for inference. The resulting framework includes as special cases both MaxEnt and Bayes’ rule. It therefore unifies entropic and Bayesian methods into a single general inference scheme. I find that similar pragmatic elements are an integral part of Putnam’s internal realism, of Floridi’s informational structural realism, and also of van Fraasen’s empiricist structuralism. I conclude with the conjecture that their valuable insights can be incorporated into a single coherent doctrine—an informational pragmatic realism. (shrink)

This paper describes a novel perspective on the foundations of mathematics: how mathematics may be seen to be largely about “information compression via the matching and unification of patterns”. That is itself a novel approach to IC, couched in terms of nonmathematical primitives, as is necessary in any investigation of the foundations of mathematics. This new perspective on the foundations of mathematics reflects the facts that mathematics is almost exclusively the product of human brains, and has been developed, as an (...) aid to human thinking, mathematics is likely to be consonant with much evidence for the importance of IC in human learning, perception, and cognition. This perspective on the foundations of mathematics has grown out of a long-term programme of research developing the SP Theory of Intelligence and its realization in the SP Computer Model, a system in which a generalised version of ICMUP—the powerful concept of SP-multiple-alignment—plays a central role. This paper shows with an example how mathematics, without any special provision, may achieve compression of information. Then, it describes examples showing how variants of ICMUP may be seen in widely used structures and operations in mathematics. Examples are also given to show how several aspects of the mathematics-related disciplines of logic and computing may be understood as ICMUP. Also discussed is the intimate relation between IC and concepts of probability, with arguments that there are advantages in approaching AI, cognitive science, and concepts of probability via ICMUP. Also discussed is how the close relation between IC and concepts of probability relates to the established view that some parts of mathematics are intrinsically probabilistic, and how that latter view may be reconciled with the all-or-nothing, “exact,” forms of calculation or inference that are familiar in mathematics and logic. There are many potential benefits and applications of the mathematics-as-IC perspective. (shrink)

The feature-matching approach pioneered by Amos Tversky remains a groundwork for psychological models of similarity and categorization but is rarely explicitly justified considering recent advances in thinking about cognition. While psychologists often view similarity as an unproblematic foundational concept that explains generalization and conceptual thought, long-standing philosophical problems challenging this assumption suggest that similarity derives from processes of higher-level cognition, including inference and conceptual thought. This paper addresses three specific challenges to Tversky’s approach: (i) the feature-selection problem, (ii) the problem (...) of cognitive implausibility, and (iii) the problem of unprincipled tweaking. It subsequently supports key insights from Tversky’s account based on recent developments in Bayesian modeling of cognition. A novel computational view of similarity as inference is proposed that addresses each challenge by considering the contrast class as constitutive of similarity and selecting for highly informative features. In so doing, this view illustrates the ongoing promise of the feature-matching approach in explaining perception, generalization and conceptual thought by grounding them in principles of probabilistic inference. (shrink)

Bayes’ formula is a fundamental statistical method for inference judgments in uncertain situations used by both laymen and professionals. However, since people often fail in situations where Bayes’ formula can be applied, how to improve their performance in Bayesian situations is a crucial question. We based our research on a widely accepted beneficial strategy in Bayesian situations, representing the statistical information in the form of natural frequencies. In addition to this numerical format, we used five visualizations: a 2×2-table, (...) a unit square, an icon array, a tree diagram, and a double-tree diagram. In an experiment with 688 undergraduate students, we empirically investigated the effectiveness of three graphical properties of visualizations: area-proportionality, use of discrete and countable statistical entities, and graphical transparency of the nested-sets structure. We found no additional beneficial effect of area-proportionality. In contrast, the representation of discrete objects seems to be beneficial. Furthermore, our results show a strong facilitating effect of making the nested-sets structure of a Bayesian situation graphically transparent. Our results contribute to answering the questions of how and why a visualization could facilitate judgment and decision making in situations of uncertainty. (shrink)

Social learning has been shown to be an evolutionarily adaptive strategy, but it can be implemented via many different cognitive mechanisms. The adaptive advantage of social learning depends crucially on the ability of each learner to obtain relevant and accurate information from informants. The source of informants’ knowledge is a particularly important cue for evaluating advice from multiple informants; if the informants share the source of their information or have obtained their information from each other, then their testimony is statistically (...) dependent and may be less reliable than testimony from informants who do not share information. In this study, we use a Bayesian model to determine how rational learners should incorporate the effects of shared information when learning from other people, conducting three experiments that examine whether human learners behave similarly. We find that people are sensitive to a number of different patterns of dependency, supporting the use of a sophisticated strategy for social learning that goes beyond copying the majority, and broadening the situations in which social learning is likely to be an adaptive strategy. (shrink)

Pursuing a precise, focused train of thought requires cognitive effort. Even more effort is necessary when more alternatives need to be considered or when the imagined situation becomes more complex. Cognitive resources available to us limit the cognitive effort we can spend. In line with previous work, an information-theoretic, Bayesian brain approach to cognitive effort is pursued: to solve tasks in our environment, our brain needs to invest information, that is, negative entropy, to impose structure, or focus, away from (...) a uniform structure or other task-incompatible, latent structures. To get a more complete formalization of cognitive effort, a resourceful event-predictive inference model is introduced, which offers computational and algorithmic explanations about the latent structure of our generative models, the active inference dynamics that unfold within, and the cognitive effort required to steer the dynamics—to, for example, purposefully process sensory signals, decide on responses, and invoke their execution. REPI suggests that we invest cognitive resources to infer preparatory priors, activate responses, and anticipate action consequences. Due to our limited resources, though, the inference dynamics are prone to task-irrelevant distractions. For example, the task-irrelevant side of the imperative stimulus causes the Simon effect and, due to similar reasons, we fail to optimally switch between tasks. An actual model implementation simulates such task interactions and offers first estimates of the involved cognitive effort. The approach may be further studied and promises to offer deeper explanations about why we get quickly exhausted from multitasking, how we are influenced by irrelevant stimulus modalities, why we exhibit magnitude interference, and, during social interactions, why we often fail to take the perspective of others into account. (shrink)

Moral hypocrisy is typically viewed as an ethical accusation: Someone is applying different moral standards to essentially identical cases, dishonestly claiming that one action is acceptable while otherwise equivalent actions are not. We suggest that in some instances the apparent logical inconsistency stems from different evaluations of a weak argument, rather than dishonesty per se. Extending Corner, Hahn, and Oaksford's (2006) analysis of slippery slope arguments, we develop a Bayesian framework in which accusations of hypocrisy depend on inferences of (...) shared category membership between proposed actions and previous standards, based on prior probabilities that inform the strength of competing hypotheses. Across three experiments, we demonstrate that inferences of hypocrisy increase as perceptions of the likelihood of shared category membership between precedent cases and current cases increase, that these inferences follow established principles of category induction, and that the presence of self-serving motives increases inferences of hypocrisy independent of changes in the actions themselves. Taken together, these results demonstrate that Bayesian analyses of weak arguments may have implications for assessing moral reasoning. (shrink)

In 1972,Ernst Ulrich and Christine von Weizs ¨acker introduced the concept of pragmatic information with three desiderata:(i) Pragmatic information should assess the impact of a message upon its receiver;(ii)Pragmatic information should vanish in the limits of complete (non-interpretable)'novelty 'and complete 'confirmation';(iii)Pragmatic information should exhibit non-classical properties since novelty and confirmation behave similarly to Fourier pairs of complementary operators in quantum mechanics. It will be shown how these three desiderata can be naturally fulfilled within the framework of Gardenfors' dynamic semantics of (...) Bayesian belief models.(i)The meaning of a message is its impact upon the epistemic states of a cognitive agent. A pragmatic information measure can then be quanti .ed by the average information gain for the transition from a prior to a posterior state.(ii)Total novelty can be represented by the identical proposition, total con- .rmation by the logical consequence of propositions. In both cases, pragmatic information vanishes.(iii)For operators that are neither idempotent nor commuting, novelty and confirmation relative to a message sequence can be defined within Gardenfors' theory of belief revisions.The proposed approach is consistent with measures of relevance derived from statistical decision theory and it contains Bar-Hillel 's and Carnap's theory of semantic information as a special case. (shrink)

In 1972,Ernst Ulrich and Christine von Weizs ¨acker introduced the concept of pragmatic information with three desiderata: Pragmatic information should assess the impact of a message upon its receiver;Pragmatic information should vanish in the limits of complete 'novelty 'and complete 'confirmation';Pragmatic information should exhibit non-classical properties since novelty and confirmation behave similarly to Fourier pairs of complementary operators in quantum mechanics. It will be shown how these three desiderata can be naturally fulfilled within the framework of Gardenfors' dynamic semantics of (...) Bayesian belief models.The meaning of a message is its impact upon the epistemic states of a cognitive agent. A pragmatic information measure can then be quanti .ed by the average information gain for the transition from a prior to a posterior state.Total novelty can be represented by the identical proposition, total con- .rmation by the logical consequence of propositions. In both cases, pragmatic information vanishes.For operators that are neither idempotent nor commuting, novelty and confirmation relative to a message sequence can be defined within Gardenfors' theory of belief revisions.The proposed approach is consistent with measures of relevance derived from statistical decision theory and it contains Bar-Hillel 's and Carnap's theory of semantic information as a special case. (shrink)

Mainstream social psychology focuses on how people characteristically violate norms of action through social misbehaviors such as conformity with false majority judgments, destructive obedience, and failures to help those in need. Likewise, they are seen to violate norms of reasoning through cognitive errors such as misuse of social information, self-enhancement, and an over-readiness to attribute dispositional characteristics. The causes of this negative research emphasis include the apparent informativeness of norm violation, the status of good behavior and judgment as unconfirmable null (...) hypotheses, and the allure of counter-intuitive findings. The shortcomings of this orientation include frequently erroneous imputations of error, findings of mutually contradictory errors, incoherent interpretations of error, an inability to explain the sources of behavioral or cognitive achievement, and the inhibition of generalized theory. Possible remedies include increased attention to the complete range of behavior and judgmental accomplishment, analytic reforms emphasizing effect sizes and Bayesian inference, and a theoretical paradigm able to account for both the sources of accomplishment and of error. A more balanced social psychology would yield not only a more positive view of human nature, but also an improved understanding of the bases of good behavior and accurate judgment, coherent explanations of occasional lapses, and theoretically grounded suggestions for improvement. Key Words: Bayesian inference; biases; normative models; personality; positive psychology; rationality; reasoning; social behavior; social judgment; social psychology. (shrink)