In this article, we develop a hierarchical Bayesian model of learning in a general type of artificial language‐learning experiment in which learners are exposed to a mixture of grammars representing the variation present in real learners’ input, particularly at times of language change. The modeling goal is to formalize and quantify hypothesized learning biases. The test case is an experiment (Culbertson, Smolensky, & Legendre, 2012) targeting the learning of word‐order patterns in the nominal domain. The model identifies (...) internal biases of the experimental participants, providing evidence that learners impose (possibly arbitrary) properties on the grammars they learn, potentially resulting in the cross‐linguistic regularities known as typological universals. Learners exposed to mixtures of artificial grammars tended to shift those mixtures in certain ways rather than others; the model reveals how learners’ inferences are systematically affected by specific prior biases. These biases are in line with a typological generalization—Greenberg's Universal 18—which bans a particular word‐order pattern relating nouns, adjectives, and numerals. (shrink)

How can an incomplete and uncertain model of the environment be used to perceive, infer, decide and act efficiently? This is the challenge that both living and artificial cognitive systems have to face. Symbolic logic is, by its nature, unable to deal with this question. The subjectivist approach to probability is an extension to logic that is designed specifically to face this challenge. In this paper, we review a number of frequently encountered cognitive issues and cast them into a (...) common Bayesian formalism. The concepts we review are ambiguities, fusion, multimodality, conflicts, modularity, hierarchies and loops. First, each of these concepts is introduced briefly using some examples from the neuroscience, psychophysics or robotics literature. Then, the concept is formalized using a template Bayesian model. The assumptions and common features of these models, as well as their major differences, are outlined and discussed. (shrink)

We argue that the authors’ call to integrate Bayesian models more strongly with algorithmic- and implementational-level models must go hand in hand with a call for a fully developed account of algorithmic rationality. Without such an account, the integration of levels would come at the expense of the explanatory benefit that rational models provide.

A long tradition suggests a fundamental distinction between situations of risk, where true objective probabilities are known, and unmeasurable uncertainties where no such probabilities are given. This distinction can be captured in a Bayesian model where uncertainty is represented by the agent’s subjective belief over the parameter governing future income streams. Whether uncertainty reduces to ordinary risk depends on the agent’s ability to smooth consumption. Uncertainty can have a major behavioral and economic impact, including precautionary behavior that may (...) appear overly conservative to an outside observer. We argue that one of the main characteristics of uncertain beliefs is that they are not empirical, in the sense that they cannot be objectively tested to determine whether they are right or wrong. This can confound empirical methods that assume rational expectations. (shrink)

The mechanisms by which delusion and anxiety affect the tendency to make hasty decisions (Jumping-to-Conclusions bias) remain unclear. This paper proposes a Bayesian computational model that explores the assignment of evidence weights as a potential explanation of the Jumping-to-Conclusions bias using the Beads Task. We also investigate the Beads Task as a repeated measure by varying the key aspects of the paradigm. The Bayesian model estimations from two online studies showed that higher delusional ideation promoted reduced (...) belief updating but the impact of general and social anxiety on evidence weighting was inconsistent. The altered evidence weighting as a result of a psychopathological trait appeared insufficient in contributing to the Jumping-to-Conclusions bias. Variations in Beads Task aspects significantly affected subjective certainty at the point of decisions but not the number of draws to decisions. Repetitions of the Beads Task are feasible if one assesses the Jumping-to-Conclusions bias using number of draws to decisions. (shrink)

The Capgras delusion is a condition in which a person believes that an imposter has replaced some close friend or relative. Recent theorists have appealed to Bayesianism to help explain both why a subject with the Capgras delusion adopts this delusional belief and why it persists despite counter-evidence. The Bayesian approach is useful for addressing these questions; however, the main proposal of this essay is that Capgras subjects also have a delusional conception of epistemic possibility, more specifically, they think (...) more things are possible, given what is known, than non-delusional subjects do. I argue that this is a central way in which their thinking departs from ordinary cognition and that it cannot be characterized in Bayesian terms. Thus, in order to fully understand the cognitive processing involved in the Capgras delusion, we must move beyond Bayesianism. 1 The Simple Bayesian Model2 Anomalous Evidence and the Capgras Delusion3 Impaired Reasoning4 Setting Priors5 Epistemic Modality6 Delusions of Possibility7 Delusions of Possibility in Different Contexts8 How Many Factors? (shrink)

Bayesian paradigm has been widely acknowledged as a coherent approach to learning putative probability model structures from a finite class of candidate models. Bayesian learning is based on measuring the predictive ability of a model in terms of the corresponding marginal data distribution, which equals the expectation of the likelihood with respect to a prior distribution for model parameters. The main controversy related to this learning method stems from the necessity of specifying proper prior distributions (...) for all unknown parameters of a model, which ensures a complete determination of the marginal data distribution. Even for commonly used models, subjective priors may be difficult to specify precisely, and therefore, several automated learning procedures have been suggested in the literature. Here we introduce a novel Bayesian learning method based on the predictive entropy of a probability model, that can combine both subjective and objective probabilistic assessment of uncertain quantities in putative models. It is shown that our approach can avoid some of the limitations of the earlier suggested objective Bayesian methods. (shrink)

This article explores some of the philosophical implications of the Bayesian modeling paradigm. In particular, it focuses on the ramifications of the fact that Bayesian models pre‐specify an inbuilt hypothesis space. To what extent does this pre‐specification correspond to simply ‘‘building the solution in''? I argue that any learner must have a built‐in hypothesis space in precisely the same sense that Bayesian models have one. This has implications for the nature of learning, Fodor's puzzle of concept acquisition, (...) and the role of modeling in cognitive science. (shrink)

According to [Bayesian] models” in cognitive neuroscience, says a recent textbook, “the human mind behaves like a capable data scientist”. Do they? That is to say, do such model show we are rational? I argue that Bayesian models of cognition, perhaps surprisingly, do not and indeed cannot, show that we are Bayesian-rational. The key reason is that such models appeal to approximations, a fact that carries significant implications. After outlining the argument, I critique two responses, seen (...) in recent cognitive neuroscience. One says that the mind can be seen as approximately Bayes-rational, while the other reconceives norms of rationality. (shrink)

Bayesian approaches to legal reasoning propose causal models of the relation between evidence, the credibility of evidence, and ultimate hypotheses, or verdicts. They assume that legal reasoning is the process whereby one infers the posterior probability of a verdict based on observed evidence, or facts. In practice, legal reasoning does not operate quite that way. Legal reasoning is also an attempt at inferring applicable rules derived from legal precedents or statutes based on the facts at hand. To make such (...) an inference, legal reasoning follows syllogistic logic and first order transitivity. This paper proposes a Bayesian model of legal syllogistic reasoning that complements existing Bayesian models of legal reasoning using a Bayesian network whose variables correspond to legal precedents, statutes, and facts. We suggest that legal reasoning should be modelled as a process of finding the posterior probability of precedents and statutes based on available facts. (shrink)

(2013). Hierarchical Bayesian models as formal models of causal reasoning. Argument & Computation: Vol. 4, Formal Models of Reasoning in Cognitive Psychology, pp. 36-45. doi: 10.1080/19462166.2012.700321.

Bayesian model selection has frequently been the focus of philosophical inquiry (e.g., Forster, Br J Philos Sci 46:399–424, 1995; Bandyopadhyay and Boik, Philos Sci 66:S390–S402, 1999; Dowe et al., Br J Philos Sci 58:709–754, 2007). This paper argues that Bayesian model selection procedures are very diverse in their inferential target and their justification, and substantiates this claim by means of case studies on three selected procedures: MML, BIC and DIC. Hence, there is no tight link between (...) Bayesian model selection and Bayesian philosophy. Consequently, arguments for or against Bayesian reasoning based on properties of Bayesian model selection procedures should be treated with great caution. (shrink)

We derive a probabilistic account of the vagueness and context-sensitivity of scalar adjectives from a Bayesian approach to communication and interpretation. We describe an iterated-reasoning architecture for pragmatic interpretation and illustrate it with a simple scalar implicature example. We then show how to enrich the apparatus to handle pragmatic reasoning about the values of free variables, explore its predictions about the interpretation of scalar adjectives, and show how this model implements Edgington’s Vagueness: a reader, 1997) account of the (...) sorites paradox, with variations. The Bayesian approach has a number of explanatory virtues: in particular, it does not require any special-purpose machinery for handling vagueness, and it is integrated with a promising new approach to pragmatics and other areas of cognitive science. (shrink)

We consider human performance on an optimal stopping problem where people are presented with a list of numbers independently chosen from a uniform distribution. People are told how many numbers are in the list, and how they were chosen. People are then shown the numbers one at a time, and are instructed to choose the maximum, subject to the constraint that they must choose a number at the time it is presented, and any choice below the maximum is incorrect. We (...) present empirical evidence that suggests people use threshold-based models to make decisions, choosing the first currently maximal number that exceeds a fixed threshold for that position in the list. We then develop a hierarchical generative account of this model family, and use Bayesian methods to learn about the parameters of the generative process, making inferences about the threshold decision models people use. We discuss the interesting aspects of human performance on the task, including the lack of learning, and the presence of large individual differences, and consider the possibility of extending the modeling framework to account for individual differences. We also use the modeling results to discuss the merits of hierarchical, generative and Bayesian models of cognitive processes more generally. (shrink)

Although some previous studies have investigated the relationship between moral foundations and moral judgment development, the methods used have not been able to fully explore the relationship. In the present study, we used Bayesian Model Averaging (BMA) in order to address the limitations in traditional regression methods that have been used previously. Results showed consistency with previous findings that binding foundations are negatively correlated with post-conventional moral reasoning and positively correlated with maintaining norms and personal interest schemas. In (...) addition to previous studies, our results showed a positive correlation for individualizing foundations and post-conventional moral reasoning. Implications are discussed as well as a detailed explanation of the novel BMA method in order to allow others in the field of moral education to be able to use it in their own studies. (shrink)

The "myside bias'' in evaluating arguments is an empirically well-confirmed phenomenon that consists of overweighting arguments that endorse one's beliefs or attack alternative beliefs while underweighting arguments that attack one's beliefs or defend alternative beliefs. This paper makes two contributions: First, it proposes a probabilistic model that adequately captures three salient features of myside bias in argument evaluation. Second, it provides a Bayesian justification of this model, thus showing that myside bias has a rational Bayesian explanation (...) under certain conditions. (shrink)

Analysts often use data-driven approaches to supplement their knowledge when selecting covariates for effect estimation. Multiple variable selection procedures for causal effect estimation have been devised in recent years, but additional developments are still required to adequately address the needs of analysts. We propose a generalized Bayesian causal effect estimation algorithm to perform variable selection and produce double robust estimates of causal effects for binary or continuous exposures and outcomes. GBCEE employs a prior distribution that targets the selection of (...) true confounders and predictors of the outcome for the unbiased estimation of causal effects with reduced standard errors. The Bayesian machinery allows GBCEE to directly produce inferences for its estimate. In simulations, GBCEE was observed to perform similarly or to outperform DR alternatives. Its ability to directly produce inferences is also an important advantage from a computational perspective. The method is finally illustrated for the estimation of the effect of meeting physical activity recommendations on the risk of hip or upper-leg fractures among older women in the study of osteoporotic fractures. The 95% confidence interval produced by GBCEE is 61% narrower than that of a DR estimator adjusting for all potential confounders in this illustration. (shrink)

Bayesian models of legal arguments generally aim to produce a single integrated model, combining each of the legal arguments under consideration. This combined approach implicitly assumes that variables and their relationships can be represented without any contradiction or misalignment, and in a way that makes sense with respect to the competing argument narratives. This paper describes a novel approach to compare and ‘average’ Bayesian models of legal arguments that have been built independently and with no attempt to (...) make them consistent in terms of variables, causal assumptions or parameterization. The approach involves assessing whether competing models of legal arguments are explained or predict facts uncovered before or during the trial process. Those models that are more heavily disconfirmed by the facts are given lower weight, as model plausibility measures, in the Bayesian model comparison and averaging framework adopted. In this way a plurality of arguments is allowed yet a single judgement based on all arguments is possible and rational. (shrink)

본 연구는 “교육학적 추론을 위한 베이지언 모델”의 형식적 타당성 및 이 모델이 갖는 교육학적 함의와 인식론적 함의에 대해 비판적으로 검토한다.BR 베이즈주의 학습이론가들에 따르면, 교육학적 목표를 가장 잘 성취하기 위해서는 “정확한 가설”(h)에 대한 학습자의 믿음을 최대화하는 “데이터”(d)를 교사가 선택해야 한다. 달리 말하면, 학생이 추측하는 문제의 가설(개념)이 교사가 목표로 하는 바로 그 가설(개념)에 최대로 가까워지게 하는 예시를 교사가 학생에게 제공해야 한다. 이를 위해서는 교사가 생산하는 “데이터의 분포”(p teacher (d｜h))가 “가설(h)에 대한 학습자의 사후 믿음”(p learner (h｜d))을 최대화하는 데이터들을 중심으로 균등하게 분포되어야 할 것이다. (...) 학생은 처음부터 문제의 개념을 소유하고 있지 않다. 학생은 교사가 제공하는 예시를 통해서 비로소 개념을 구성해야 하는 위치에 있다. 이를 위해서 우선 교사는 학생의 인지 상태를 알고 있어야 한다. 즉 학생이 어떤 데이터를 접하게 될 때, 어떤 개념을 상상할 것이라고 교사는 예측해야 한다. 결국 교사는 “p teacher (d｜h)” 와 “p learner (h｜d)”, 양자 모두를 알아야 한다. 이러한 맥락에서 교사가 활용할 수 있는 모델이 아래와 같은 방정식이다.BR 이것이 베이지언 학습이론가들이 지지하는 “교육학적 추론 모델”이다. 그들에 따르면, 이 방정식의 해는 문제의 개념(가설)을 가장 잘 전달하게 할 예시 선택을 가능하게 하는 대안이다. 그런데 이 모델이 구체적 교육 현장에서 어떻게 적용될 수 있는가를 보기 위해서, 또한 이 모델이 가지는 논리-형식적 타당성 및 교육-인식론적 함의를 이해하기 위해서, 필자는 베이지언 이론가들이 제시하는 많은 예시들 중에서 가장 단순한 예시인 “선 게임 이론”(theory of line game)을 분석하고자 한다.BR. (shrink)

The prominence of Bayesian modeling of cognition has increased recently largely because of mathematical advances in specifying and deriving predictions from complex probabilistic models. Much of this research aims to demonstrate that cognitive behavior can be explained from rational principles alone, without recourse to psychological or neurological processes and representations. We note commonalities between this rational approach and other movements in psychology – namely, Behaviorism and evolutionary psychology – that set aside mechanistic explanations or make use of optimality assumptions. (...) Through these comparisons, we identify a number of challenges that limit the rational program's potential contribution to psychological theory. Specifically, rational Bayesian models are significantly unconstrained, both because they are uninformed by a wide range of process-level data and because their assumptions about the environment are generally not grounded in empirical measurement. The psychological implications of most Bayesian models are also unclear. Bayesian inference itself is conceptually trivial, but strong assumptions are often embedded in the hypothesis sets and the approximation algorithms used to derive model predictions, without a clear delineation between psychological commitments and implementational details. Comparing multiple Bayesian models of the same task is rare, as is the realization that many Bayesian models recapitulate existing (mechanistic level) theories. Despite the expressive power of current Bayesian models, we argue they must be developed in conjunction with mechanistic considerations to offer substantive explanations of cognition. We lay out several means for such an integration, which take into account the representations on which Bayesian inference operates, as well as the algorithms and heuristics that carry it out. We argue this unification will better facilitate lasting contributions to psychological theory, avoiding the pitfalls that have plagued previous theoretical movements. (shrink)

This paper provides a model of belief representation in which ambiguity and unambiguity are endogenously distinguished in a purely subjective setting where objects of choices are, as usual, maps from states to consequences. Specifically, I first extend the maxmin expected utility theory and get a representation of beliefs such that the probabilistic beliefs over each ambiguous event are represented by a non-degenerate interval, while the ones over each unambiguous event are represented by a number. I then consider a class (...) of the biseparable preferences. Two representation results are achieved and can be used to identify the unambiguity in the context of the biseparable preferences. Finally a subjective definition of ambiguity is suggested. It provides a choice theoretic foundation for the Knightian distinction between ambiguity and unambiguity. (shrink)

According to a growing trend in theoretical neuroscience, the human perceptual system is akin to a Bayesian machine. The aim of this article is to clearly articulate the claims that perception can be considered Bayesian inference and that the brain can be considered a Bayesian machine, some of the epistemological challenges to these claims; and some of the implications of these claims. We address two questions: (i) How are Bayesian models used in theoretical neuroscience? (ii) From (...) the use of Bayesian models in theoretical neuroscience, have we learned or can we hope to learn that perception is Bayesian inference or that the brain is a Bayesian machine? From actual practice in theoretical neuroscience, we argue for three claims. First, currently Bayesian models do not provide mechanistic explanations; instead they are useful devices for predicting and systematizing observational statements about people's performances in a variety of perceptual tasks. That is, currently we should have an instrumentalist attitude towards Bayesian models in neuroscience. Second, the inference typically drawn from Bayesian behavioural performance in a variety of perceptual tasks to underlying Bayesian mechanisms should be understood within the three-level framework laid out by David Marr ( [1982] ). Third, we can hope to learn that perception is Bayesian inference or that the brain is a Bayesian machine to the extent that Bayesian models will prove successful in yielding secure and informative predictions of both subjects' perceptual performance and features of the underlying neural mechanisms. (shrink)

본고는 딥러닝의 이미지 인식 원리와 유아의 이미지 인식 원리를 종합하면서, 이미지-개념 학습을 위한 새로운 교수학습모델, 즉 “베이지안 구조구성주의 교수학습모델”(Bayesian Structure-constructivist Teaching-learning Model: BSTM)을 제안한다. 달리 말하면, 기계학습 원리와 인간학습 원리를 비교함으로써 얻게 되는 시너지 효과를 바탕으로, 유아들의 이미지-개념 학습을 위한 새로운 교수 모델을 구성하는 것을 목표로 한다. 이런 맥락에서 본고는 전체적으로 3가지 차원에서 논의된다. 첫째, 아동의 이미지 학습에 대한 역사적 중요 이론인 “대상 전체론적 가설”, “분류학적 가설”, “배타적 가설”, “기본 수준 범주 가설” 등을 역사 비판적 관점에서 검토한다. 둘째, (...) 컴퓨터 공학에서 전개된 머신러닝의 이미지 학습 원리 및 그 구조의 역사적 변형들에 대해서 비판적으로 분석하면서, 특히 딥러닝의 교육 인식론적 의미를 도출한다. 셋째, 선행하는 논의들을 토대로 이미지와 개념을 연결시키는 학습, 즉 단어학습을 위한 필자의 고유한 이론인 구조구성주의 개념교수모델을 제안한다. 이때 필자는 피아제의 명제논리학적 학습 가설, 즉 논리-수학적 구조를 중시하는 기존의 피아제 학파의 학습 가설과 최근의 베이지안 학습 이론에서 강조된 확률론적 추론 가설, 특히 “교육학적 추론 가설”을 동시에 포함할 수 있는 교수학습모델의 구조 및 주요 지향점들을 제안한다. (shrink)

The basic Bayesian model of credence states, where each individual’s belief state is represented by a single probability measure, has been criticized as psychologically implausible, unable to represent the intuitive distinction between precise and imprecise probabilities, and normatively unjustifiable due to a need to adopt arbitrary, unmotivated priors. These arguments are often used to motivate a model on which imprecise credal states are represented by sets of probability measures. I connect this debate with recent work in (...) class='Hi'>Bayesian cognitive science, where probabilistic models are typically provided with explicit hierarchical structure. Hierarchical Bayesian models are immune to many classic arguments against single-measure models. They represent grades of imprecision in probability assignments automatically, have strong psychological motivation, and can be normatively justified even when certain arbitrary decisions are required. In addition, hierarchical models show much more plausible learning behavior than flat representations in terms of sets of measures, which—on standard assumptions about update—rule out simple cases of learning from a starting point of total ignorance. (shrink)

Learning is fundamentally about action, enabling the successful navigation of a changing and uncertain environment. The experience of pain is central to this process, indicating the need for a change in action so as to mitigate potential threat to bodily integrity. This review considers the application of Bayesian models of learning in pain that inherently accommodate uncertainty and action, which, we shall propose are essential in understanding learning in both acute and persistent cases of pain.

Bayesian models of human learning are becoming increasingly popular in cognitive science. We argue that their purported confirmation largely relies on a methodology that depends on premises that are inconsistent with the claim that people are Bayesian about learning and inference. Bayesian models in cognitive science derive their appeal from their normative claim that the modeled inference is in some sense rational. Standard accounts of the rationality of Bayesian inference imply predictions that an agent selects the (...) option that maximizes the posterior expected utility. Experimental confirmation of the models, however, has been claimed because of groups of agents that probability match the posterior. Probability matching only constitutes support for the Bayesian claim if additional unobvious and untested (but testable) assumptions are invoked. The alternative strategy of weakening the underlying notion of rationality no longer distinguishes the Bayesian model uniquely. A new account of rationality—either for inference or for decision-making—is required to successfully confirm Bayesian models in cognitive science. (shrink)

The Recursive Bayesian Net formalism was originally developed for modelling nested causal relationships. In this paper we argue that the formalism can also be applied to modelling the hierarchical structure of mechanisms. The resulting network contains quantitative information about probabilities, as well as qualitative information about mechanistic structure and causal relations. Since information about probabilities, mechanisms and causal relations is vital for prediction, explanation and control respectively, an RBN can be applied to all these tasks. We show in particular (...) how a simple two-level RBN can be used to model a mechanism in cancer science. The higher level of our model contains variables at the clinical level, while the lower level maps the structure of the cell's mechanism for apoptosis. (shrink)

Bayesian Rationality (Oaksford & Chater 2007) illustrates the strengths of Bayesian models of cognition: the systematicity of rational explanations, transparent assumptions about human learners, and combining structured symbolic representation with statistics. However, the book also highlights some of the challenges this approach faces: of providing psychological mechanisms, explaining the origins of the knowledge that guides human learning, and accounting for how people make genuinely new discoveries.

The principle of compositionality claims that the content of a complex concept is determined by its constituent concepts and the way in which they are composed. However, for prototype concepts this principle is often too rigid. Blurring the division between conceptual composition and belief update has therefore been suggested. Inspired by this idea, we develop a normative account of how belief revision and meaning composition should interact in modifications such as “red apple” or “pet hamster”. We do this by combining (...) the well-known selective modification model :485–527 1988) with the rules of Bayesian belief update. Moreover, we relate this model to systems of defeasible reasoning as discussed in the field of artificial intelligence. (shrink)

For decisions between many alternatives, the benchmark result is Hick's Law: that response time increases log-linearly with the number of choice alternatives. Even when Hick's Law is observed for response times, divergent results have been observed for error rates—sometimes error rates increase with the number of choice alternatives, and sometimes they are constant. We provide evidence from two experiments that error rates are mostly independent of the number of choice alternatives, unless context effects induce participants to trade speed for accuracy (...) across conditions. Error rate data have previously been used to discriminate between competing theoretical accounts of Hick's Law, and our results question the validity of those conclusions. We show that a previously dismissed optimal observer model might provide a parsimonious account of both response time and error rate data. The model suggests that people approximate Bayesian inference in multi-alternative choice, except for some perceptual limitations. (shrink)

The great advantage of Tenenbaum and Griffiths's model is that it incorporates both specific and general prior knowledge into category learning. Two phenomena are presented as supporting the detailed assumptions of this model. However, one phenomenon, effects of diversity, does not seem to require these assumptions, and the other phenomenon, effects of sample size, is not representative of most reported results. [Tenenbaum & Griffiths].