Off-campus access
Using PhilPapers from home?
Click here to configure this browser for off-campus access.
- Aidan Feeney, Jonathan Evans & Simon Venn (2008). Rarity, Pseudodiagnosticity and Bayesian Reasoning. Thinking and Reasoning 14 (3):209 – 230.Three experiments investigated the effect of rarity on people's selection and interpretation of data in a variant of the pseudodiagnosticity task. For familiar (Experiment 1) but not for arbitrary (Experiment 3) materials, participants were more likely to select evidence so as to complete a likelihood ratio when the initial evidence they received was a single likelihood concerning a rare feature. This rarity effect with familiar materials was replicated in Experiment 2 where it was shown that participants were relatively insensitive to explicit manipulations of the likely diagnosticity of rare evidence. In contrast to the effects for data selection, there was an effect of rarity on confidence ratings after receipt of a single likelihood for arbitrary but not for familiar materials. It is suggested that selecting diagnostic evidence necessitates explicit consideration of the alternative hypothesis and that consideration of the possible consequences of the evidence for the alternative weakens the rarity effect in confidence ratings. Paradoxically, although rarity effects in evidence selection and confidence ratings are in the spirit of Bayesian reasoning, the effect on confidence ratings appears to rely on participants thinking less about the alternative hypothesis.
Similar books and articles
In this paper the arguments for optimal data selection and the contrast class account of negations in the selection task and the conditional inference task are summarised, and contrasted with the matching bias approach. It is argued that the probabilistic contrast class account provides a unified, rational explanation for effects across these tasks. Moreover, there are results that are only explained by the contrast class account that are also discussed. The only major anomaly is the explicit negations effect in the selection task (Evans, Clibbens, & Rood, 1996), which it is argued may not be the result of normal interpretative processes. It is concluded that the effects of negation on human reasoning provide good evidence for the view that human reasoning processes may be rational according to a probabilistic standard.
No categories
Three experiments investigated the malleability of perceived plausibility and the subjective likelihood of occurrence of plausible and implausible events among participants who had no recollection of experiencing them. In Experiment 1, a plausibility-enhancing manipulation (reading accounts of the occurrence of events) combined with a personalized suggestion increased the perceived plausibility of the implausible event, as well as participants' ratings of the likelihood that they had experienced it. Plausibility and likelihood ratings were uncorrelated. Subsequent studies showed that the plausibility manipulation alone was sufficient to increase likelihood ratings but only if the accounts that participants read were set in a contemporary context. These data suggest that false autobiographical beliefs can be induced in clinical and forensic contexts even for initially implausible events.
No categories
Four experiments investigated how people judge the plausibility of category-based arguments, focusing on the diversity effect, in which arguments with diverse premise categories are considered particularly strong. In Experiment 1 we show that priming people as to the nature of the blank property determines whether sensitivity to diversity is observed. In Experiment 2 we find that people's hypotheses about the nature of the blank property predict judgements of argument strength. In Experiment 3 we examine the effect of our priming methodology on people's tendency to bring knowledge about causality or similarity to bear when evaluating arguments, and in Experiment 4 we show that whether people's hypotheses about the nature of the blank property were causal predicted ratings of argument strength. Together these results suggest that diversity effects occur because diverse premises lead people to bring general features of the premise categories to mind. Although our findings are broadly consistent with Bayesian and Relevance-based approaches to category-based inductive reasoning, neither approach captures all of our findings.
Research on preference reversals has demonstrated a disproportionate influence of outcome probability on choices between monetary gambles. The aim was to investigate the hypothesis that this is a prominence effect originally demonstrated for riskless choice. Another aim was to test the structure compatibility hypothesis as an explanation of the effect. The hypothesis implies that probability should be the prominent attribute when compared with value attributes both in a choice and a preference rating procedure. In Experiment 1, two groups of undergraduates were presented with medical treatments described by two value attributes (effectiveness and pain-relief). All participants performed both a matching task and made preference ratings. In the latter task, outcome probabilities were added to the descriptions of the medical treatments for one of the groups. In line with the hypothesis, this reduced the prominence effect on the preference ratings observed for effectiveness. In Experiment 2, a matching task was used to demonstrate that probability was considered more important by a group of participating undergraduates than the value attributes. Furthermore, in both choices and preference ratings the expected prominence effect was found for probability.
In Bayesian epistemology, the concept of one proposition’s being evidence for another is explained along the following lines. Given a measure of degrees of confidence, con(...), that conforms to standard probability axioms: (EV) a proposition e is evidence for a proposition h iff con(h|e) is greater than con(h). (Con(h|e) is the degree of confidence in h given e, and is defined as con(h and e)/con(e).) Proposals along these lines, however, have been dogged by what Clark Glymour called the Problem of Old Evidence.[i] (EV) apparently precludes a theory being confirmed by evidence that is already in. For if a potentially evidential proposition, e, is already known, then con(e)=1. One can be subjectively certain of propositions already known to be true. But by definition of con(h|e), where con(e)=1, con(h|e) will always be equal to, and hence never greater than, con(h). Not only does (EV) preclude one from confirming new theories on the basis of information already gathered. Suppose Q is some proposition of which we are now uncertain, but which is evidence for a scientific hypothesis P. That is, con(P|Q) is greater than con(P). If we now devise an experiment to test whether Q, perform the experiment, and become certain that Q, it will no longer count as evidence for P. Thus, if we accept (EV), gathering new evidence to support a theory actually has quite the opposite effect. Gathering the evidence destroys its quality as evidence.
Oaksford and Chater (1994) proposed to analyse the Wason selection task as an inductive instead of a deductive task. Applying Bayesian statistics, they concluded that the cards that participants tend to select are those with the highest expected information gain. Therefore, their choices seem rational from the perspective of optimal data selection. We tested a central prediction from the theory in three experiments: card selection frequencies should be sensitive to the subjective probability of occurrence for individual cards. In Experiment 1, expected frequencies of the p- and the q-card were manipulated independently by concepts referring to large vs. small sets. Although the manipulation had an effect on card selection frequencies, there was only a weak correlation between the predicted and the observed patterns. In the second experiment, relative frequencies of individual cards were manipulated more directly by explicit frequency information. In addition, participants estimated probabilities for the four logical cases and of the conditional statement itself. The experimental manipulations strongly affected the probability estimates, but were completely unrelated to card selections. This result was replicated in a third experiment. We conclude that our data provide little support for optimal data selection theory.
Four experiments investigated the effects of probability manipulations on the indicative four card selection task (Wason, 1966, 1968). All looked at the effects of high and low probability antecedents (p) and consequents (q) on participants' data selections when determining the truth or falsity of a conditional rule, if p then q . Experiments 1 and 2 also manipulated believability. In Experiment 1, 128 participants performed the task using rules with varied contents pretested for probability of occurrence. Probabilistic effects were observed which were partly consistent with some probabilistic accounts but not with non-probabilistic approaches to selection task performance. No effects of believability were observed, a finding replicated in Experiment 2 which used 80 participants with standardised and familiar contents. Some effects in this experiment appeared inconsistent with existing probabilistic approaches. To avoid possible effects of content, Experiments 3 (48 participants) and 4 (20 participants) used abstract material. Both experiments revealed probabilistic effects. In the Discussion we examine the compatibility of these results with the various models of selection task performance.
No categories
It has been reported as a robust effect that people are likely to select a matching case in the Wason selection task. For example, they usually select the 5 case, in the Wason selection task with the conditional "if an E, then a not-5". This was explained by the matching bias account that people are likely to regard a matching case as relevant to the truth of the conditional (Evans, 1998). However, because a positive concept usually constructs a smaller set than its negative one does (a rarity assumption), it is more effective to get information on the truth of the conditional in a positive set than in a negative set. Thus the optimal data selection account can also explain the effect. The set size of Q and matching by introducing negation were manipulated independently in four experiments. From the results it was inferred that the so-called matching bias was an amalgam of two different cognitive components-relevance judgement by matching and optimal data selection.
No categories
In this paper we argue that it is often adaptive to use one's background beliefs when interpreting information that, from a normative point of view, is incomplete. In both of the experiments reported here participants were presented with an item possessing two features and were asked to judge, in the light of some evidence concerning the features, to which of two categories it was more likely that the item belonged. It was found that when participants received evidence relevant to just one of these hypothesised categories (i.e. evidence that did not form a Bayesian likelihood ratio) they used their background beliefs to interpret this information. In Experiment 2, on the other hand, participants behaved in a broadly Bayesian manner when the evidence they received constituted a completed likelihood ratio. We discuss the circumstances under which participants, when making their judgements, consider the alternative hypothesis. We conclude with a discussion of the implications of our results for an understanding of hypothesis testing, belief revision, and categorisation.
Three experiments investigated the effect of rarity on people's selection and interpretation of data in a variant of the pseudodiagnosticity task. For familiar (Experiment 1) but not for arbitrary (Experiment 3) materials, participants were more likely to select evidence so as to complete a likelihood ratio when the initial evidence they received was a single likelihood concerning a rare feature. This rarity effect with familiar materials was replicated in Experiment 2 where it was shown that participants were relatively insensitive to explicit manipulations of the likely diagnosticity of rare evidence. In contrast to the effects for data selection, there was an effect of rarity on confidence ratings after receipt of a single likelihood for arbitrary but not for familiar materials. It is suggested that selecting diagnostic evidence necessitates explicit consideration of the alternative hypothesis and that consideration of the possible consequences of the evidence for the alternative weakens the rarity effect in confidence ratings. Paradoxically, although rarity effects in evidence selection and confidence ratings are in the spirit of Bayesian reasoning, the effect on confidence ratings appears to rely on participants thinking less about the alternative hypothesis.
Discussion of Aidan Feeney , Jonathan Evans & Simon Venn, Rarity, pseudodiagnosticity and bayesian reasoning
|
|
There are no threads in this forum |
Nothing in this forum yet.

