Moral, social, political, and other “nonepistemic” values can lead to bias in science, from prioritizing certain topics over others to the rationalization of questionable research practices. Such values might seem particularly common or powerful in the social sciences, given their subject matter. However, I argue first that the well-documented phenomenon of motivated reasoning provides a useful framework for understanding when values guide scientific inquiry (in pernicious or productive ways). Second, this analysis reveals a parity thesis: values influence the (...) social and natural sciences about equally, particularly because both are so prominently affected by desires for social credit and status, including recognition and career advancement. Ultimately, bias in natural and social science is both natural and social— that is, a part of human nature and considerably motivated by a concern for social status (and its maintenance). Whether the pervasive influence of values is inimical to the sciences is a separate question. (shrink)

Many scientists routinely generalize from study samples to larger populations. It is commonly assumed that this cognitive process of scientific induction is a voluntary inference in which researchers assess the generalizability of their data and then draw conclusions accordingly. We challenge this view and argue for a novel account. The account describes scientific induction as involving by default a generalization bias that operates automatically and frequently leads researchers to unintentionally generalize their findings without sufficient evidence. The result is unwarranted, (...) overgeneralized conclusions. We support this account of scientific induction by integrating a range of disparate findings from across the cognitive sciences that have until now not been connected to research on the nature of scientific induction. The view that scientific induction involves by default a generalization bias calls for a revision of the current thinking about scientific induction and highlights an overlooked cause of the replication crisis in the sciences. Commonly proposed interventions to tackle scientific overgeneralizations that may feed into this crisis need to be supplemented with cognitive debiasing strategies against generalization bias to most effectively improve science. (shrink)

This book is about Addressing Gender Bias in Science & Technology.

The question of bias in methodology and terminology is a problem that faces researchers east, west, north and south; however, it faces Third World intellectuals with special keenness. For although they write in a cultural environment that has its own specific conceptual and cultural paradigms, they nevertheless encounter a foreign paradigm which attempts to impose itself upon their society and upon their very imagination and thoughts. When the term “developmental psychology” for instance is used in the West Arab scholars (...) also say “developmental psychology”, when “applied psychology” is mentioned they hurry to use the same term etc. Why not establish a new science with its own mechanisms, methodologies and points of reference to deal with epistemological biases and open up the gate of ijtihad with respect to them? This collection of papers aims to discover some of the biases latent in our terminology, methodologies, research tools, and conceptual principles, and to propose alternative ones marked by a greater degree of independence and neutrality. This is not to belittle the human value of the West’s creative contributions but to emphasize the danger of making it the ultimate point of reference and then trying to continuously play “catch up” with it. (shrink)

For decades, cigarette companies helped to promote the impression that there was no scientific consensus concerning the safety of their product. The appearance of controversy, however, was misleading, designed to confuse the public and to protect industry interests. Created scientific controversies emerge when expert communities are in broad agreement but the public perception is one of profound scientific uncertainty and doubt. In the first book-length analysis of the concept of a created scientific controversy, David Harker explores issues including climate change, (...) Creation science, the anti-vaccine movement and genetically modified crops. Drawing on work in cognitive psychology, social epistemology, critical thinking and philosophy of science, he shows readers how to better understand, evaluate, and respond to the appearance of scientific controversy. His book will be a valuable resource for students of philosophy of science, environmental and health sciences, and social and natural sciences. (shrink)

Gender bias is a recalcitrant problem in academia and society. However, dissent has been created on this issue. We focus on dissenting studies by Stephen J. Ceci and Wendy M. Williams, arguing that they reach conclusions that are unwarranted on the basis of the available evidence and that they ignore fundamental objections to their methodological decisions. Drawing on discussions from other contexts, particularly on manufactured dissent concerning anthropogenic climate change, we conclude that dissent on gender bias substantially contributes (...) to the exacerbation of biases in society and an increasing number of attacks on researchers, making it both epistemically and socially problematic. (shrink)

To arrive at their final evaluation of a manuscript or grant proposal, reviewers must convert a submission’s strengths and weaknesses for heterogeneous peer review criteria into a single metric of quality or merit. I identify this process of commensuration as the locus for a new kind of peer review bias. Commensuration bias illuminates how the systematic prioritization of some peer review criteria over others permits and facilitates problematic patterns of publication and funding in science. Commensuration bias (...) also foregrounds a range of structural strategies for realigning peer review practices and institutions with the aims of science. (shrink)

In the philosophy of science, it is a common proposal that values are illegitimate in science and should be counteracted whenever they drive inquiry to the confirmation of predetermined conclusions. Drawing on recent cognitive scientific research on human reasoning and confirmation bias, I argue that this view should be rejected. Advocates of it have overlooked that values that drive inquiry to the confirmation of predetermined conclusions can contribute to the reliability of scientific inquiry at the group level (...) even when they negatively affect an individual’s cognition. This casts doubt on the proposal that such values should always be illegitimate in science. It also suggests that advocates of that proposal assume a narrow, individualistic account of science that threatens to undermine their own project of ensuring reliable belief formation in science. (shrink)

Name der Zeitschrift: Jahrbuch für Wissenschaft und Ethik Jahrgang: 20 Heft: 1 Seiten: 293-302.

Name der Zeitschrift: Jahrbuch für Wissenschaft und Ethik Jahrgang: 20 Heft: 1 Seiten: 237-240.

Research on bias in peer review examines scholarly communication and funding processes to assess the epistemic and social legitimacy of the mechanisms by which knowledge communities vet and self-regulate their work. Despite vocal concerns, a closer look at the empirical and methodological limitations of research on bias raises questions about the existence and extent of many hypothesized forms of bias. In addition, the notion of bias is predicated on an implicit ideal that, once articulated, raises questions (...) about the normative implications of research on bias in peer review. This review provides a brief description of the function, history, and scope of peer review; articulates and critiques the conception of bias unifying research on bias in peer review; characterizes and examines the empirical, methodological, and normative claims of bias in peer review research; and assesses possible alternatives to the status quo. We close by identifying ways to expand conceptions and studies of bias to countenance the complexity of social interactions among actors involved directly and indirectly in peer review. (shrink)

_Anthropic Bias_ explores how to reason when you suspect that your evidence is biased by "observation selection effects"--that is, evidence that has been filtered by the precondition that there be some suitably positioned observer to "have" the evidence. This conundrum--sometimes alluded to as "the anthropic principle," "self-locating belief," or "indexical information"--turns out to be a surprisingly perplexing and intellectually stimulating challenge, one abounding with important implications for many areas in science and philosophy. There are the philosophical thought experiments and (...) paradoxes: the Doomsday Argument; Sleeping Beauty; the Presumptuous Philosopher; Adam & Eve; the Absent-Minded Driver; the Shooting Room. And there are the applications in contemporary science: cosmology ; evolutionary theory ; the problem of time's arrow ; quantum physics ; game-theory problems with imperfect recall ; even traffic analysis. _Anthropic Bias_ argues that the same principles are at work across all these domains. And it offers a synthesis: a mathematically explicit theory of observation selection effects that attempts to meet scientific needs while steering clear of philosophical paradox. (shrink)

_Anthropic Bias_ explores how to reason when you suspect that your evidence is biased by "observation selection effects"--that is, evidence that has been filtered by the precondition that there be some suitably positioned observer to "have" the evidence. This conundrum--sometimes alluded to as "the anthropic principle," "self-locating belief," or "indexical information"--turns out to be a surprisingly perplexing and intellectually stimulating challenge, one abounding with important implications for many areas in science and philosophy. There are the philosophical thought experiments and (...) paradoxes: the Doomsday Argument; Sleeping Beauty; the Presumptuous Philosopher; Adam & Eve; the Absent-Minded Driver; the Shooting Room. And there are the applications in contemporary science: cosmology ; evolutionary theory ; the problem of time's arrow ; quantum physics ; game-theory problems with imperfect recall ; even traffic analysis. _Anthropic Bias_ argues that the same principles are at work across all these domains. And it offers a synthesis: a mathematically explicit theory of observation selection effects that attempts to meet scientific needs while steering clear of philosophical paradox. (shrink)

Work in philosophy of religion exhibits at least four symptoms of poor health: it is too partisan, too polemical, too narrow in its focus, and too often evaluated using criteria that are theological or religious instead of philosophical. Our diagnosis is that, because of the emotional and psychosocial aspects of religion, many philosophers of religion suffer from cognitive biases and group influence. We support this diagnosis in two ways. First, we examine work in psychology on cognitive biases and their affective (...) triggers. This work supports the view that, while cognitive biases are no doubt a problem in all inquiry and in all areas ofphilosophy, they are particularly damaging to inquiry in philosophy of religion. Second, we examine work in social and evolutionary psychology on religious sociality and its attendant emotions. This work establishes that the coalitional features of religion are correlated with group bias, and we contend that this bias is also harmful to inquiry in philosophy of religion. We close by offering both a prognosis and recommendations for treatment. (shrink)

When ethical decisions have to be taken in critical, complex medical situations, they often involve decisions that set the course for or against life-sustaining treatments. Therefore the decisions have far-reaching consequences for the patients, their relatives, and often for the clinical staff. Although the rich psychology literature provides evidence that reasoning may be affected by undesired influences that may undermine the quality of the decision outcome, not much attention has been given to this phenomenon in health care or ethics consultation. (...) In this paper, we aim to contribute to the sensitization of the problem of systematic reasoning biases by showing how exemplary individual and group biases can affect the quality of decision-making on an individual and group level. We are addressing clinical ethicists as well as clinicians who guide complex decision-making processes of ethical significance. Knowledge regarding exemplary group psychological biases (e.g. conformity bias), and individual biases (e.g. stereotypes), will be taken from the disciplines of social psychology and cognitive decision science and considered in the field of ethical decision-making. Finally we discuss the influence of intuitive versus analytical (systematical) reasoning on the validity of ethical decision-making. (shrink)

Summary The journal Systematic Zoology is studied in order to see what effect factionalism in the taxonomic community had on the refereeing process. Publication patterns in the journal were largely independent of changes in editorship. Although the taxonomic community was subdivided into feuding factions during the period under study, little bias along these lines was discernible in the refereeing process when studied statistically. Several explanations are suggested for the wide-spread impression at the time that bias was pervasive.

Animal welfare scientific literature has accumulated rapidly in recent years, but bias may exist which influences understanding of progress in the field. We conducted a survey of articles related to animal welfare or well being from an electronic database. From 8,541 articles on this topic, we randomly selected 115 articles for detailed review in four funding categories: government; charity and/or scientific association; industry; and educational organization. Ninety articles were evaluated after unsuitable articles were rejected. The welfare states of animals (...) in new treatments, conventional treatments or control groups with no treatment were classified as high, medium or low according to one or more. More articles were published in which the welfare of animals in new treatments was better than that of animals in the conventional or no treatment groups, demonstrating a positive result bias. Failure to publish studies with negative or inconclusive results may lead to other scientists unnecessarily repeating the research. The authors’ assessments of the welfare state of the groups were similarly rated high, medium or low, and it was found that new treatments were rated lower if the research was funded by industry, and higher when funded by charities, with government funding agencies intermediate. These differences were not evident in the Five Freedoms assessment, demonstrating an authors’ assessment bias that appeared to support the funding agencies’ interests. North American funded publications rated the welfare of animals in New treatments higher and those in a Conventional or No Treatment lower, compared with European-funded publications. It is concluded that preliminary evidence was provided of several forms of publication bias in animal welfare science. (shrink)

Women’s underrepresentation in science, technology, engineering, and mathematics (STEM) is related to the hierarchical social structure of gender relations in these fields. However, interventions to increase women’s participation have focused primarily on women’s interests rather than on STEM managers’ hiring practices. In this research, we examine STEM hiring practices, explore the implicit bias in criteria used by STEM managers, and suggest possible corrective solutions. Using an experimental design with 213 men and women STEM managers, we show that when (...) evaluating a female candidate, women and men STEM managers apply differential selection criteria, with men demonstrating implicit in-group gender favoritism in their hiring decisions. Specifically, the ability to work long hours was a more important criterion for male managers when evaluating a female candidate, forming an implicit gender bias, whereas female managers gave greater importance to problem-solving ability, a more gender-equal criterion. Adding a personal note to the curriculum vitae stating that the candidate had hired a full-time nanny was useful in decreasing the importance of the ability to work long hours criterion for men managers. We suggest individual and institutional interventions to reduce this bias, as a path to increasing women’s participation in STEM. (shrink)

Animal welfare scientific literature has accumulated rapidly in recent years, but bias may exist which influences understanding of progress in the field. We conducted a survey of articles related to animal welfare or well being from an electronic database. From 8,541 articles on this topic, we randomly selected 115 articles for detailed review in four funding categories: government; charity and/or scientific association; industry; and educational organization. Ninety articles were evaluated after unsuitable articles were rejected. The welfare states of animals (...) in new treatments, conventional treatments or control groups with no treatment were classified as high, medium or low according to one or more. More articles were published in which the welfare of animals in new treatments was better than that of animals in the conventional or no treatment groups, demonstrating a positive result bias. Failure to publish studies with negative or inconclusive results may lead to other scientists unnecessarily repeating the research. The authors’ assessments of the welfare state of the groups were similarly rated high, medium or low, and it was found that new treatments were rated lower if the research was funded by industry, and higher when funded by charities, with government funding agencies intermediate. These differences were not evident in the Five Freedoms assessment, demonstrating an authors’ assessment bias that appeared to support the funding agencies’ interests. North American funded publications rated the welfare of animals in New treatments higher and those in a Conventional or No Treatment lower, compared with European-funded publications. It is concluded that preliminary evidence was provided of several forms of publication bias in animal welfare science. (shrink)

The last 5 years have seen a series of remarkable achievements in deep-neural-network-based artificial intelligence research, and some modellers have argued that their performance compares favourably to human cognition. Critics, however, have argued that processing in deep neural networks is unlike human cognition for four reasons: they are (i) data-hungry, (ii) brittle, and (iii) inscrutable black boxes that merely (iv) reward-hack rather than learn real solutions to problems. This article rebuts these criticisms by exposing comparative bias within them, in (...) the process extracting some more general lessons that may also be useful for future debates. (shrink)

This volume is a wide-ranging examination of denial and ideological denialism. It offers a readable overview of the psychology and social science of bias, self-deception, and denial, and examines the role of ideological denialism in conflicts over science and public policy, politics, and culture.

How should we handle ethical issues related to emerging science and technology in a rational way? This is a crucial issue in our time. On the one hand, there is great optimism with respect to technology. On the other, there is pessimism. As both perspectives are based on scarce evidence, they may appear speculative and irrational. Against the pessimistic perspective to emerging technology, it has been forcefully argued that there is a status quo bias (SQB) fuelling irrational attitudes (...) to emergent science and technology and greatly hampering useful development and implementation. Therefore, this article starts by analysing the SQB using human enhancement as a case study. It reveals that SQB may not be as prominent in restricting the implementation of emergent technologies as claimed in the ethics literature, because SQB (a) is fuelled by other and weaker drivers than those addressed in the literature, (b) is at best one amongst many drivers of attitudes towards emergent science and technology, and (c) may not be a particularly prominent driver of irrational decision‐making. While recognizing that SQB can be one driver behind pessimism, this article investigates other and counteracting forces that may be as strong as SQB. Progress bias is suggested as a generic term for the various drivers of unwarranted science and technology optimism. Based on this analysis, a test for avoiding or reducing this progress bias is proposed. Accordingly, we should recognize and avoid a broad range of biases in the assessment of emerging and existing science and technology in order to promote an open and transparent deliberation. (shrink)

The "myside bias'' in evaluating arguments is an empirically well-confirmed phenomenon that consists of overweighting arguments that endorse one's beliefs or attack alternative beliefs while underweighting arguments that attack one's beliefs or defend alternative beliefs. This paper makes two contributions: First, it proposes a probabilistic model that adequately captures three salient features of myside bias in argument evaluation. Second, it provides a Bayesian justification of this model, thus showing that myside bias has a rational Bayesian explanation under (...) certain conditions. (shrink)

Peer reviews of 84 organic farming grant applications from Sweden were analyzed to determine whether the reviewers’ affiliation to one of two types of agriculture (i.e., organic and conventional) influenced their reviews. Fifteen reviewers were divided into three groups: (1) scientists with experience in organic farming research; (2) scientists with no experience in organic farming research; and (3) users of organic farming research. The two groups of scientists assessed the societal relevance and scientific quality of the grant applications based on (...) three criteria (i.e., presentation, methodology, qualifications), whereas the user group only assessed societal relevance. The analysis showed that the two groups of scientists provided very different reviews. Scientist reviewers with experience in organic farming research agreed more with the user group on research relevance than did scientist reviewers without such experience, and the assessment of relevance was closely correlated to the assessment of scientific quality within both scientific groups. As both scientific groups did not clearly distinguish between societal relevance and scientific quality, the idea of an objective science is challenged. The contextual values associated with the norms of good agriculture were not clearly distinguished from the constitutive values of science associated with the traditional norms of good science. This raises the question of whether organic and conventional grant applications should be mixed for review regardless of the reviewers. (shrink)

Neuroscience research, like all science, is vulnerable to the influence of extraneous values in the practice of research, whether in research design or the selection, analysis and interpretation of data. This is particularly problematic for research into the biological mechanisms that underlie behavior, and especially the neurobiological underpinnings of moral development and ethical reasoning, decision-making and behavior, and the other elements of what is often called the neuroscience of ethics. The problem arises because neuroscientists, like most everyone, bring to (...) their work assumptions, preconceptions and values and other sources of potentially inappropriate bias of which they may be unaware. It is important that the training of neuroscientists, and research practice itself, include open and in-depth discussion and examination of the assumptions that underlie research. Further, policy makers, journalists, and the general public, that is, the consumers of neuroscience research findings (and by extension, neurotechnologies) should be made aware of the limitations as well as the strengths of the science, the evolving nature of scientific understanding, and the often invisible values inherent in science. (shrink)

The delineation of constituency boundaries and variations in vote distribution across districts often favor certain parties at the expense of others. Applying a hitherto under-utilized formula (Brookes, 1959; Johnston et al., 1999), this study investigates whether the mechanism translating votes into seats in Japan's single-member districts results in systematic partisan advantage that may influence election outcomes. Simulations are conducted for the 2003 and 2005 general elections under two scenarios: where the governing coalition and the main opposition party receive equal vote (...) shares, and where their vote shares are reversed from the actual results. Components of electoral bias are then disaggregated into size and distribution effects, and the impact of malapportionment, electorate size, turnout, and the role of third party/independent candidates on overall electoral bias is examined. Results show that while partisan bias exists, disadvantages toward one party in some components are likely to cancel out benefits derived from others, producing a relatively small net effect. Furthermore, electoral bias in Japan is found to award sectoral rather than partisan seat bonuses. (shrink)

Methodological objectivism is a conception of bias which obscures the contingent and limited nature of methodological principles behind the guise of fixed a priori standards. I suggest as an alternative a more flexible view of the operation of bias which I call the attribution model. The attribution model makes explicit the working principles of both parties to an actual charge of bias. It enables those involved to identify the issues in dispute between them, and is the basis (...) for an approach to handling charges of bias within the process of discussion and negotiation which characterizes normal scientific decision-making. (shrink)

BackgroundDescriptive studies examining publication rates and citation counts demonstrate a geographic skew toward high-income countries (HIC), and research from low- or middle-income countries (LMICs) is generally underrepresented. This has been suggested to be due in part to reviewers’ and editors’ preference toward HIC sources; however, in the absence of controlled studies, it is impossible to assert whether there is bias or whether variations in the quality or relevance of the articles being reviewed explains the geographic divide. This study synthesizes (...) the evidence from randomized and controlled studies that explore geographic bias in the peer review process.MethodsA systematic review was conducted to identify research studies that explicitly explore the role of geographic bias in the assessment of the quality of research articles. Only randomized and controlled studies were included in the review. Five databases were searched to locate relevant articles. A narrative synthesis of included articles was performed to identify common findings.ResultsThe systematic literature search yielded 3501 titles from which 12 full texts were reviewed, and a further eight were identified through searching reference lists of the full texts. Of these articles, only three were randomized and controlled studies that examined variants of geographic bias. One study found that abstracts attributed to HIC sources elicited a higher review score regarding relevance of the research and likelihood to recommend the research to a colleague, than did abstracts attributed to LIC sources. Another study found that the predicted odds of acceptance for a submission to a computer science conference were statistically significantly higher for submissions from a “Top University.” Two of the studies showed the presence of geographic bias between articles from “high” or “low” prestige institutions.ConclusionsTwo of the three included studies identified that geographic bias in some form was impacting on peer review; however, further robust, experimental evidence is needed to adequately inform practice surrounding this topic. Reviewers and researchers should nonetheless be aware of whether author and institutional characteristics are interfering in their judgement of research. (shrink)

There has been a longstanding bias in the study of spoken language towards using writing to analyse speech. This approach is problematic in that it assumes language to be derived from an autonomous mental capacity to assemble words into sentences, while failing to acknowledge culture-specific ideas linked to writing. Words and sentences are writing constructs that hardly capture the sound-making actions involved in spoken language. This book brings to light research that has long revealed structures present in all languages (...) but which do not match the writing-induced concepts of traditional linguistic analysis. It demonstrates that language processes are not physiologically autonomous, and that speech structures are structures of spoken language. It then illustrates how speech acts can be studied using instrumental records, and how multisensory experiences in semantic memory couple to these acts, offering a biologically-grounded understanding of how spoken language conveys meaning and why it develops only in humans. (shrink)

Peer reviewers at many funding agencies and scientific journals are asked to score submissions both on individual criteria and overall. The overall scores should be some kind of aggregate of the criteria scores. Carole Lee identifies this as a potential locus for bias to enter the peer review process, which she calls commensuration bias. Here I view the aggregation of scores through the lens of social choice theory. I argue that, when reviewing grant proposals, it is in many (...) cases impossible to avoid commensuration bias. (shrink)

In this essay, I want to identify an invidious bias that is embedded in much research into sex differences. I shall argue that bias against women is endemic in any such research programme that fails to take account at every stage of women's social inequality. It is primarily because its view of the relation between sexual difference and sexual inequality is too simplistic that much sex differences research rationalizes and so perpetuates women's subordination.