Open Peer Review: Educational Philosophy and Theory (EPAT)Michael A. Peters, Beijing Normal University, PR ChinaIn 2016 EPAT started experimenting with open peer review for articles that were part...

Open peer review (OPR) is moving into the mainstream, but it is often poorly understood and surveys of researcher attitudes show important barriers to implementation. As more journals move to implement and experiment with the myriad of innovations covered by this term, there is a clear need for best practice guidelines to guide implementation. This brief article aims to address this knowledge gap, reporting work based on an interactive stakeholder workshop to create best-practice guidelines for editors and (...) journals who wish to transition to OPR. Although the advice is aimed mainly at editors and publishers of scientific journals, since this is the area in which OPR is at its most mature, many of the principles may also be applicable for the implementation of OPR in other areas (e.g., books, conference submissions). (shrink)

As universities in the United Kingdom gear themselves up for the next Research Excellence Framework, REF2021, with peer review at its core, we critically re-visit the idea of peer review as a gold standard proxy for research excellence. We question the premise that anonymous peer review is a necessary and enabling condition for impartial, expert judgement. We argue that the intentions and supposed benefits underlying peer review and its associated concepts have become (...) congealed in received discourse about research quality. Hence we explore the key conceptual issues raised by the nested assumptions and concepts that come into play in peer review as currently practised: primarily those of secrecy, anonymity, legitimacy, trust, impartiality and openness. After delineating the benefits attributed to peer review, we contrast its declared virtues with its problematic features. We locate peer review in an audit culture in which the reviewer is an academic labourer. Drawing on recent trends in moral and political philosophy, we question the usefulness of the ideal of impartiality when tied to secrecy. Then we raise more deliberative, intersubjective possibilities for a revised understanding of peer review in the context of an academic community. Finally, we suggest ways in which the academic community could pursue quality in research by recasting peer review to be less secret and more open. (shrink)

We examine the criticisms and subsequent changes that arise in the course of peer review. Fifty-two scholars who had recently published in Administrative Science Quarterly were surveyed regarding their peer review experience and how their article changed from initial journal submission to eventual publication. Papers that challenged theoretical perspectives faced distinctively high levels of criticism and change, particularly with attention to methodology, while those that offered a new perspective or that extended or combined established perspectives were (...) less criticized and changed. The number of challenge-oriented publications was small as well, suggesting that either few such submissions survive the review process or few are submitted in the first place. Overall, peer review appears open to expansion of the variety of theoretical argument but does little to aid in the winnowing out of established perspectives. (shrink)

Peer review of manuscripts for biomedical journals has become a subject of intense ethical debate. One of the most contentious issues is whether or not peer review should be anonymous. This study aimed to generate a rich, empirically-grounded understanding of the values held by journal editors and peer reviewers with a view to informing journal policy. Qualitative methods were used to carry out an inductive analysis of biomedical reviewers’ and editors’ values. Data was derived from (...) in-depth, open-ended interviews with journal editors and peer reviewers. Data was “read for” themes relevant to reviewer anonymisation and interactions among editors, reviewers, and authors. Editors and peer reviewers provided three arguments that would support a more open and interactive peer-review process. First, a number of participants emphasised the importance of not only ensuring the scientific quality of published research but also nurturing their colleagues and supporting their communities. Second, many spoke about the ongoing moral responsibilities that reviewers and editors felt toward authors. Finally, participants spoke at length about their enjoyment of social interactions and of the value of collective, rather than isolated, reasoning processes. Whether or not journal editors decide to allow anonymous review , the values of editors and reviewers need to be seriously addressed in codes of publication ethics, in the management of biomedical journals, and in the establishment of journal policies. (shrink)

This paper reviews the published empirical evidence concerning journal peer review consisting of 68 papers, all but three published since 1975. Peer review improves quality, but its use to screen papers has met with limited success. Current procedures to assure quality and fairness seem to discourage scientific advancement, especially important innovations, because findings that conflict with current beliefs are often judged to have defects. Editors can use procedures to encourage the publication of papers with innovative findings (...) such as invited papers, early-acceptance procedures, author nominations of reviewers, structured rating sheets, open peer review, results-blind review, and, in particular, electronic publication. Some journals are currently using these procedures. The basic principle behind the proposals is to change the decision from whether to publish a paper to how to publish it. (shrink)

Peer review of journal submissions has become one of the most important pillars of quality management in academic publishing. Because of growing concerns with the quality and effectiveness of the system, a host of enthusiastic innovators has proposed and experimented with new procedures and technologies. However, little is known about whether these innovations manage to convince other journal editors. This paper will address open questions regarding the implementation of new review procedures, the occurrence rate of various (...) peer review procedures and their distribution over scientific disciplines or academic publishers, as well as the motivations for editors or publishers to engage in novel review procedures. It shows that in spite of enthusiastic innovation, the adoption of new peer review procedures is in fact very slow, with the exception of text similarity scanners. For now, peer review innovations appear to be restricted to specific niches in academic publishing. Analysing these niches, the article concludes with a reflection on the circumstances in which innovations might be more widely implemented. (shrink)

This Open Access book about the Zadeh Project demonstrates and explores a core question in clinical ethics: how can ethics consultants be accountable in the face of a robust plurality of ethical standpoints, especially those that underwrite practices and methods for doing ethics consultation as well as those viewpoints and values encountered in daily clinical ethics practice? Underscoring this question is the recognition that the field of clinical ethics consultation has arrived at a crucial point in its maturation. Many (...) efforts are underway to more formally “professionalize” the field, with most aimed toward stabilizing a specific set of institutional considerations. Stretched between these institutional and practical initiatives resides a crucial set of of ethical considerations, chief among them the meaning and scope of responsibility for clinical ethics consultants. Developed around a long-form case scenario, the Zadeh Project provides a multi-layered series of “peer-reviews”: critique of the actions of the case scenario’s ethics consultant; reflection on clinical ethics method; examination of the many ways that commitments to method and practice can, and do, intersect, overlap, and alter one another. The design and format of this book thus models a key element for clinical ethics practice: the need and ability to provide careful and thoughtful explanation of core moral considerations that emerge among diverse standpoints. Specifically designed for those studying to become and those who are ethics consultants, this book, with its innovative and multi-layered approach, allows readers to share a peer-review-like experience that shows accountability to be what it is, an ethical, not merely procedural or administrative, undertaking. (shrink)

Recent science funding policy scholars and practitioners have advocated for the use of lotteries, or elements of random chance, as supplementations of traditional peer review for evaluating grant applications. One of the primary motivations for lotteries is their purported openness to innovative research. The purpose of this paper is to argue that current proponents of funding science by lottery overestimate the viability of peer review and thus unduly restrict the scope of lotteries in science funding practice. (...) I further show how this analysis suggests a different way of introducing lotteries into science funding policy. (shrink)

Despite general agreement within philosophy that peer review is indispensable, its fairness and reliability is often questioned. This article suggests that such worries can to a large extent be met by adopting the practice that reviews as well as earlier versions of papers are made publicly available when the final version of a paper is published. This suggestion combines the advantages of transparency with the merits of anonymity of reviewers. While there are obstacles to this suggestion, the article (...) argues that it would be worthwhile to implement it because it can help map patterns of conduct and secure confidence in the fairness and reliability of review procedures and journal editing within philosophy. (shrink)

Mission-oriented climate change research is often unverifiable. Therefore, many stakeholders look to peer-reviewed climate change research for trustworthy information about deeply uncertain and impactful phenomena. This is because peer-review signals that research has been vetted for scientific standards like reproducibility and replicability. Here we evaluate the transparency of research methodologies in mission-oriented computational climate research. We find that only five percent of our sample meets the minimal standard of fully open data and code required for reproducibility (...) and replicability. The widespread lack of minimal openness standards in peer-reviewed climate change research jeopardizes scientific credibility and risks poor societal outcomes as we manage growing climate risks. The scientific community can and must do better. We, the authors, outline necessary openness standards that we commit to as researchers, reviewers, and readers. We invite you to join us. (shrink)

Retractions of COVID-19 literature in both preprints and the peer-reviewed literature serve as a reminder that there are still challenging issues underlying the integrity of the biomedical literature. The risks to academia become larger when such retractions take place in high-ranking biomedical journals. In some cases, retractions result from unreliable or nonexistent data, an issue that could easily be avoided by having open data policies, but there have also been retractions due to oversight in peer review (...) and editorial verification. As COVID-19 continues to affect academics and societies around the world, failures in peer review might also constitute a public health risk. The effectiveness by which COVID-19 literature is corrected, including through retractions, depends on the stringency of measures in place to detect errors and to correct erroneous literature. It also relies on the stringent implementation of open data policies. (shrink)

Peer review of manuscripts has recently become a subject of academic research and ethical debate. Critics of the review process argue that it is a means by which powerful members of the scientific community maintain their power, and achieve their personal and communal aspirations, often at others' expense. This qualitative study aimed to generate a rich, empirically‐grounded understanding of the process of manuscript review, with a view to informing strategies to improve the review process. (...) class='Hi'>Open‐ended interviews were carried out with 35 journal editors and peer reviewers in the United Kingdom, the USA and Australia. It is clear from this research that relations of power and epistemic authority in manuscript review are complex and dynamic, and may have positive and negative features, and that even where power is experienced as controlling, restrictive and illegitimate, it can also be resisted. In conclusion, the manuscript review process is best thought of not in terms of simple dominance of reviewers and editors over authors, but rather as a shifting “net” of power relations. These complex power relations need to be understood if reviewers are to be encouraged to participate in the process and to do so in the the most ethical and effective manner. (shrink)

BackgroundThe aim of this survey was to determine the level of awareness and understanding of peer review and peer review models amongst junior hospital doctors and whether this influences clinical decision-making.MethodsA 30-question online anonymous survey was developed aimed at determining awareness of peer review models and the purpose of peer review, perceived trustworthiness of different peer review models and the role of peer review in clinical decision-making. It was (...) sent to 800 trainee doctors in medical specialties on the University College London Partners trainee database.ResultsThe response rate was (178/800) 22%. Most respondents were specialist registrars. Checking that research is conducted correctly (152/178, 85%) and the data interpreted correctly (148/178, 83%) were viewed as the most important purposes of peer review. Most respondents were aware of open (133/178, 75%), double-blind (125/178, 70%) and single-blind peer review (121/178, 68%). 101/178 (57%) had heard of collaborative, 87/178 (49%) of post publication and 29/178 (16%) of decoupled peer review. Of those who were aware of double-blind, single-blind open and collaborative peer review, 85 (68%), 82 (68%), 74 (56%) and 24 (24%), respectively, understood how they worked. The NEJM, Lancet and The BMJ were deemed to have most trustworthy peer review, 137/178 (77%), 129/178 (72%) and 115/178 (65%), respectively. That peer review had taken place was important for a journal content to be used for clinical decision-making 152/178 (85%), but the ability to see peer review reports was not as important 22/178 (12%). Most felt there was a need for peer review training and that this should be at the specialist registrar stage of training.ConclusionsJunior hospital doctors view peer review to be important as a means of quality control, but do not value the ability to scrutinize peer review themselves. The unquestioning acceptance of peer review as final validation in the field of medicine emphasises not only the responsibility held by medical journals to ensure peer review is done well but also the need to raise awareness amongst the medical community of the limitations of the current peer review process. (shrink)

A growing body of literature has identified potential problems that can compromise the quality, fairness, and integrity of journal peer review, including inadequate review, inconsistent reviewer reports, reviewer biases, and ethical transgressions by reviewers. We examine the evidence concerning these problems and discuss proposed reforms, including double-blind and open review. Regardless of the outcome of additional research or attempts at reforming the system, it is clear that editors are the linchpin of peer review, (...) since they make decisions that have a significant impact on the process and its outcome. We consider some of the steps editors should take to promote quality, fairness and integrity in different stages of the peer review process and make some recommendations for editorial conduct and decision-making. (shrink)

The double‐blind peer‐review of manuscripts for potential publication is a longstanding tradition in the production of scholarship. Nursing has adopted this tradition to secure a place of legitimacy and authority for its scholarship amongst the other disciplines in the academy. However, despite its ubiquity and avowed utility, the peer‐review has not generally been the subject of much research let alone intense philosophical scrutiny and debate. This manuscript attempts such an engagement with a view to uncovering specific (...) concerns about the essentially conservative and sometimes restrictive effects the double‐blind peer‐review produces. Drawing on the deconstructionist writings of Derrida and his acolytes this paper attempts to dig beneath the surface mechanics of the double‐blind peer‐review and in so doing, expose its rather shaky philosophical foundations. It is written to open debate from others who too, have harboured doubts about its adequacy and supremacy as a technology in the production of (legitimate) knowledge. (shrink)

Given that health systems research involves different aims, approaches, and methodologies as compared to more traditional clinical trials, the ethical issues present in HSR may be unique or particularly nuanced. This article outlines eight pertinent ethical issues that are particularly salient in HSR and argues that the ethical review process should be better tailored to ensure more efficient and appropriate oversight of HSR with adequate human protections, especially in low- and middle-income countries. The eight ethical areas we discuss include (...) the nature of intervention, types of research subjects, units of intervention and observation, informed consent, controls and comparisons, risk assessment, inclusion of vulnerable groups, and benefits of research. HSR involving human participants is necessary to ensure health systems strengthening and quality of care and to guide public policy intelligently. Health systems researchers must carefully define their intent and goals and openly clarify the values that may influence the premises and design of protocols. As new types of population-level research activities become more commonplace, it is critical that institutional review board and research ethics committee review processes evolve to evaluate these research protocols in ways that address the nuanced features of these studies. (shrink)

Institutional ethics consultation services for biomedical scientists have begun to proliferate, especially for clinical researchers. We discuss several models of ethics consultation and describe a team-based approach used at Stanford University in the context of these models. As research ethics consultation services expand, there are many unresolved questions that need to be addressed, including what the scope, composition, and purpose of such services should be, whether core competencies for consultants can and should be defined, and how conflicts of interest should (...) be mitigated. We make preliminary recommendations for the structure and process of research ethics consultation, based on our initial experiences in a pilot program. (shrink)

The nature of authority is shifting in online scholarly communication. This examination of the history and future of peer review argues that effective online communication requires the development of an open, community?oriented, post?publication system of peer?to?peer review, transforming peer review from a process focused on gatekeeping to one concerned with filtering the wealth of scholarly material made available via the Internet.

BackgroundOpen peer review practices are increasing in medicine and life sciences, but in social sciences and humanities they are still rare. We aimed to map out how editors of respected SSH journals perceive open peer review, how they balance policy, ethics, and pragmatism in the review processes they oversee, and how they view their own power in the process.MethodsWe conducted 12 pre-registered semi-structured interviews with editors of respected SSH journals. Interviews consisted of 21 questions (...) and lasted an average of 67 min. Interviews were transcribed, descriptively coded, and organized into code families.ResultsSSH editors saw anonymized peer review benefits to outweigh those of open peer review. They considered anonymized peer review the “gold standard” that authors and editors are expected to follow to respect institutional policies; moreover, anonymized review was also perceived as ethically superior due to the protection it provides, and more pragmatic due to eased seeking of reviewers. Finally, editors acknowledged their power in the publication process and reported strategies for keeping their work as unbiased as possible.ConclusionsEditors of SSH journals preferred the benefits of anonymized peer review over open peer and acknowledged the power they hold in the publication process during which authors are almost completely disclosed to editorial bodies. We recommend journals to communicate the transparency elements of their manuscript review processes by listing all bodies who contributed to the decision on every review stage. (shrink)

In May 2016, we launched Research Integrity and Peer Review, an international, open access journal with fully open peer review (reviewers are identified on their reports and named reports are published alongside the article) to provide a home for research on research and publication ethics, research reporting, and research on peer review. As the journal enters its third year, we reflect on recent events and highlights for the journal and explore how the (...) journal is faring in terms of gender and diversity in peer review. We also share the particular interests of our Editors-in-Chief regarding models of peer review, reporting quality, common research integrity issues that arise during the publishing process, and how people interact with the published literature. We continue to encourage further research into peer review, research and publication ethics and research reporting, as we believe that all new initiatives should be evidence-based. We also remain open to constructive discussions of the developments in the field that offer new solutions. (shrink)

This study evaluates the editorial policies of a randomized sample of English language peer-reviewed journals that publish original research involving the use of animals. The aim is to identify whether journals have editorial policies relating to the use of animals in the research that they are prepared to publish and whether any policies are likely to promote animal welfare and dissemination of information on the 3Rs within the scientific community. The results demonstrate that a significant proportion of journals publishing (...) original research involving animals do not have any editorial policy relating to the use of animals. Of those journals that do have policies the majority simply request that the research be carried out in accordance with standard regulatory requirements. This paper aims to provide editors and publishers with the information they need to review their own editorial policies to ensure they are fulfilling their potential to promote animal welfare and dissemination of the 3Rs. (shrink)

A resilient issue in research ethics is whether and when a placebo-controlled trial is justified if it deprives research subjects of a recognized treatment. The clinicians' moral duty to provide the best available care seems to require the use of ‘active’ controlled trials that use an established treatment as a control whenever such a therapy is available. In another regard, ACTs are supposedly methodologically inferior to PCTs. Hence, the moral duty of the clinical researcher to use the best methods will (...) favor PCTs. In this target article, I analyze the three reasons for believing that ACTs are inferior to PCTs namely: 1) ACTs lack ‘assay sensitivity’; 2) ACTs do not measure absolute effect size; and 3) ACTs require more participants; and I contend that none are acceptable. Consequently the tension between clinical and research ethics dissolves: the moral duty of the clinician to avoid PCTs is unopposed by methodological considerations. (shrink)

As part of a continuous process to explore the factors that might weaken or corrupt traditional peer review, in this paper, we query the ethics, fairness and validity of the request, by editors, of authors to suggest peer reviewers during the submission process. One of the reasons for the current crisis in science pertains to a loss in trust as a result of a flawed peer review which is by nature biased unless it is (...) class='Hi'>open peer review. As we indicate, the fact that some editors and journals rely on authors’ suggestions in terms of who should peer review their paper already instills a potential way to abuse the trust of the submission and publishing system. An author-suggested peer reviewer choice might also tempt authors to seek reviewers who might be more receptive or sympathetic to the authors’ message or results, and thus favor the outcome of that paper. Authors should thus not be placed in such a potentially ethically compromising situation, especially as a mandatory condition for submission. However, the fact that they do not have an opt-out choice during the submission process—especially when using an online submission system that makes such a suggestion compulsory—may constitute a violation of authors’ rights. (shrink)

BackgroundIn their research reports, scientists are expected to discuss limitations that their studies have. Previous research showed that often, such discussion is absent. Also, many journals emphasize the importance of avoiding overstatement of claims. We wanted to see to what extent editorial handling and peer review affects self-acknowledgment of limitations and hedging of claims.MethodsUsing software that automatically detects limitation-acknowledging sentences and calculates the level of hedging in sentences, we compared the submitted manuscripts and their ultimate publications of all (...) randomized trials published in 2015 in 27 BioMed Central (BMC) journals and BMJ Open. We used mixed linear and logistic regression models, accounting for clustering of manuscript-publication pairs within journals, to quantify before-after changes in the mean numbers of limitation-acknowledging sentences, in the probability that a manuscript with zero self-acknowledged limitations ended up as a publication with at least one and in hedging scores.ResultsFour hundred forty-six manuscript-publication pairs were analyzed. The median number of manuscripts per journal was 10.5 (interquartile range 6–18). The average number of distinct limitation sentences increased by 1.39 (95% CI 1.09–1.76), from 2.48 in manuscripts to 3.87 in publications. Two hundred two manuscripts (45.3%) did not mention any limitations. Sixty-three (31%, 95% CI 25–38) of these mentioned at least one after peer review. Changes in mean hedging scores were negligible.ConclusionsOur findings support the idea that editorial handling and peer review lead to more self-acknowledgment of study limitations, but not to changes in linguistic nuance. (shrink)

As part of a continuous process to explore the factors that might weaken or corrupt traditional peer review, in this paper, we query the ethics, fairness and validity of the request, by editors, of authors to suggest peer reviewers during the submission process. One of the reasons for the current crisis in science pertains to a loss in trust as a result of a flawed peer review which is by nature biased unless it is (...) class='Hi'>open peer review. As we indicate, the fact that some editors and journals rely on authors’ suggestions in terms of who should peer review their paper already instills a potential way to abuse the trust of the submission and publishing system. An author-suggested peer reviewer choice might also tempt authors to seek reviewers who might be more receptive or sympathetic to the authors’ message or results, and thus favor the outcome of that paper. Authors should thus not be placed in such a potentially ethically compromising situation, especially as a mandatory condition for submission. However, the fact that they do not have an opt-out choice during the submission process—especially when using an online submission system that makes such a suggestion compulsory—may constitute a violation of authors’ rights. (shrink)

This research examined the experiences of authors of academic journal articles in the educational sector of all eight universities in Finland. The ethical principles of peer review and best and worst review processes were in focus. Data were gathered by electronic questionnaire, which was completed by 121 respondents who represented well the heterogeneity of the staff in the educational sector. Out of nine ethical principles honesty, constructiveness, and impartiality were appreciated but promptness, balance, and diplomacy were criticized. (...) According to two open questions, a third of authors praised and blamed reviewers as experts and non-experts. The accuracy of feedback was more often present in the best rather than in the worst experienced review processes. Journals’ editors and their decision-making called forth more negative than positive accounts. The results were discussed in the context of ethical codes for reviewers and researchers’ findings regarding the ethical responsibilities to promote good science with thorough, appropriate, and honest feedback and feedforward. (shrink)

Investigators and institutional review boards should integrate plans about the appropriate disclosure of individual genetic results when designing research studies. The ethical principles of beneficence, respect, reciprocity, and justice provide justification for routinely offering certain results to research participants. We propose a result-evaluation approach that assesses the expected information and the context of the study in order to decide whether results should be offered. According to this approach, the analytic validity and the clinical utility of a specific result determine (...) whether it should be offered routinely. Different results may therefore require different decisions even within the same study. We argue that the threshold of clinical utility for disclosing a result in a research study should be lower than the threshold used for clinical use of the same result. The personal meaning of a result provides additional criteria for evaluation. Finally, the context of the study allows for a more nuanced analysis by addressing the investigators' capabilities for appropriate disclosure, participants' alternative access to the result, and their relationship with the investigators. This analysis shows that the same result may require different decisions in different contexts. (shrink)

In “Ontologies Relevant to behaviour change interventions: A Method for their Development” Wright, et al. outline a step by step process for building ontologies of behaviour modification – what the authors call the Refined Ontology Developmental Method (RODM) – and demonstrate its use in the development of the Behaviour Change Intervention Ontology (BCIO). RODM is based on the principles of good ontology building used by the Open Biomedical Ontology (OBO) Foundry in addition to those outlined in (Arp, Smith, and (...) Spear 2015). BCIO uses as its top-level ontology Basic Formal Ontology (BFO). The methods outlined in Wright, et al. are a valuable contribution to the field, especially the use of formal mechanisms for literature annotation and expert stakeholder review, and the BCIO will certainly play an important role in the extension of OBO Foundry ontologies into the behavioural domain. (shrink)

This article argues that we could improve the design of research protocols by developing an awareness of and a responsiveness to the social contexts of all the actors in the research enterprise, including subjects, investigators, sponsors, and members of the community in which the research will be conducted. “Social context” refers to the settings in which the actors are situated, including, but not limited to, their social, economic, political, cultural, and technological features. The utility of thinking about social contexts is (...) introduced and exemplified by the presentation of a hypothetical case in which one central issue is limitation of the probability of injury to subjects by selection of individuals who are not expected to live long enough for the known risks of the study to become manifest as harms. Benefits of such considerations may include enhanced subject satisfaction and cooperation, community acceptance, and improved data quality, among other desirable consequences. (shrink)

Peer reviewers at many funding agencies and scientific journals are asked to score submissions both on individual criteria and overall. The overall scores should be some kind of aggregate of the criteria scores. Carole Lee identifies this as a potential locus for bias to enter the peer review process, which she calls commensuration bias. Here I view the aggregation of scores through the lens of social choice theory. I argue that, when reviewing grant proposals, it is in (...) many cases impossible to avoid commensuration bias. (shrink)

Personhood is a foundational concept in ethics, yet defining criteria have been elusive. In this article we summarize attempts to define personhood in psychological and neurological terms and conclude that none manage to be both specific and non-arbitrary. We propose that this is because the concept does not correspond to any real category of objects in the world. Rather, it is the product of an evolved brain system that develops innately and projects itself automatically and irrepressibly onto the world whenever (...) triggered by stimulus features such as a human-like face, body, or contingent patterns of behavior. We review the evidence for the existence of an autonomous person network in the brain and discuss its implications for the field of ethics and for the implicit morality of everyday behavior. (shrink)

This article focuses on emergency medical care in black urban populations, suggesting that the classification of a “community” within clinical trial language is problematic. The article references a cultural history of black Americans with pre-hospital emergency medical treatment as relevant to contemporary emergency medicine paradigms. Part I explores a relationship between “autonomy” and “community.” The idea of community emerges as a displacement for the ethical principle of autonomy precisely at the moment that institutionalized medicine focuses on diversity. Part II examines (...) a clinical trial for the blood substitute PolyHeme® (Northfield Laboratories, Inc., Evanston, IL). It illustrates the ways in which bias in research paradigms and Institutional Review Board decisions attach to the notion and utility of the language of “community.” The conclusion's contemporary anecdote makes apparent the vitality of the issues of prehospital emergency medical care and the ways in which decisions and practices fall too easily into a narrative of culturally biased treatment. (shrink)

Nowadays, protecting trust in social sciences also means engaging in open community dialogue, which helps to safeguard robustness and improve efficiency of research methods. The combination of open data, open review and open dialogue may sound simple but implementation in the real world will not be straightforward. However, in view of Begley and Ellis’s (2012) statement that, “the scientific process demands the highest standards of quality, ethics and rigour,” they are worth implementing. More importantly, they (...) are feasible to work on and likely will help to restore plausibility to social sciences research. Therefore, I feel it likely that the triplet of open data, open review and open dialogue will gradually emerge to become policy requirements regardless of the research funding source. (shrink)

Most departments in any field of science that have a sound academic basis have discussion groups or journal clubs in which pertinent and relevant literature is frequently discussed, as a group. This paper shows how such discussions could help to fortify the post-publication peer review movement, and could thus fortify the value of traditional peer review, if their content and conclusions were made known to the wider academic community. Recently, there are some tools available for making (...) PPPR viable, either as signed or anonymous comments, or in a hybrid format. Thus, limited platforms are currently in place to accommodate and integrate PPPR as a supplement to traditional peer review, allowing for the open and public discussion of what is often publicly-funded science. This paper examines ways in which the opinions that emerge from journal clubs or discussion groups could help to fortify the integrity and reliability of science while increasing its accountability. A culture of reward for good and corrective behavior, rather than a culture that protects silence, would benefit science most. (shrink)

Most departments in any field of science that have a sound academic basis have discussion groups or journal clubs in which pertinent and relevant literature is frequently discussed, as a group. This paper shows how such discussions could help to fortify the post-publication peer review movement, and could thus fortify the value of traditional peer review, if their content and conclusions were made known to the wider academic community. Recently, there are some tools available for making (...) PPPR viable, either as signed or anonymous comments, or in a hybrid format. Thus, limited platforms are currently in place to accommodate and integrate PPPR as a supplement to traditional peer review, allowing for the open and public discussion of what is often publicly-funded science. This paper examines ways in which the opinions that emerge from journal clubs or discussion groups could help to fortify the integrity and reliability of science while increasing its accountability. A culture of reward for good and corrective behavior, rather than a culture that protects silence, would benefit science most. (shrink)

This paper describes the experience of an academic institution, the Queensland University of Technology (QUT), developing training courses about research integrity practices in authorship, publication, and Journal Peer Review. The importance of providing research integrity training in these areas is now widely accepted; however, it remains an open question how best to conduct this training. For this reason, it is vital for institutions, journals, and peak bodies to share learnings.We describe how we have collaborated across our institution (...) to develop training that supports QUT’s principles and which is in line with insights from contemporary research on best practices in learning design, universal design, and faculty involvement. We also discuss how we have refined these courses iteratively over time, and consider potential mechanisms for evaluating the effectiveness of the courses more formally. (shrink)

There is an increasing push by journals to ensure that data and products related to published papers are shared as part of a cultural move to promote transparency, reproducibility, and trust in the scientific literature. Yet few journals commit to evaluating their effectiveness in implementing reporting standards aimed at meeting those goals (1, 2). Similarly, though the vast majority of journals endorse peer review as an approach to ensure trust in the literature, few make their peer (...) class='Hi'>review data available to evaluate effectiveness toward achieving concrete measures of quality, including consistency and completeness in meeting reporting standards. Remedying these apparent disconnects is critical for closing the gap between guidance recommendations and actual reporting behavior. We see this as a collective action problem requiring leadership and investment by publishers, who can be incentivized through mechanisms that allow them to manage reputational risk and through continued innovation in journal assessment. (shrink)

This article reviews the Dutch societal debate on euthanasia/assisted suicide in dementia cases, specifically Alzheimer's disease. It discusses the ethical and practical dilemmas created by euthanasia requests in advance directives and the related inconsistencies in the Dutch legal regulations regarding euthanasia/assisted suicide. After an initial focus on euthanasia in advanced dementia, the actual debate concentrates on making euthanasia/assisted suicide possible in the very early stages of dementia. A review of the few known cases of assisted suicide of people with (...) so-called early dementia raises the question why requests for euthanasia/assisted suicide from patients in the early stage of Alzheimer's disease are virtually non-existent. In response to this question two explanations are offered. It is concluded that, in addition to a moral discussion on the limits of anticipatory choices, there is an urgent need to develop research into the patient's perspective with regard to medical treatment and care-giving in dementia, including end-of-life care. (shrink)

This editorial explains why we are launching Research Integrity and Peer Review, a new open-access journal that will provide a home to research on ethics, reporting, and evaluation of research. We discuss how the idea to launch this journal came about and identify the gaps in knowledge where we would like to encourage more research and interdisciplinary discussion. We are particularly keen to receive submissions presenting actual research that will increase our understanding and suggest potential solutions to (...) issues related to peer review, study reporting, and research and publication ethics. (shrink)

Academics across the sciences and humanities are increasingly being encouraged to use social media as a post-publication strategy to enhance and extend the impact of their articles and books. As well as various measures of social media impact, the turn towards publication outlets which are open access and free to use is contributing to anxieties over where, what and how to publish. This is all the more pernicious given the increasing measures of academic value that govern the academy, and (...) the stresses, strains and hidden injuries that structure academic life. This article will debate these issues and their consequences for the humanities and social sciences by analysing the contours of a recent controversy in academic science publishing, which follows the after-lives of a highly cited journal article. This includes a discussion of the value and status of post-publication peer review, and the politics of open access publishing, of citation and the public communication of science within digital environments and archives. (shrink)

This paper assesses possible reasons why Hermann J. Muller avoided peer-review of data that became the basis of his Nobel Prize award for producing gene mutations in male Drosophila by X-rays. Extensive correspondence between Muller and close associates and other materials were obtained from preserved papers to compliment extensive publications by and about Muller in the open literature. These were evaluated for potential historical insights that clarify why he avoided peer-review of his Nobel Prize findings. (...) This paper clarifies the basis of Muller’s (Muller HJ, Sci 66 84-87, 1927c) belief that he produced X-ray induced “gene” mutations in Drosophila. It then shows his belief was contemporaneously challenged by his longtime friend/confidant and Drosophila geneticist, Edgar Altenburg. Altenburg insisted that Muller may have simply poked large holes in chromosomes with massive doses of X-rays, and needed to provide proof of gene “point” mutations. Given the daunting and uncertain task to experimentally address this criticism, especially within the context of trying to become first to produce gene mutations, it is proposed that Muller purposely avoided peer-review while rushing to publish his paper in Science to claim discovery primacy without showing any data. The present paper also explores ethical issues surrounding these actions, including those of the editor of Science, James McKeen Catell and Altenburg, and their subsequent impact on the scientific and regulatory communities. This historical analysis suggests that Muller deliberately avoided peer-review on his most significant findings because he was extremely troubled by the insightful and serious criticism of Altenburg, which suggested he had not produced gene mutations as he claimed. Nonetheless, Muller manipulated this situation (i.e., publishing a discussion within Science with no data, publishing a poorly written non-peer reviewed conference proceedings with no methods and materials, and no references) due to both the widespread euphoria over his claim of gene mutation and confidence that Altenburg would not publically challenge him. This situation permitted Muller to achieve his goal to be the first to produce gene mutations while buying him time to later try to experimentally address Altenburg’s criticisms, and a possible way to avoid discovery of his questionable actions. (shrink)

Experimental psychologists in the learning tradition stress the importance of three of the authors' four key variables of experimental design. We review research investigating the roles played by these variables in studies of choice from our laboratory. Supporting the authors' claims, these studies show that the effects of these variables are not fixed and should not be taken for granted.

We examine the ethical, social, and regulatory barriers that may hinder research on therapeutic potential of certain controversial controlled substances like marijuana, heroin, or ketamine. Hazards for individuals and society and potential adverse effects on communities may be good reasons for limiting access and justify careful monitoring of these substances. Overly strict regulations, fear of legal consequences, stigma associated with abuse and populations using illicit drugs, and lack of funding may, however, limit research on their considerable therapeutic potential. We (...) class='Hi'>review the surprisingly sparse literature and address the particular ethical concerns pertinent to research with illicit and addictive substances, such as undue inducement, informed consent, therapeutic misconception, and risk to participants, researchers, and institutions. We consider the perspectives of key research stakeholders and explore whether they may be infected with bias. We conclude by proposing an empirical research agenda to provide an evidentiary basis for ethical reasoning. (shrink)