Abstract
Peer review is a topic of considerable concern to many researchers, and there is a correspondingly large body of research on the topic. This issue of Science and Engineering Ethics presents recent work on peer review that is both grounded in empirical science and is applicable to policy decisions. This research raises two basic questions; (a) how does current peer review operate, and (b) how can it be improved? Topics addressed include descriptions of how peer review is used in Federal agencies. whether peer review leads to better manuscripts, demographic characteristics of authors or reviewers (status or institutional affiliation), blinding of reviewers, authors, or results, reliability and consistency of reviews, accepting a paper before the study is done, simultaneous submission, and use of dispute resolution procedures such as scientific dialectical and pleading protocols.
References
Chubin, D. E., & Hackett, E. J. (1990) Peerless science: peer review and U.S. science policy. State University of New York Press, Albany, New York.
Chubin, D. E., & Jasanoff, S. (1985) Science, Technology & Human Values 10 (3).
Cicchetti, D. V., (1991). The reliability of peer review for manuscript and grant submissions: a cross-disciplinary investigation. Behavioral and Brain Sciences 14: 119–186.
Cummings, L. L., & Frost, P. J. (1985) Publishing in the organizational sciences. Richard D, Irwin, Inc., Homewood, Illinois.
Daniel, H.-D. (1993) Guardians of science: fairness and reliability of peer review. VCH, New York.
Finn, R. (1995) NIH study section members acknowledge major flaws in the reviewing system. The Scientist 9 (16): 1,7.
Gordon, M. (1983) Running a referring system. A.B. Printers Ltd., Leiccster, UK.
Hargens, L. L. (1990) Variations in journal peer review systems. Journal of the American Medical Association 263 (10): 1348–1352.
Hargens, L. L. (1988) Scholarly consensus and journal rejection rates. American Sociological Review 53: 139–51.
King, D. W., McDonald, D. D. & Roderer, N. K. (1981) Scientific journals in the United States, Hutchinson Ross, Stroudsburg, Pennsylvania.
Kostoff, R. N. (1994) (editor) Evaluation Review 18 (1).
Kostoff, R. N. (1995) The handbook of research impact assessment. DTIC Report Number ADA296021. Office of Naval Research, Arlington, Virginia.
Lambert, J. (1985) Scientific and technical journals. Clive Bingley Ltd., London, UK.
Lindsey, D. (1978) The scientific publication system in social science. Jossey-Bass, San Francisco.
Mahoney, M. J. (1976) Scientist as subject: the pyschological imperative. Ballinger, Cambridge, Massachusetts.
National Academy of Sciences (1995) Allocating federal funds for science and technology. Washington: National Academy Press, B-680. http://www.nas.edu
National Science Foundation (1995a). Grant proposal guide. Arlington, Virginia: National Science Foundation. NSF95-27. http://www.nsf.gov/bfa/cpo/gpg/ch3.html 15 January 1995.
National Science Foundation (1995b) Improving proposal review: summary report of September 1995 workshop on improving peer review. http://www.nsf.gov/25 November 1995.
Peters, D. P. & Ceci, S. J. (1982) Peer-review practices of psychological journals: the fate of published articles, submitted again. Behavioral and Brain Sciences 5: 187–255.
Rennie, D. (editor) (1990) Journal of the American Medical Association 263 (10).
Rennie, D. & Flanagin, A. (editors) (1994) Journal of the American Medical Association 272 (2).
Shepard, G.B. (1995) Rejected: leading economists ponder the publication process. Thomas Horton and Daughters, Sun Lakes, Arizona.
Speek, B. W. (1993) Publication peer review: an annotated bibliography. Greenwood Press, Westport, Connecticut.
Zuckerman, H. & Merton, R. K. (1971) Patterns of evaluation in science: institutionalism, structure and functions of the referce system. Minerva 9: 66–100.
Author information
Authors and Affiliations
Additional information
The papers in this issue are based on presentations by the authors at AMSIE’96. the 162nd National Meeting of the American Association for the Advancement of Science. Baltimore. Maryland, 8–13 February 1996 in the session entitled Advances in Peer Review Research organized by Arthur E. Stamps III. The papers have been modified following double blind peer review. The views expressed are those of the authors and do not reflect the opinions of the AAAS or its Board of Directors.
This issue’ guest editor researches, lectures and publishes in the area of physical and social aspects of environmental quality. He is also a practicing architect.
Rights and permissions
About this article
Cite this article
Stamps, A.E. Advances in peer review research: an introduction. SCI ENG ETHICS 3, 3–10 (1997). https://doi.org/10.1007/s11948-997-0012-8
Issue Date:
DOI: https://doi.org/10.1007/s11948-997-0012-8