For decisions between many alternatives, the benchmark result is Hick's Law: that response time increases log-linearly with the number of choice alternatives. Even when Hick's Law is observed for response times, divergent results have been observed for error rates—sometimes error rates increase with the number of choice alternatives, and sometimes they are constant. We provide evidence from two experiments that error rates are mostly independent of the number of choice alternatives, unless context effects induce participants to trade speed for accuracy (...) across conditions. Error rate data have previously been used to discriminate between competing theoretical accounts of Hick's Law, and our results question the validity of those conclusions. We show that a previously dismissed optimal observer model might provide a parsimonious account of both response time and error rate data. The model suggests that people approximate Bayesian inference in multi-alternative choice, except for some perceptual limitations. (shrink)
Drawing on a landscape analysis of existing data-sharing initiatives, in-depth interviews with expert stakeholders, and public deliberations with community advisory panels across the U.S., we describe features of the evolving medical information commons. We identify participant-centricity and trustworthiness as the most important features of an MIC and discuss the implications for those seeking to create a sustainable, useful, and widely available collection of linked resources for research and other purposes.
At the forefront of international concerns about global legislation and regulation, a host of noted environmentalists and business ethicists examine ethical issues in consumption from the points of view of environmental sustainability, economic development, and free enterprise.
Table of contentsI1 Proceedings of the 4th World Conference on Research IntegrityConcurrent Sessions:1. Countries' systems and policies to foster research integrityCS01.1 Second time around: Implementing and embedding a review of responsible conduct of research policy and practice in an Australian research-intensive universitySusan Patricia O'BrienCS01.2 Measures to promote research integrity in a university: the case of an Asian universityDanny Chan, Frederick Leung2. Examples of research integrity education programmes in different countriesCS02.1 Development of a state-run “cyber education program of research ethics” in (...) KoreaEun Jung Ko, Jin Sun Kwak, TaeHwan Gwon, Ji Min Lee, Min-Ho LeeCS02.3 Responsible conduct of research teachers’ training courses in Germany: keeping on drilling through hard boards for more RCR teachersHelga Nolte, Michael Gommel, Gerlinde Sponholz3. The research environment and policies to encourage research integrityCS03.1 Challenges and best practices in research integrity: bridging the gap between policy and practiceYordanka Krastev, Yamini Sandiran, Julia Connell, Nicky SolomonCS03.2 The Slovenian initiative for better research: from national activities to global reflectionsUrsa Opara Krasovec, Renata SribarCS03.3 Organizational climate assessments to support research integrity: background of the Survey of Organizational Research Climate and the experience with its use at Michigan State UniversityBrian C. Martinson, Carol R. Thrush, C.K. Gunsalus4. Expressions of concern and retractionsCS04.1 Proposed guidelines for retraction notices and their disseminationIvan Oransky, Adam MarcusCS04.2 Watching retractions: analysis of process and practice, with data from the Wiley retraction archivesChris Graf, Verity Warne, Edward Wates, Sue JoshuaCS04.3 An exploratory content analysis of Expressions of ConcernMiguel RoigCS04.4 An ethics researcher in the retraction processMichael Mumford5. Funders' role in fostering research integrityCS05.1 The Fonds de Recherche du Québec’s institutional rules on the responsible conduct of research: introspection in the funding agency activitiesMylène Deschênes, Catherine Olivier, Raphaëlle Dupras-LeducCS05.2 U.S. Public Health Service funds in an international setting: research integrity and complianceZoë Hammatt, Raju Tamot, Robin Parker, Cynthia Ricard, Loc Nguyen-Khoa, Sandra TitusCS05.3 Analyzing decision making of funders of public research as a case of information asymmetryKarsten Klint JensenCS05.4 Research integrity management: Empirical investigation of academia versus industrySimon Godecharle, Ben Nemery, Kris Dierickx5A: Education: For whom, how, and what?CS05A.1 Research integrity or responsible conduct of research? What do we aim for?Mickey Gjerris, Maud Marion Laird Eriksen, Jeppe Berggren HoejCS05A.2 Teaching and learning about RCR at the same time: a report on Epigeum’s RCR poll questions and other assessment activitiesNicholas H. SteneckCS05A.4 Minding the gap in research ethics education: strategies to assess and improve research competencies in community health workers/promoteresCamille Nebeker, Michael Kalichman, Elizabeth Mejia Booen, Blanca Azucena Pacheco, Rebeca Espinosa Giacinto, Sheila Castaneda6. Country examples of research reward systems and integrityCS06.1 Improving systems to promote responsible research in the Chinese Academy of SciencesDing Li, Qiong Chen, Guoli Zhu, Zhonghe SunCS06.4 Exploring the perception of research integrity amongst public health researchers in IndiaParthasarathi Ganguly, Barna Ganguly7. Education and guidance on research integrity: country differencesCS07.1 From integrity to unity: how research integrity guidance differs across universities in Europe.Noémie Aubert Bonn, Kris Dierickx, Simon GodecharleCS07.2 Can education and training develop research integrity? The spirit of the UNESCO 1974 recommendation and its updatingDaniele Bourcier, Jacques Bordé, Michèle LeducCS07.3 The education and implementation mechanisms of research ethics in Taiwan's higher education: an experience in Chinese web-based curriculum development for responsible conduct of researchChien Chou, Sophia Jui-An PanCS07.4 Educating principal investigators in Swiss research institutions: present and future perspectivesLouis Xaver Tiefenauer8. Measuring and rewarding research productivityCS08.1 Altimpact: how research integrity underpins research impactDaniel Barr, Paul TaylorCS08.2 Publication incentives: just reward or misdirection of funds?Lyn Margaret HornCS08.3 Why Socrates never charged a fee: factors contributing to challenges for research integrity and publication ethicsDeborah Poff9. Plagiarism and falsification: Behaviour and detectionCS09.1 Personality traits predict attitude towards plagiarism of self and others in biomedicine: plagiarism, yes we can?Martina Mavrinac, Gordana Brumini, Mladen PetrovečkiCS09.2 Investigating the concept of and attitudes toward plagiarism for science teachers in Brazil: any challenges for research integrity and policy?Christiane Coelho Santos, Sonia VasconcelosCS09.3 What have we learnt?: The CrossCheck Service from CrossRefRachael LammeyCS09.4 High p-values as a sign of data fabrication/falsificationChris Hartgerink, Marcel van Assen, Jelte Wicherts10. Codes for research integrity and collaborationsCS10.1 Research integrity in cross-border cooperation: a Nordic exampleHanne Silje HaugeCS10.3 Research integrity, research misconduct, and the National Science Foundation's requirement for the responsible conduct of researchAaron MankaCS10.4 A code of conduct for international scientific cooperation: human rights and research integrity in scientific collaborations with international academic and industry partnersRaffael Iturrizaga11. Countries' efforts to establish mentoring and networksCS11.1 ENRIO : a network facilitating common approaches on research integrity in EuropeNicole FoegerCS11.2 Helping junior investigators develop in a resource-limited country: a mentoring program in PeruA. Roxana Lescano, Claudio Lanata, Gissella Vasquez, Leguia Mariana, Marita Silva, Mathew Kasper, Claudia Montero, Daniel Bausch, Andres G LescanoCS11.3 Netherlands Research Integrity Network: the first six monthsFenneke Blom, Lex BouterCS11.4 A South African framework for research ethics and integrity for researchers, postgraduate students, research managers and administratorsLaetus OK Lategan12. Training and education in research integrity at an early career stageCS12.1 Research integrity in curricula for medical studentsGustavo Fitas ManaiaCS12.2 Team-based learning for training in the responsible conduct of research supports ethical decision-makingWayne T. McCormack, William L. Allen, Shane Connelly, Joshua Crites, Jeffrey Engler, Victoria Freedman, Cynthia W. Garvan, Paul Haidet, Joel Hockensmith, William McElroy, Erik Sander, Rebecca Volpe, Michael F. VerderameCS12.4 Research integrity and career prospects of junior researchersSnezana Krstic13. Systems and research environments in institutionsCS13.1 Implementing systems in research institutions to improve quality and reduce riskLouise HandyCS13.2 Creating an institutional environment that supports research integrityDebra Schaller-DemersCS13.3 Ethics and Integrity Development Grants: a mechanism to foster cultures of ethics and integrityPaul Taylor, Daniel BarrCS13.4 A culture of integrity at KU LeuvenInge Lerouge, Gerard Cielen, Liliane Schoofs14. Peer review and its role in research integrityCS14.1 Peer review research across disciplines: transdomain action in the European Cooperation in Science and Technology “New Frontiers of Peer Review ”Ana Marusic, Flaminio SquazzoniCS14.2 Using blinding to reduce bias in peer reviewDavid VauxCS14.3 How to intensify the role of reviewers to promote research integrityKhalid Al-Wazzan, Ibrahim AlorainyCS14.4 Credit where credit’s due: professionalizing and rewarding the role of peer reviewerChris Graf, Verity Warne15. Research ethics and oversight for research integrity: Does it work?CS15.1 The psychology of decision-making in research ethics governance structures: a theory of bounded rationalityNolan O'Brien, Suzanne Guerin, Philip DoddCS15.2 Investigator irregularities: iniquity, ignorance or incompetence?Frank Wells, Catherine BlewettCS15.3 Academic plagiarismFredric M. Litto16. Research integrity in EuropeCS16.1 Whose responsibility is it anyway?: A comparative analysis of core concepts and practice at European research-intensive universities to identify and develop good practices in research integrityItziar De Lecuona, Erika Löfstrom, Katrien MaesCS16.2 Research integrity guidance in European research universitiesKris Dierickx, Noémie Bonn, Simon GodecharleCS16.3 Research Integrity: processes and initiatives in Science Europe member organisationsTony Peatfield, Olivier Boehme, Science Europe Working Group on Research IntegrityCS16.4 Promoting research integrity in Italy: the experience of the Research Ethics and Bioethics Advisory Committee of the Consiglio Nazionale delle Ricerche Cinzia Caporale, Daniele Fanelli17. Training programs for research integrity at different levels of experience and seniorityCS17.1 Meaningful ways to incorporate research integrity and the responsible conduct of research into undergraduate, graduate, postdoctoral and faculty training programsJohn Carfora, Eric Strauss, William LynnCS17.2 "Recognize, respond, champion": Developing a one-day interactive workshop to increase confidence in research integrity issuesDieter De Bruyn, Bracke Nele, Katrien De Gelder, Stefanie Van der BurghtCS17.4 “Train the trainer” on cultural challenges imposed by international research integrity conversations: lessons from a projectJosé Roberto Lapa e Silva, Sonia M. R. Vasconcelos18. Research and societal responsibilityCS18.1 Promoting the societal responsibility of research as an integral part of research integrityHelene IngierdCS18.2 Social responsibility as an ethical imperative for scientists: research, education and service to societyMark FrankelCS18.3 The intertwined nature of social responsibility and hope in scienceDaniel Vasgird, Stephanie BirdCS18.4 Common barriers that impede our ability to create a culture of trustworthiness in the research communityMark Yarborough19. Publication ethicsCS19.1 The authors' forum: A proposed tool to improve practices of journal editors and promote a responsible research environmentIbrahim Alorainy, Khalid Al-WazzanCS19.2 Quantifying research integrity and its impact with text analyticsHarold GarnerCS19.3 A closer look at authorship and publication ethics of multi- and interdisciplinary teamsLisa Campo-Engelstein, Zubin Master, Elise Smith, David Resnik, Bryn Williams-JonesCS19.4 Invisibility of duplicate publications in biomedicineMario Malicki, Ana Utrobicic, Ana Marusic20. The causes of bad and wasteful research: What can we do?CS20.1 From countries to individuals: unravelling the causes of bias and misconduct with multilevel meta-meta-analysisDaniele Fanelli, John PA IoannidisCS20.2 Reducing research waste by integrating systems of oversight and regulationGerben ter Riet, Tom Walley, Lex Marius BouterCS20.3 What are the determinants of selective reporting?: The example of palliative care for non-cancer conditionsJenny van der Steen, Lex BouterCS20.4 Perceptions of plagiarism, self-plagiarism and redundancy in research: preliminary results from a national survey of Brazilian PhDsSonia Vasconcelos, Martha Sorenson, Francisco Prosdocimi, Hatisaburo Masuda, Edson Watanabe, José Carlos Pinto, Marisa Palácios, José Lapa e Silva, Jacqueline Leta, Adalberto Vieyra, André Pinto, Mauricio Sant’Ana, Rosemary Shinkai21. Are there country-specific elements of misconduct?CS21.1 The battle with plagiarism in Russian science: latest developmentsBoris YudinCS21.2 Researchers between ethics and misconduct: A French survey on social representations of misconduct and ethical standards within the scientific communityEtienne Vergès, Anne-Sophie Brun-Wauthier, Géraldine VialCS21.3 Experience from different ways of dealing with research misconduct and promoting research integrity in some Nordic countriesTorkild VintherCS21.4 Are there specifics in German research misconduct and the ways to cope with it?Volker Bähr, Charité22. Research integrity teaching programmes and their challengesCS22.1 Faculty mentors and research integrityMichael Kalichman, Dena PlemmonsCS22.2 Training the next generation of scientists to use principles of research quality assurance to improve data integrity and reliabilityRebecca Lynn Davies, Katrina LaubeCS22.3 Fostering research integrity in a culturally-diverse environmentCynthia Scheopner, John GallandCS22.4 Towards a standard retraction formHervé Maisonneuve, Evelyne Decullier23. Commercial research and integrityCS23.1 The will to commercialize: matters of concern in the cultural economy of return-on-investment researchBrian NobleCS23.2 Quality in drug discovery data reporting: a mission impossible?Anja Gilis, David J. Gallacher, Tom Lavrijssen, Malwitz David, Malini Dasgupta, Hans MolsCS23.3 Instituting a research integrity policy in the context of semi-private-sector funding: an example in the field of occupational health and safetyPaul-Emile Boileau24. The interface of publication ethics and institutional policiesCS24.1 The open access ethical paradox in an open government effortTony SavardCS24.2 How journals and institutions can work together to promote responsible conductEric MahCS24.3 Improving cooperation between journals and research institutions in research integrity casesElizabeth Wager, Sabine Kleinert25. Reproducibility of research and retractionsCS25.1 Promoting transparency in publications to reduce irreproducibilityVeronique Kiermer, Andrew Hufton, Melanie ClyneCS25.2 Retraction notices issued for publications by Latin American authors: what lessons can we learn?Sonia Vasconcelos, Renan Moritz Almeida, Aldo Fontes-Pereira, Fernanda Catelani, Karina RochaCS25.3 A preliminary report of the findings from the Reproducibility Project: Cancer biologyElizabeth Iorns, William Gunn26. Research integrity and specific country initiativesCS26.1 Promoting research integrity at CNRS, FranceMichèle Leduc, Lucienne LetellierCS26.2 In pursuit of compliance: is the tail wagging the dog?Cornelia MalherbeCS26.3 Newly established research integrity policies and practices: oversight systems of Japanese research universitiesTakehito Kamata27. Responsible conduct of research and country guidelinesCS27.1 Incentives or guidelines? Promoting responsible research communication through economic incentives or ethical guidelines?Vidar EnebakkCS27.3 Responsible conduct of research: a view from CanadaLynn PenrodCS27.4 The Danish Code of Conduct for Research Integrity: a national initiative to promote research integrity in DenmarkThomas Nørgaard, Charlotte Elverdam28. Behaviour, trust and honestyCS28.1 The reasons behind non-ethical behaviour in academiaYves FassinCS28.2 The psychological profile of the dishonest scholarCynthia FekkenCS28.3 Considering the implications of Dan Ariely’s keynote speech at the 3rd World Conference on Research Integrity in MontréalJamal Adam, Melissa S. AndersonCS28.4 Two large surveys on psychologists’ views on peer review and replicationJelte WichertsBrett Buttliere29. Reporting and publication bias and how to overcome itCS29.1 Data sharing: Experience at two open-access general medical journalsTrish GrovesCS29.2 Overcoming publication bias and selective reporting: completing the published recordDaniel ShanahanCS29.3 The EQUATOR Network: promoting responsible reporting of health research studiesIveta Simera, Shona Kirtley, Eleana Villanueva, Caroline Struthers, Angela MacCarthy, Douglas Altman30. The research environment and its implications for integrityCS30.1 Ranking of scientists: the Russian experienceElena GrebenshchikovaCS30.4 From cradle to grave: research integrity, research misconduct and cultural shiftsBronwyn Greene, Ted RohrPARTNER SYMPOSIAPartner Symposium AOrganized by EQUATOR Network, Enhancing the Quality and Transparency of Health ResearchP1 Can we trust the medical research literature?: Poor reporting and its consequencesIveta SimeraP2 What can BioMed Central do to improve published research?Daniel Shanahan, Stephanie HarrimanP3 What can a "traditional" journal do to improve published research?Trish GrovesP4 Promoting good reporting practice for reliable and usable research papers: EQUATOR Network, reporting guidelines and other initiativesCaroline StruthersPartner Symposium COrganized by ENRIO, the European Network of Research Integrity OfficersP5 Transparency and independence in research integrity investigations in EuropeKrista Varantola, Helga Nolte, Ursa Opara, Torkild Vinther, Elizabeth Wager, Thomas NørgaardPartner Symposium DOrganized by IEEE, the Institute of Electrical and Electronics EngineersRe-educating our author community: IEEE's approach to bibliometric manipulation, plagiarism, and other inappropriate practicesP6 Dealing with plagiarism in the connected world: An Institute of Electrical and Electronics Engineers perspectiveJon RokneP7 Should evaluation of raises, promotion, and research proposals be tied to bibliometric indictors? What the Institute of Electrical and Electronics Engineers is doing to answer this questionGianluca SettiP8 Recommended practices to ensure conference content qualityGordon MacPhersonPartner Symposium EOrganized by the Committee on Freedom and Responsibility in the Conduct of Science of ICSU, the International Council for ScienceResearch assessment and quality in science: perspectives from international science and policy organisationsP9 Challenges for science and the problems of assessing researchEllen HazelkornP10 Research assessment and science policy developmentCarthage SmithP11 Research integrity in South Africa: the value of procedures and processes to global positioningRobert H. McLaughlinP12 Rewards, careers and integrity: perspectives of young scientists from around the worldTatiana Duque MartinsPartner Symposium FOrganized by the Online Resource Center for Ethics Education in Engineering and Science / Center for Engineering, Ethics, and Society of the National Academy of EngineeringP13 Research misconduct: conceptions and policy solutionsTetsuya Tanimoto, Nicholas Steneck, Daniele Fanelli, Ragnvald Kalleberg, Tajammul HusseinPartner Symposium HOrganized by ORI, the Office of Research Integrity; Universitas 21; and the Asia Pacific Research Integrity NetworkP14 International integrity networks: working together to ensure research integrityPing Sun, Ovid Tzeng, Krista Varantola, Susan ZimmermanPartner Symposium IOrganized by COPE, the Committee on Publication EthicsPublication without borders: Ethical challenges in a globalized worldP15 Authorship: credit and responsibility, including issues in large and interdisciplinary studiesRosemary ShinkaiPartner Symposium JOrganized by CITI, the Cooperative Institutional Training InitiativeExperiences on research integrity educational programs in Colombia, Costa Rica and PeruP16 Experiences in PeruRoxana LescanoP17 Experiences in Costa RicaElizabeth HeitmanP18 Experiences in ColumbiaMaria Andrea Rocio del Pilar Contreras NietoPoster Session B: Education, training, promotion and policyPT.01 The missing role of journal editors in promoting responsible researchIbrahim Alorainy, Khalid Al-WazzanPT.02 Honorary authorship in Taiwan: why and who should be in charge?Chien Chou, Sophia Jui-An PanPT.03 Authorship and citation manipulation in academic researchEric Fong, Al WilhitePT.04 Open peer review of research submission at medical journals: experience at BMJ Open and The BMJTrish GrovesPT.05 Exercising authorship: claiming rewards, practicing integrityDésirée Motta-RothPT.07 Medical scientists' views on publication culture: a focus group studyJoeri Tijdink, Yvo SmuldersPoster Session B: Education, training, promotion and policyPT.09 Ethical challenges in post-graduate supervisionLaetus OK LateganPT.10 The effects of viable ethics instruction on international studentsMichael Mumford, Logan Steele, Logan Watts, James Johnson, Shane Connelly, Lee WilliamsPT.11 Does language reflect the quality of research?Gerben ter Riet, Sufia Amini, Lotty Hooft, Halil KilicogluPT.12 Integrity complaints as a strategic tool in policy decision conflictsJanneke van Seters, Herman Eijsackers, Fons Voragen, Akke van der Zijpp and Frans BromPoster Session C: Ethics and integrity intersectionsPT.14 Regulations of informed consent: university-supported research processes and pitfalls in implementationBadaruddin Abbasi, Naif Nasser AlmasoudPT.15 A review of equipoise as a requirement in clinical trialsAdri LabuschagnePT.16 The Research Ethics Library: online resource for research ethics educationJohanne Severinsen, Espen EnghPT.17 Research integrity: the view from King Abdulaziz City for Science and TechnologyDaham Ismail AlaniPT. 18 Meeting global challenges in high-impact publications and research integrity: the case of the Malaysian Palm Oil BoardHJ. Kamaruzaman JusoffPT.19 University faculty perceptions of research practices and misconductAnita Gordon, Helen C. HartonPoster Session D: International perspectivesPT.21 The Commission for Scientific Integrity as a response to research fraudDieter De Bruyn, Stefanie Van der BurghtPT. 22 Are notions of the responsible conduct of research associated with compliance with requirements for research on humans in different disciplinary traditions in Brazil?Karina de Albuquerque Rocha, Sonia Maria Ramos de VasconcelosPT.23 Creating an environment that promotes research integrity: an institutional model of Malawi Liverpool Welcome TrustLimbanazo MatandikaPT.24 How do science policies in Brazil influence user-engaged ecological research?Aline Carolina de Oliveira Machado Prata, Mark William NeffPoster Session E: Perspectives on misconductPT.26 What “causes” scientific misconduct?: Testing major hypotheses by comparing corrected and retracted papersDaniele Fanelli, Rodrigo Costas, Vincent LarivièrePT.27 Perception of academic plagiarism among dentistry studentsDouglas Leonardo Gomes Filho, Diego Oliveira GuedesPT. 28 a few bad apples?: Prevalence, patterns and attitudes towards scientific misconduct among doctoral students at a German university hospitalVolker Bähr, Niklas Keller, Markus Feufel, Nikolas OffenhauserPT. 29 Analysis of retraction notices published by BioMed CentralMaria K. Kowalczuk, Elizabeth C. MoylanPT.31 "He did it" doesn't work: data security, incidents and partnersKatie SpeanburgPoster Session F: Views from the disciplinesPT.32 Robust procedures: a key to generating quality results in drug discoveryMalini Dasgupta, Mariusz Lubomirski, Tom Lavrijssen, David Malwitz, David Gallacher, Anja GillisPT.33 Health promotion: criteria for the design and the integrity of a research projectMaria Betânia de Freitas Marques, Laressa Lima Amâncio, Raphaela Dias Fernandes, Oliveira Patrocínio, and Cláudia Maria Correia Borges RechPT.34 Integrity of academic work from the perspective of students graduating in pharmacy: a brief research studyMaria Betânia de Freitas Marques, Cláudia Maria Correia Borges Rech, Adriana Nascimento SousaPT.35 Research integrity promotion in the Epidemiology and Health Services, the journal of the Brazilian Unified Health SystemLeila Posenato GarciaPT.36 When are clinical trials registered? An analysis of prospective versus retrospective registration of clinical trials published in the BioMed Central series, UKStephanie Harriman, Jigisha PatelPT.37 Maximizing welfare while promoting innovation in drug developmentFarida LadaOther posters that will be displayed but not presented orally:PT.38 Geoethics and the debate on research integrity in geosciencesGiuseppe Di Capua, Silvia PeppoloniPT.39 Introducing the Professionalism and Integrity in Research Program James M. DuBois, John Chibnall, Jillon Van der WallPT.40 Validation of the professional decision-making in research measureJames M. DuBois, John Chibnall, Jillon Van der Wall, Raymond TaitPT.41 General guidelines for research ethicsJacob HolenPT. 42 A national forum for research ethicsAdele Flakke Johannessen, Torunn EllefsenPT.43 Evaluation of integrity in coursework: an approach from the perspective of the higher education professorClaudia Rech, Adriana Sousa, Maria Betânia de Freitas MarquesPT.44 Principles of geoethics and research integrity applied to the European Multidisciplinary Seafloor and Water Column Observatory, a large-scale European environmental research infrastructureSilvia Peppoloni, Giuseppe Di Capua, Laura BeranzoliF1 Focus track on improving research systems: the role of fundersPaulo S.L. Beirão, Susan ZimmermanF2 Focus track on improving research systems: the role of countriesSabine Kleinert, Ana MarusicF3 Focus track on improving research systems: the role of institutionsMelissa S. Anderson, Lex Bouter. (shrink)
After more than 15 years of study, the 1/f noise or complex-systems approach to cognitive science has delivered promises of progress, colorful verbiage, and statistical analyses of phenomena whose relevance for cognition remains unclear. What the complex-systems approach has arguably failed to deliver are concrete insights about how people perceive, think, decide, and act. Without formal models that implement the proposed abstract concepts, the complex-systems approach to cognitive science runs the danger of becoming a philosophical exercise in futility. The complex-systems (...) approach can be informative and innovative, but only if it is implemented as a formal model that allows concrete prediction, falsification, and comparison against more traditional approaches. (shrink)
Most models of response time (RT) in elementary cognitive tasks implicitly assume that the speed-accuracy trade-off is continuous: When payoffs or instructions gradually increase the level of speed stress, people are assumed to gradually sacrifice response accuracy in exchange for gradual increases in response speed. This trade-off presumably operates over the entire range from accurate but slow responding to fast but chance-level responding (i.e., guessing). In this article, we challenge the assumption of continuity and propose a phase transition model for (...) RTs and accuracy. Analogous to the fast guess model (Ollman, 1966), our model postulates two modes of processing: a guess mode and a stimulus-controlled mode. From catastrophe theory, we derive two important predictions that allow us to test our model against the fast guess model and against the popular class of sequential sampling models. The first prediction—hysteresis in the transitions between guessing and stimulus-controlled behavior—was confirmed in an experiment that gradually changed the reward for speed versus accuracy. The second prediction—bimodal RT distributions—was confirmed in an experiment that required participants to respond in a way that is intermediate between guessing and accurate responding. (shrink)
The probabilistic approach to human reasoning is exemplified by the information gain model for the Wason card selection task. Although the model is elegant and original, several key aspects of the model warrant further discussion, particularly those concerning the scope of the task and the choice process of individuals.
A frequentist confidence interval can be constructed by inverting a hypothesis test, such that the interval contains only parameter values that would not have been rejected by the test. We show how a similar definition can be employed to construct a Bayesian support interval. Consistent with Carnap’s theory of corroboration, the support interval contains only parameter values that receive at least some minimum amount of support from the data. The support interval is not subject to Lindley’s paradox and provides an (...) evidence-based perspective on inference that differs from the belief-based perspective that forms the basis of the standard Bayesian credible interval. (shrink)
Jones & Love (J&L) suggest that Bayesian approaches to the explanation of human behavior should be constrained by mechanistic theories. We argue that their proposal misconstrues the relation between process models, such as the Bayesian model, and mechanisms. While mechanistic theories can answer specific issues that arise from the study of processes, one cannot expect them to provide constraints in general.
In this paper we study abstract elementary classes of modules. We give several characterizations of when the class of modules A with is abstract elementary class with respect to the notion that M1 is a strong submodel M2 if the quotient remains in the given class.
This collection addresses the central issue of political philosophy or, in a couple of cases, issues very close to the heart of that question: Is government justified? This ancient question has never been more alive than at the present time, in the midst of continuing political and social upheaval in virtually every part of the world. Only two of the pieces collected here have been published previously. All the other contributions were, at the time of the inception of the volume, (...) fresh from the pens, or still to emerge from the pens, of their authors. (shrink)
The field of psychology, including cognitive science, is vexed by a crisis of confidence. Although the causes and solutions are varied, we focus here on a common logical problem in inference. The default mode of inference is significance testing, which has a free lunch property where researchers need not make detailed assumptions about the alternative to test the null hypothesis. We present the argument that there is no free lunch; that is, valid testing requires that researchers test the null against (...) a well-specified alternative. We show how this requirement follows from the basic tenets of conventional and Bayesian probability. Moreover, we show in both the conventional and Bayesian framework that not specifying the alternative may lead to rejections of the null hypothesis with scant evidence. We review both frequentist and Bayesian approaches to specifying alternatives, and we show how such specifications improve inference. The field of cognitive science will benefit because consideration of reasonable alternatives will undoubtedly sharpen the intellectual underpinnings of research. (shrink)
The replicability of findings in experimental psychology can be improved by distinguishing sharply between hypothesis-generating research and hypothesis-testing research. This distinction can be achieved by preregistration, a method that has recently attracted widespread attention. Although preregistration is fair in the sense that it inoculates researchers against hindsight bias and confirmation bias, preregistration does not allow researchers to analyze the data flexibly without the analysis being demoted to exploratory. To alleviate this concern we discuss how researchers may conduct blinded analyses. As (...) with preregistration, blinded analyses break the feedback loop between the analysis plan and analysis outcome, thereby preventing cherry-picking and significance seeking. However, blinded analyses retain the flexibility to account for unexpected peculiarities in the data. We discuss different methods of blinding, offer recommendations for blinding of popular experimental designs, and introduce the design for an online blinding protocol. (shrink)