Europe PMC

This website requires cookies, and the limited processing of your personal data in order to function. By using the site you are agreeing to this as outlined in our privacy notice and cookie policy.

Abstract 


Background

The high disease burden of Africa, the emergence of new diseases and efforts to address the 10/90 gap have led to an unprecedented increase in health research activities in Africa. Consequently, there is an increase in the volume and complexity of protocols that ethics review committees in Africa have to review.

Methods

With a grant from the Bill and Melinda Gates Foundation, the African Malaria Network Trust (AMANET) undertook a survey of 31 ethics review committees (ERCs) across sub-Saharan Africa as an initial step to a comprehensive capacity-strengthening programme. The number of members per committee ranged from 3 to 21, with an average of 11. Members of 10 institutional committees were all from the institution where the committees were based, raising prima facie questions as to whether independence and objectivity could be guaranteed in the review work of such committees.

Results

The majority of the committees (92%) cited scientific design of clinical trials as the area needing the most attention in terms of training, followed by determination of risks and benefits and monitoring of research. The survey showed that 38% of the ERC members did not receive any form of training. In the light of the increasing complexity and numbers of health research studies being conducted in Africa, this deficit requires immediate attention.

Outcome

The survey identified areas of weakness in the operations of ERCs in Africa. Consequently, AMANET is addressing the identified needs and weaknesses through a 4-year capacity-building project.

Free full text 


J Med Ethics. 2009 Mar; 35(3): 189–193.
Published online 2009 Feb 20. https://doi.org/10.1136/jme.2008.025189
PMCID: PMC2643018
PMID: 19251972

Composition, training needs and independence of ethics review committees across Africa: are the gate-keepers rising to the emerging challenges?

Abstract

Background:

The high disease burden of Africa, the emergence of new diseases and efforts to address the 10/90 gap have led to an unprecedented increase in health research activities in Africa. Consequently, there is an increase in the volume and complexity of protocols that ethics review committees in Africa have to review.

Methods:

With a grant from the Bill and Melinda Gates Foundation, the African Malaria Network Trust (AMANET) undertook a survey of 31 ethics review committees (ERCs) across sub-Saharan Africa as an initial step to a comprehensive capacity-strengthening programme. The number of members per committee ranged from 3 to 21, with an average of 11. Members of 10 institutional committees were all from the institution where the committees were based, raising prima facie questions as to whether independence and objectivity could be guaranteed in the review work of such committees.

Results:

The majority of the committees (92%) cited scientific design of clinical trials as the area needing the most attention in terms of training, followed by determination of risks and benefits and monitoring of research. The survey showed that 38% of the ERC members did not receive any form of training. In the light of the increasing complexity and numbers of health research studies being conducted in Africa, this deficit requires immediate attention.

Outcome:

The survey identified areas of weakness in the operations of ERCs in Africa. Consequently, AMANET is addressing the identified needs and weaknesses through a 4-year capacity-building project.

Recent concerted efforts to address the Grand Challenges in Global Health1 2 and the 10/90 gap3 and to achieve the United Nations Millennium Development Goals (http://www.un.org/millenniumgoals/) have contributed to an unprecedented increase in health research involving humans in Africa. In the wake of such an increase in health research on mostly poverty-stricken and poorly educated populations, given Africa’s weak civic protection systems, it is imperative that attention be paid to the ethical review capacity of African health institutions. Review of research protocols before implementation is now regarded as one of the cornerstones of ethical research involving human participants, and some countries have made it a legal requirement.4 Various international and national guidelines also stipulate that ethical approval be a prerequisite for the commencement of research involving humans.

The main purpose of reviewing research protocols is to ensure that the research meets internationally acceptable scientific and ethical standards. It would be unethical for poorly designed research involving human beings to be approved, since data generated from such research would not contribute to the improvement of disease prevention or management. A holistic approach to reviewing research is critical, since issues that relate to ethical principles of autonomy, beneficence, non-maleficence and justice are equally important. One approach that has been proposed looks at seven requirements that should be considered when reviewing protocols, namely, the value of the research in terms of potential to improve health and/or knowledge, scientific validity in terms of experimental design, fair selection of participants in light of the scientific objectives of the research, favourable risk:benefit ratio with potential benefits outweighing potential risks, independent ethical review of the research before implementation, informed consent that emphasises voluntary participation, and respect for the participants recruited.5 In addition, community engagement has recently been recognised as a critical activity that helps to create an amicable relationship between researchers and the communities from which participants are drawn and demonstrates respect for communities as partners in research.6 7 It is imperative that ethical review committees (ERCs) that review the protocols are adequately knowledgeable about all these requirements; otherwise the welfare of people is compromised by approval of unethical research or wrongful rejection of scientifically and ethically sound research.

Although the requirements could be assessed during the review process, implementation of approved research protocols in the field, especially in developing countries, is bound to encounter practical challenges that are attributable to socio-economic factors.813 Thus, ethical approval alone does not necessarily ensure protection of the safety and welfare of research participants throughout the research; hence the need for approved research to be monitored by ERCs. Ethical review and subsequent monitoring of health research require adequate resources and trained ERCs, which are limited in various ways in most African committees.

Thus, although the majority of countries in Africa are reported to now have at least some form of ethical review process in place,1416 the operations of these processes are generally hindered by a combination of challenges, including scarcity of resources, inadequate training of members and poor staffing levels.14 16 17 For instance, a study on health research ethics review and needs of institutional ERCs in Tanzania showed that 49% of 45 respondents had not had any training in health research ethics review.18 Milford and colleagues also reported on the extent to which limited resources available to ethics committees in Africa could affect preparations for HIV vaccine trials.17 Another example is a case study of 12 African ERCs that showed inadequate training of committee members and shortage of resources to be some of the major challenges faced by the committees.19

In light of the relatively weak ethical review capacity in Africa, it is encouraging to note that a number of not-for-profit African organisations are involved in capacity-building programmes. The South African Research Ethics Training Initiative (SARETI) (http://shsph.up.ac.za/sareti/sareti.htm), which is based at the universities of KwaZulu-Natal and Pretoria in South Africa, provides training in ethics to African researchers and ERC members through short-term fellowships and long-term educational programmes. Another programme based in South Africa is the International Research Ethics Network for Southern Africa (IRENSA) (http://www.irensa.org), based at the University of Cape Town, which runs short-term training programmes for mid-career African academics, scientists, clinicians and members of ERCs who generally cannot enrol for long-term, full-time programmes. An additional organisation involved in providing educational programmes in Africa is the Training and Resources in Research Ethics Evaluation (TRREE) (http://www.trree.org/site/en_home.phtml) for Africa, which focuses on development of research ethics educational programmes for e-learning and provision of e-resources.

The African Malaria Network Trust (AMANET) (http://www.amanet-trust.org) is also a not-for-profit organisation that was formed in 2002, succeeding the then African Malaria Vaccine Testing Network, founded in 1995 to promote malaria vaccine trials in Africa. Although the broad objective of AMANET is still the same as that of its predecessor, the roles and activities of AMANET have been expanded to include (1) trial site development for malaria vaccine trials, which entails infrastructural development and training of research personnel in various scientific fields, (2) strengthening of ethical review capacity in Africa and (3) sponsorship of malaria vaccine clinical trials.

The current study by AMANET was aimed at finding specific gaps in the ethical review process in Africa with a view to effectively implementing a capacity-building programme tailor-made for the identified needs. Having such empirical data would go a long way towards ensuring that any interventions would complement efforts by others in this field rather than duplicate their activities, although a certain amount of overlap is both inevitable and harmless. The paucity of resources for ethical review process in Africa and the need to strengthen the process through various training programmes make it critical for the organisations working in this field to streamline their activities and programmes and promote synergistic collaborative efforts. Indeed, the efforts of the organisations are beginning to bear fruit. For instance, two ethicists working in the AMANET programmes are products of the SARETI training programmes, and an additional ethicist working with AMANET also actively takes part in both IRENSA and SARETI programmes.

In order to fill the gaps identified by the needs assessment survey, AMANET targeted ERCs as entities rather than individual members of the committees, an aspect being addressed by other organisations. Collaboration with the Pan African Bioethics Initiative started at the design stage of the current project and has continued to the implementation stage, where the two organisations jointly conduct some training workshops on health research ethics. This paper reports on the findings of the needs assessment survey and gives an overview of a longitudinal capacity-building project by AMANET.

METHODS

Information on the capacities and needs of ERCs in Africa was obtained through presentations by selected ethics committee members during three workshops organised by AMANET in Dar es Salaam and in Addis Ababa and a needs assessment survey conducted across Africa. The data gathered through the two methods were pooled together for analyses.

Ethics committee presentations at AMANET health research ethics workshops

Members of ethics committees attending the AMANET series of health research ethics workshops during 2007 were requested to present to the workshop participants the status and operations of their committees. The participants were requested to prepare presentations covering such issues as the committees’ composition, standard operating procedures, sources of funding, type of data management and archiving system, ethical review process and workload. This allowed interactive discussions on the shortcomings, strengths and needs of the various committees.

Needs assessment survey

A survey questionnaire, containing 103 questions covering general identifying information and sections on the establishment of the ERCs, membership and professional background of members, funding of the committees and ethical review process for 2005 and 2006 was designed and pilot tested at institutions in southern Africa, East Africa and West Africa. A French version of the questionnaire was prepared for use in francophone countries. Six surveyors all qualified in health research ethics were appointed to conduct physical surveys across sub-Saharan Africa. The respondents were either the chairpersons or administrators of the ethics committees surveyed. The completed questionnaires were compiled and double-entered in Microsoft Excel and analysed in Stata version 10 (Stata Corporation, College Station, Texas, USA) by a statistician.

RESULTS

Coverage

A response rate of about 84% (31/37) was achieved, making this the most comprehensive survey of ERCs in Africa that the authors are aware of. A total of 12 institutional ERCs from nine African countries gave presentations at two AMANET health research ethics training workshops held in Dar es Salaam, Tanzania (May and August 2007), and a third workshop held in Addis Ababa, Ethiopia, in September 2007. Gaps and shortcomings of the ERCs were identified and possible solutions explored during interactive discussions that followed each presentation. The presentations covered Cameroon, Ethiopia, Ghana, Kenya, Mali, Malawi, Nigeria, Senegal, Tanzania, Gambia, Uganda and Zambia. The ERCs that presented were among the 31 respondents that were interviewed by surveyors. The countries covered in the survey, which include anglophone, francophone and lusophone countries, are shown in table 1.

Table 1

Number and nature of ethics review committees (ERCs) surveyed per country
CountryNumber of ERCsAffiliation
Burkina Faso2All research-institute based
Cameroon2All research-institute based
Ethiopia2All research-institute based
Gabon1Research-institute based
Gambia1National
Ghana54 research-institute based, 1 university based
Kenya1National
Malawi1University based
Mali1University based
Mozambique1National
Nigeria41 university based, 3 research-institute based
Rwanda1National
Senegal1National
Sudan1University based
Tanzania41 national, 2 university based, 1 research-institute based
Uganda1University based
Zambia1Research-institute based
Zimbabwe1National
Total31

Composition of the ERCs

As shown in fig 1, the ERCs ranged in size from three to 21 members. The 31 ERCs surveyed had a total of 345 members, the average number of members per committee being 11. Regarding gender balance, about 33% (112/345) of the members of all 31 committees were female. Ten committees (32%) did not have any external members (that is, members not affiliated to the parent institutions where the respective committees were based). As shown in table 1, a total of seven committees are national, while seven and 17 are affiliated to universities and health research institutes, respectively.

An external file that holds a picture, illustration, etc.
Object name is MET-35-03-0189-f01.jpg
Composition of ethics review committees.

Constraints reported by respondents

The top five training needs cited by the respondents were scientific design of clinical trials, risk assessment of clinical trials, understanding of trial phases, monitoring of approved studies, and handling of issues surrounding post-trial access to benefits. Table 2 shows the major constraints that were highlighted by the respondents, the top two being inadequacy of resources available to the committees and limited expertise in the committees to review complex studies. Other frequently mentioned constraints were pressure from researchers, weak participation of members and low rating of the importance of the functions of ERCs. None of the respondents had electronic data management and archiving systems in place; they all relied on cumbersome, paper-based systems.

Table 2

Constraints hindering operations of ethics review committees (ERCs)
ConstraintsNumber of ERCs*
Insufficiency of resources25/30
Lack of/insufficient expertise on ethical review13/30
Pressure from researchers11/30
Lack of active/consistent participation of members11/30
Lack of recognition of the importance of ERC functions11/30
None or poorly supported by the institute10/30
Not completely independent4/30
Pressure from sponsors3/30
Unequal treatment of applicants in review1/27
Biased committee members0/27

*Respondents skipped some questions.

Duration of training, and training needs of ERCs

Overall, 38% of the members had not undergone any form of training in health research ethics. Table 3 shows the duration of training courses attended by the members of the surveyed committees.

Table 3

Duration of training of committee members reported by respondents
Duration of trainingNumber of committee members
None132
1 day13
2–3 days42
4–7 days92
>7 days48
Online training14
Not known4
Total345

Table 4 shows the training needs of ethics committees. Topics related to understanding the scientific design of research protocols in intervention trials were reported as being the greatest need, while topics related to identification of appropriate subjects scored the least. Other important topics identified include determination of potential risks of vaccines, trial phase determinants and monitoring/oversight activities.

Table 4

Training needs of ERCs in Africa, ranked by respondents
Training needsRanking
Very importantQuite importantImportantNot importantTotal institutions*
Scientific design issues in intervention trials27229
Determination of potential risks of malaria vaccine research253129
Determinations to run phases (I,II,III) in a country or community252128
Monitoring and oversight235129
Post-trial access to benefits (eg, successful intervention)2061128
The interpretation of preclinical studies197329
The use of placebo in controlled trials1693129
Assessment of understanding for informed consent16101128
Assessment of anticipated benefits1585129
Assessment of cultural sensitivity for informed consent1593128
Community participation14113129
Determination of appropriate subject selection in vulnerable population1485128
Determination of appropriate subject selection with regard to women1368128
Incentives for participation12105128
Social and behavioural studies12106129
Privacy and confidentiality11134129
Determination of appropriate subject selection with regard to minors1196127

*Some respondents did not answer some questions.

Independence of ERCs

Membership of 10 committees was entirely by staff employed at the institution, while the rest had varying involvement of members from “outside” the parent institution, such as community members, local universities, religious organisations, non-governmental organisations, civic organisations and professional associations. A large proportion (77%) of the surveyed committees relied on funds received from the institutions where they were based in 2005 and 2006. Figure 2 shows that a relatively smaller proportion of respondents received levies on projects reviewed, whereas application fees were a source of funding for a much smaller number of committees, about 20% for both years.

An external file that holds a picture, illustration, etc.
Object name is MET-35-03-0189-f02.jpg
Sources of funds for 31 ethics review committees surveyed.

DISCUSSION

This survey covered 31 ERCs of 37 targeted institutions; 12 of the 31 committees also presented at workshops organised by AMANET. This is to our knowledge the first survey ever to cover so many countries and institutions; previous surveys in Africa have been on a smaller scale and arguably less comprehensive. Furthermore, this survey included anglophone (eight institutions), francophone (22 institutions) and lusophone (1) institutions. Although this survey received replies from most African regions, replies from central Africa were rare. The relatively high response rate could be attributed to the personal visits by the surveyors. Encouragingly, only two of the 37 institutions lacked ethics review committees and did not complete the questionnaire. This is a great improvement from previous times,20 when the absence of ethics committees in many African countries was common.

The World Health Organization publication Operational guidelines for ethics committees that review biomedical research (2000) states:

Countries, institutions, and communities should strive to develop ECs and ethical review systems that ensure the broadest possible coverage of protection for potential research participants and contribute to the highest attainable quality in the science and ethics of biomedical research. States should promote, as appropriate, the establishment of ECs at the national, institutional, and local levels that are independent, multi-disciplinary, multi-sectorial, and pluralistic in nature. ECs require administrative and financial support (p2).21

The survey shows that most institutions across sub-Saharan Africa have established ethics committees. However, in order to effectively review protocols, ERCs should be composed of members of diverse backgrounds; many ethics committees surveyed are not yet sufficiently multidisciplinary or multi-sectoral. There are also weaknesses relating to gender and age. The UNAIDS (Joint United Nations Programme on HIV/AIDS) guidelines stipulate that an ERC should have a minimum of five members, and there is no upper limit that is set by guidelines. The current study revealed that membership is still problematic for some ERCs in sub-Saharan Africa, with some having as few as three members and others 19 or more. The major reasons cited for the wide variation in membership include unwillingness of potential members to participate in the committees over and above their normal duties and the lack of compensation for the costs incurred in attending ERC meetings. These issues need to be addressed if ERCs are to function properly.

Independence of the committees from their institutions is influenced by a number of factors. First, a committee made up of members from the institution that hosts it, without external members, faces a high risk of bias in its work. Second, reliance on the parent institution for financial support also compromises the independence of the ERC. It is therefore imperative that the ultimate goal should be to enable ERCs to generate adequate operational funds in order to reduce financial reliance on host institutions and also to attract members from outside the parent institution. This is all the more important in sub-Saharan Africa, given the limited financial and skilled human resources available and very poor personnel remuneration. However, the cost of running an ERC needs to be determined, if cost-effective fees are to be charged to ensure self-sustainability. Although in developed countries such as the USA, efforts have been made to determine running costs,22 the authors are not aware of such attempts made elsewhere, especially in Africa.

Training of members before or upon joining an ERC would help to orient them in terms of the standard operating procedures in place and the ethical review procedures of the particular committee. Whereas the volume of trials being conducted in Africa is increasing, 92% of the surveyed committees reported that they are inadequately trained to properly review and monitor trials. Since it may not be feasible for committee members to take long leaves of absence to undergo long-term training away from their workplaces, workshops and web-based courses in health research ethics could go a long way towards meeting the training needs of the committees. Despite the increasing popularity of e-learning, only 4% (14/345) of the members surveyed have benefited from these opportunities, and this percentage may even decrease as committees become more independent, multi-sectoral and pluralistic. Reliance on traditional pedagogical methods, with all their drawbacks, particularly in the least-developed countries, may be the only opportunity.

The survey revealed the training needs of ethics committees in sub-Saharan Africa. A closer examination of the responses is guiding the development of ongoing training of members of ethics committees and will be invaluable in the development of upcoming training of investigators.

Harmonisation of ethical review process

A study conducted in the USA showed variable decisions by different ERCs that reviewed the same protocol for a multi-centre genetic epidemiological study.23 Given the diversity of the ERCs in Africa, especially the weaknesses cited above, there is a high likelihood of diverse decisions if study protocols will be subjected to these committees, particularly in upcoming multi-centre studies. The need to harmonise ethical review in Africa is considered to be urgent. The harmonisation could first focus on procedural aspects of the ethical review process and subsequently address substantive aspects of ethical review, which could be more challenging than the former. However, for the harmonisation to be acceptable to the African ERCs and also effective in terms of improving the ethical review process, a participatory approach that includes all interested stakeholders is critical.

The survey also highlighted the need for clear roles and responsibilities of national ERCs in relation to institutional ERCs in countries where both national and institutional committees exist. The roles of the committees should be complementary rather than duplicative; it should be clear to the committees themselves and to potential applicants what type of health research protocols should be reviewed by the respective committees. Such clarity would go a long way towards minimising potential antagonism between the national and institutional ERCs of the same country.

CONCLUSIONS

This paper provides useful public information on the status of ethics committees that stakeholders in biomedical research in Africa would find useful. The major constraints identified are shortage of resources and inadequate training of the ERC members. Sponsors of clinical trials in Africa will also find this a useful inventory when considering compliance of trial sites to international recommendations, and it is hoped that the ethical review process and oversight of research will always be taken into account at the design stage of research in order to include the activities in the budget and in the project time frame.

The gaps identified through this survey should be addressed through dedicated capacity-strengthening providing specifically identified and tailor-made support to ensure improvement, instead of conducting such surveys merely for academic purposes. A careful post-intervention survey using the same evaluation tools would be important to gauge the effectiveness of the interventions implemented, and the results should be widely disseminated for the benefit of the members of the scientific community who are involved in health research. Fostering collaborative efforts with other organisations involved in capacity-building of the ethical review process in Africa could go a long way towards minimising the risk of duplication of activities, which would waste resources.

Acknowledgments

The survey leading to this report was undertaken by Awa Keita, Godfrey Tangwa, Joyce Ikingura, Kidist Bobosha, Paul Ndebele and Paulina Tindana. We are grateful to the institutions that were surveyed. The statistical analyses were done by Samuel Bosomprah. The project was generously funded by the Bill and Melinda Gates Foundation, grant number 37350.

Footnotes

Competing interests: None.

REFERENCES

1. Varmus H, Klausner R, Zerhouni E, et al. Public health. Grand challenges in global health. Science 2003;302:398–9 [Europe PMC free article] [Abstract] [Google Scholar]
2. Bill and Melinda Gates Foundation. Grand challenges in global health. http://www.gegh.org/Pages.default.aspx (accessed 11 December 2008) [Google Scholar]
3. Global Forum for Health Research. Helping to address the 10/90 gap. http://www.globalforumhealth.org/Site/002__What%20we%20do/005__Publications/001__10%2090%20reports.php (accessed 20 January 2008) [Google Scholar]
4. National Health Act 61 of 2003. Section 73 (2), South Africa. http://www.info.gov.za/gazette/acts/2003/a61–03.pdf (accessed 11 December 2008) [Google Scholar]
5. Emanuel EJ, Wendler D, Killen J, et al. What makes clinical research in developing countries ethical? The benchmarks of ethical research. J Infect Dis 2004;189:930–7 [Abstract] [Google Scholar]
6. Tindana PO, Singh JA, Tracy CS, et al. Grand challenges in global health: community engagement in research in developing countries. PLoS Med. 2007;4:e273 10. 1371/journal. pmed. 0040273. [Europe PMC free article] [Abstract] [Google Scholar]
7. Molyneux CS, Wassenaar DR, Peshu N, et al. ‘Even if they ask you to stand by a tree all day, you have to do it (laughter) …!’ Community voices on the notion and practice of informed consent for biomedical research in developing countries. Soc Sci Med 2005;61:443–54 [Abstract] [Google Scholar]
8. Lurie P, Bishaw M, Chesney MA, et al. Ethical, behavioural and social aspects of HIV vaccine trials in developing countries. JAMA 1994;271:295–301 [Abstract] [Google Scholar]
9. Varmus H, Satcher D. Ethical complexities of conducting research in developing countries. N Engl J Med 1997;337:1003–5 [Abstract] [Google Scholar]
10. Edejer TT. North-South research partnerships: the ethics of carrying out research in developing countries. BMJ 1999;319:438–41 [Europe PMC free article] [Abstract] [Google Scholar]
11. Shapiro HT, Meslin EM. Ethical issues in the design and conduct of clinical trials in developing countries. N Engl J Med 2001;345:139–42 [Abstract] [Google Scholar]
12. Fitzgerald DW, Marotte C, Verdier RI, et al. Comprehension during informed consent in a less-developed country. Lancet 2002;360:1301–2 [Abstract] [Google Scholar]
13. Emanuel EJ, Pace CA. The ethics of research in developing countries: assessing voluntariness. Lancet 2005;365:11–2 [Abstract] [Google Scholar]
14. Kirigia JM, Wambebe C, Baba-Moussa A. Status of national research bioethics committees in the WHO African region. BMC Med Ethics 2005;6:10–6 [Europe PMC free article] [Abstract] [Google Scholar]
15. Kennedy SB, Harris AO, Oudemans E, et al. Developing capacity to protect human research subjects in a post-conflict, resource-constrained setting: procedures and prospects. J Med Ethics 2006;32:592–5 [Europe PMC free article] [Abstract] [Google Scholar]
16. Effa P, Massougbodji A, Ntoumi F. Ethics committees in western and central Africa: concrete foundations. Dev World Bioeth 2007;7:136–42 [Abstract] [Google Scholar]
17. Milford C, Wassenaar D, Slack C. Resources and needs of research ethics committees in Africa: preparations for HIV vaccine trials. IRB 2006;28:1–9 [Abstract] [Google Scholar]
18. Ikingura JK, Kruger M, Zeleke W. Health research ethics review and needs of institutional ethics committees in Tanzania. Tanzan Health Res Bull 2007;9:154–8 [Abstract] [Google Scholar]
19. Kass NE, Hyder AA, Ajuwon A, et al. The structure and function of research ethics committees in Africa: a case study. PLoS Med. 2007;4:e3. 10. 1371/journal. pmed. 0040003. [Europe PMC free article] [Abstract] [Google Scholar]
20. Rugemalila J B, Kilama W L, ed. Proceedings of Seminar on Health Research Ethics in Africa. Acta Tropica 2001;78(1):S1–S16 [Abstract] [Google Scholar]
21. World Health Organization (WHO) Operational guidelines for ethics committees that review biomedical research Geneva: WHO, 2000; [Google Scholar]
22. Sugarman J, Getz K, Speckman JL, et al. The cost of institutional review boards in academic medical centers. N Engl J Med 2005;352:1825–7 [Abstract] [Google Scholar]
23. McWilliams R, Hoover-Fong J, Hamosh A, et al. Problematic variation in local institutional review of a multicenter genetic epidemiology study. JAMA 2003;290:360–6 [Abstract] [Google Scholar]

Articles from Journal of Medical Ethics are provided here courtesy of BMJ Publishing Group

Citations & impact 


Impact metrics

Jump to Citations

Citations of article over time

Alternative metrics

Altmetric item for https://www.altmetric.com/details/1297117
Altmetric
Discover the attention surrounding your research
https://www.altmetric.com/details/1297117

Article citations


Go to all (42) article citations