The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
A Systematic Review of the Empirical Literature Evaluating IRBs: What We Know and What We Still Need to Learn
Open accessAbstract
Institutional review boards (IRBs) are integral to the U.S. system of protection of human research participants. Evaluation of IRBs, although difficult, is essential. To date, no systematic review of IRB studies has been published. We conducted a systematic review of empirical studies of U.S. IRBs to determine what is known about the function of IRBs and to identify gaps in knowledge. A structured search in PubMed identified forty-three empirical studies evaluating U.S. IRBs. Studies were included if they reported an empirical investigation of the structure, process, outcomes, effectiveness, or variation of U.S. IRBs. The authors reviewed each study to extract information about study objectives, sample and methods, study results, and conclusions. Empirical evidence collected in forty-three published studies shows that for review of a wide range of types of research, U.S. IRBs differ in their application of the federal regulations, in the time they take to review studies, and in the decisions made. Existing studies show evidence of variation in multicenter review, inconsistent or ambiguous interpretation of the federal regulations, and inefficiencies in review. Despite recognition of a need to evaluate effectiveness of IRB review, no identified published study included an evaluation of IRB effectiveness. Multiple studies evaluating the structure, process, and outcome of IRB review in the United States have documented inconsistencies and inefficiencies. Efforts should be made to address these concerns. Additional research is needed to understand how IRBs accomplish their objectives, what issues they find important, what quality IRB review is, and how effective IRBs are at protecting human research participants.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Safar, P., & Grenvik, A. (1971) · Chest · doi:10.1378/chest.59.5.535 · Cited by 1,989
Shah, S. (2004) · JAMA · doi:10.1001/jama.291.4.476 · Cited by 292
Responsible Research: A Systems Approach to Protecting Research Participants
Federman, D. D., Hanna, K. E., & Rodriguez, L. L. (2013) · Cited by 218
Problematic Variation in Local Institutional Review of a Multicenter Genetic Epidemiology Study
McWilliams, R. (2003) · JAMA · doi:10.1001/jama.290.3.360 · Cited by 196
Oversight of Human Participants Research: Identifying Problems To Evaluate Reform Proposals
Emanuel, E. J., Wood, A., Fleischman, A., Bowen, A., Getz, K. A., Grady, C., Levine, C., Hammerschmidt, D. E., Faden, R., Eckenwiler, L., et al. (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-141-4-200408170-00008 · Cited by 195
Self-citationVariability among institutional review boards’ decisions within the context of a multicenter trial
Silverman, H., Hull, S. C., & Sugarman, J. (2001) · Critical Care Medicine · doi:10.1097/00003246-200102000-00002 · Cited by 191
Breaking the Camel's Back: Multicenter Clinical Trials and Local Institutional Review Boards
Burman, W. J., Reves, R. R., Cohn, D. L., & Schooley, R. T. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-2-200101160-00016 · Cited by 157
Coleman, C. H., & Bouësseau, M.-C. (2008) · BMC Medical Ethics · doi:10.1186/1472-6939-9-6 · Cited by 150
Impact of Institutional Review Board Practice Variation on Observational Health Services Research
Green, L. A., Lowery, J. C., Kowalski, C. P., & Wyszewianski, L. (2005) · Health Services Research · doi:10.1111/j.1475-6773.2005.00458.x · Cited by 145
The Dysregulation of Human Subjects Research
Fost, N., & Levine, R. J. (2007) · JAMA · doi:10.1001/jama.298.18.2196 · Cited by 122
Cited by
Where are human subjects in big data research? the emerging ethics divide
Metcalf, J., & Crawford, K. (2016) · Big Data & Society · doi:10.1177/2053951716650211 · Cited by 394
Large image datasets: A pyrrhic win for computer vision?
Birhane, A., & Prabhu, V. U. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00158 · Cited by 257
Governing AI‐Driven Health Research: Are IRBs Up to the Task?
Friesen, P., Douglas‐Jones, R., Marks, M., Pierce, R., Fletcher, K., Mishra, A., Lorimer, J., Véliz, C., Hallowell, N., Graham, M., et al. (2021) · Ethics & Human Research · doi:10.1002/eahr.500085 · Cited by 50
Fixing Research Subjects Protection in the United States: Moving Beyond Consent
Koenig, B. A. (2013) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2013.03.010 · Cited by 7
Metadata
- Authors
- Abbott, L., & Grady, C.
- Venue
- Journal of Empirical Research on Human Research Ethics
- Publisher
- SAGE Publications
- Published
- 2011-03
- Volume
- 6
- Issue
- 1
- Pages
- 3-19
- ISSN
- 1556-2646 (ISSN-L)
- 1556-2654
- OpenAlex
- W2156812612
- Cited by
- 289
- References
- 36
- FWCI
- 2.42
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.