The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Readability Standards for Informed-Consent Forms as Compared with Actual Readability
Open accessAbstract
BACKGROUND: Institutional review boards (IRBs) are charged with safeguarding potential research subjects with limited literacy but may have an inadvertent role in promulgating unreadable consent forms. We hypothesized that text provided by IRBs in informed-consent forms falls short of the IRBs' own readability standards and that readability is influenced by the level of research activity, local literacy rates, and federal oversight. METHODS: To test these hypotheses, we conducted a cross-sectional study linking data from several public-use sources. A total of 114 Web sites of U.S. medical schools were surveyed for IRB readability standards and informed-consent-form templates. Actual readability was measured with the Flesch-Kincaid scale, which assigns a score on the basis of the minimal grade level required to read and understand English text (range, 0 to 12). Data on the level of research activity, local literacy rates, and federal oversight were obtained from organizational Web sites. RESULTS: The average readability score for text provided by IRBs was 10.6 (95 percent confidence interval, 10.3 to 10.8) on the Flesch-Kincaid scale. Specific readability standards, found on 61 Web sites (54 percent), ranged from a 5th-grade reading level to a 10th-grade reading level. The mean Flesch-Kincaid scores for the readability of sample text provided by IRBs exceeded the stated standard by 2.8 grade levels (95 percent confidence interval, 2.4 to 3.2; P<0.001). Readability was not associated with either the level of research funding (P=0.89) or local rates of literacy (P=0.92). However, the 52 schools that had been made subject to oversight by the Office for Human Research Protections (46 percent) had lower Flesch-Kincaid scores than the other schools (10.2 vs. 10.9, P=0.005). CONCLUSIONS: IRBs commonly provide text for informed-consent forms that falls short of their own readability standards. Federal oversight is associated with better readability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kincaid, J. P., Fishburne, Jr., Robert P., R., Richard L., C., & Brad, S. (1975) · doi:10.21236/ada006655 · Cited by 3,497
A history and theory of informed consent
Kapp, M. B. (1986) · Journal of Legal Medicine · doi:10.1080/01947648609513478 · Cited by 2,331
Teaching Patients with Low Literacy Skills
Doak, C. C., Doak, L. G., & Root, J. H. (1996) · American Journal of Nursing · doi:10.1097/00000446-199612000-00022 · Cited by 1,432
Teaching patients with low literacy skills
(2001) · PsycEXTRA Dataset · doi:10.1037/e518822004-001 · Cited by 1,229
Health Literacy: Report of the Council on Scientific Affairs
Ad Hoc Committee on Health Literacy for the Council on Scientific Affairs, A. M. A. (1999) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.281.6.552 · Cited by 1,123
Adult literacy in America : a first look at the results of the National Adult Literacy Survey
Kirsch, I. S., & Improvement (1993) · Cited by 814
Kincaid, J. P., Robert, P. F. L., Richard, L. R., & Brad, S. (1975) · Cited by 739
Inadequate Literacy Is a Barrier to Asthma Knowledge and Self-Care
Williams, M. V., Baker, D. W., Honig, E. G., Lee, T. M., & Nowlan, A. (1998) · Chest · doi:10.1378/chest.114.4.1008 · Cited by 660
A History and Theory of Informed Consent
Faden, R., Beauchamp, T. L., & King, N. M. P. (1986) · Cited by 536
Andrus, M. R., & Roth, M. T. (2002) · Pharmacotherapy: The Journal of Human Pharmacology and Drug Therapy · doi:10.1592/phco.22.5.282.33191 · Cited by 445
Cited by
Quick Assessment of Literacy in Primary Care: The Newest Vital Sign
Weiss, B. D. (2005) · The Annals of Family Medicine · doi:10.1370/afm.405 · Cited by 2,215
Fogel, D. B. (2018) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2018.08.001 · Cited by 1,035
Single-Donor, Marginal-Dose Islet Transplantation in Patients With Type 1 Diabetes
Hering, B. J. (2005) · JAMA · doi:10.1001/jama.293.7.830 · Cited by 592
Magnani, J. W., Mujahid, M. S., Aronow, H. D., Cené, C. W., Dickson, V. V., Havranek, E., Morgenstern, L. B., Paasche-Orlow, M. K., Pollak, A., Willey, J. Z., et al. (2018) · Circulation · doi:10.1161/cir.0000000000000579 · Cited by 581
Self-citationKorfiatis, N., García-Bariocanal, E., & Sánchez-Alonso, S. (2012) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2011.10.003 · Cited by 548
Manipulation of online reviews: An analysis of ratings, readability, and sentiments
Hu, N., Bose, I., Koh, N. S., & Liu, L. (2012) · Decision Support Systems · doi:10.1016/j.dss.2011.11.002 · Cited by 530
Enduring and Emerging Challenges of Informed Consent
Grady, C. (2015) · New England Journal of Medicine · doi:10.1056/nejmra1411250 · Cited by 465
Schenker, Y., Fernandez, A., Sudore, R., & Schillinger, D. (2011) · Medical Decision Making · doi:10.1177/0272989x10364247 · Cited by 445
Wang, L.-W., Miller, M. J., Schmitt, M. R., & Wen, F. K. (2013) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2012.05.009 · Cited by 445
Schenker, Y., Wang, F., Selig, S. J., Ng, R., & Fernandez, A. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0359-1 · Cited by 443
The Utilization of Testing and Counseling for HIV: A Review of the Social and Behavioral Evidence
Obermeyer, C. M., & Osborn, M. (2007) · American Journal of Public Health · doi:10.2105/ajph.2006.096263 · Cited by 394
McCray, A. T. (2004) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1687 · Cited by 371
Patient involvement in clinical research: why, when, and how
Sacristan, J. A., Aguaron, A., Avendaño, C., Garrido, P., Carrion, J., Gutierrez, A., Kroes, R., & Flores, A. (2016) · Patient Preference and Adherence · doi:10.2147/ppa.s104259 · Cited by 363
EVALUATION OF LITERACY LEVEL OF PATIENT EDUCATION PAGES IN HEALTH-RELATED JOURNALS
Cotugna, N., Vickery, C. E., & Carpenter-Haefele, K. M. (2005) · Journal of Community Health · doi:10.1007/s10900-004-1959-x · Cited by 344
Improvement of informed consent and the quality of consent documents
Jefford, M., & Moore, R. (2008) · The Lancet Oncology · doi:10.1016/s1470-2045(08)70128-1 · Cited by 336
Carlyle, K. E., & Steinman, K. J. (2007) · Journal of School Health · doi:10.1111/j.1746-1561.2007.00242.x · Cited by 320
Zaretsky, J., Kim, J. M., Baskharoun, S., Zhao, Y., Austrian, J., Aphinyanaphongs, Y., Gupta, R., Blecker, S. B., & Feldman, J. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.0357 · Cited by 303
Lessons learned from the gene therapy trial for ornithine transcarbamylase deficiency
Wilson, J. M. (2009) · Molecular Genetics and Metabolism · doi:10.1016/j.ymgme.2008.12.016 · Cited by 299
Assessing reading levels of health information: uses and limitations of flesch formula
Jindal, P., & MacDermid, J. (2017) · Education for Health · doi:10.4103/1357-6283.210517 · Cited by 275
Informed consent process: A step further towards making it meaningful!
Kadam, R. A. (2017) · Perspectives in Clinical Research · doi:10.4103/picr.picr_147_16 · Cited by 268
(2004) · Europe PMC (PubMed Central) · Cited by 257
Internet Usage by Low-Literacy Adults Seeking Health Information: An Observational Analysis
Birru, M. S., Monaco, V. M., Charles, L., Drew, H., Njie, V., Bierria, T., Detlefsen, E., & Steinman, R. A. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.3.e25 · Cited by 220
“Low health literacy is also a barrier to enrollment in clinical trials [5,6] and minimizes adherence to instructions given by health professionals [7].”
BackgroundLessons from HeLa Cells: The Ethics and Policy of Biospecimens
Beskow, L. M. (2016) · Annual Review of Genomics and Human Genetics · doi:10.1146/annurev-genom-083115-022536 · Cited by 146
“Empirical research has amply shown that consent forms are too long and written at too high a grade level (1, 4,19,29, 76, 84, 85, 105, 106, 125) and, not surprisingly, many participants do not understand the information disclosed (4–6,70,71, 83, 87, 97), including biobank participants (93,104,114).”
BackgroundImproving the informed consent process for research subjects with low literacy: a systematic review
Tamariz, L., Palacio, A., Robert, M., & Marcus, E. N. (2013) · Journal of General Internal Medicine · doi:10.1007/s11606-012-2133-2 · Cited by 140
Assessment of length and readability of informed consent documents for COVID-19 vaccine trials
Emanuel, E. J., & Boyle, C. W. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.10843 · Cited by 78
An objective analysis of quality and readability of online information on COVID-19
Wrigley Kelly, N. E., Murray, K. E., McCarthy, C., & O’Shea, D. B. (2021) · Health and Technology · doi:10.1007/s12553-021-00574-2 · Cited by 69
Niranjan, S. J., Wenzel, J. A., Martin, M. Y., Fouad, M. N., Vickers, S. M., Konety, B. R., & Durant, R. W. (2021) · JCO Oncology Practice · doi:10.1200/op.20.00970 · Cited by 62
Public understanding of climate change terminology
Bruine de Bruin, W., Rabinovich, L., Weber, K., Babboni, M., Dean, M., & Ignon, L. (2021) · Climatic Change · doi:10.1007/s10584-021-03183-0 · Cited by 62
Reading level and length of written research consent forms
Larson, E., Foe, G., & Lally, R. (2015) · Clinical and Translational Science · doi:10.1111/cts.12253 · Cited by 42
Forensic scientists’ conclusions: How readable are they for non-scientist report-users?
Howes, L. M., Kirkbride, K. P., Kelty, S. F., Julian, R., & Kemp, N. (2013) · Forensic Science International · doi:10.1016/j.forsciint.2013.04.026 · Cited by 34
The Health Insurance Portability and Accountability Act and the Informed Consent Process
Breese, P., Burman, W., Rietmeijer, C., & Lezotte, D. (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-141-11-200412070-00034 · Cited by 32
Ethical Issues in Adolescent and Parent Informed Consent for Pediatric Asthma Research Participation
Scherer, D. G., Annett, R. D., & Brody, J. L. (2007) · Journal of Asthma · doi:10.1080/02770900701247137 · Cited by 22
How well informed is the informed consent for cancer clinical trials?
Malik, L., Kuo, J., Yip, D., & Mejia, A. (2014) · Clinical Trials · doi:10.1177/1740774514548734 · Cited by 18
Zai, A. H., Faro, J. M., & Allison, J. (2024) · Journal of Clinical and Translational Science · doi:10.1017/cts.2024.595 · Cited by 12
(2008) · PubMed · Cited by 9
Development of a New Tool for Writing Research Key Information in Plain Language
Kurtz-Rossi, S., Okonkwo, I. A., Chen, Y., Dueñas, N., Bilodeau, T., Rushforth, A., & Klein, A. (2024) · HLRP: Health Literacy Research and Practice · doi:10.3928/24748307-20240218-01 · Cited by 6
The readability of editorials in popular Indian medical journals
Kumar, K. V. S. H., Aravinda, K., & Varadarajulu, R. (2013) · Indian Journal of Endocrinology and Metabolism · doi:10.4103/2230-8210.119626 · Cited by 4
“Readability indices have been developed to study the ease of reading a text.[4] They are based on the syllables, sentence length, and the number of hard words.”
Background
Metadata
- Authors
- Paasche-Orlow, M. K., Taylor, H. A., & Brancati, F. L.
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2003-02-20
- Volume
- 348
- Issue
- 8
- Pages
- 721-726
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W2130071626
- Cited by
- 754
- References
- 28
- FWCI
- 30.00
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.