Harms are assessed inconsistently and reported inadequately Part 2: nonsystematic adverse events
Open accessAbstract
Objective We examined nonsystematic adverse events (AEs) in Part 2 (of 2) of a study describing the assessment and reporting AEs in clinical trials. Study Design and Setting We examined 21 trials of gabapentin for neuropathic pain (52 sources) and seven trials of quetiapine for bipolar depression (80 sources) using data from the Multiple Data Sources study. We extracted and compared information about nonsystematic AEs (i.e., AEs that were not assessed for every participant), including AEs categorized as "serious." We recorded whether AEs were grouped by anatomic or physiological system. Results Trials of the same drug reported information about different AEs. Information in public sources was inadequate for decision-making. No public source reported all AEs, or all serious AEs, identified in nonpublic sources about the same trial. Of trials with only public sources, 2/15 (13%) gabapentin and 0/3 (0%) quetiapine trials grouped AEs by anatomic or physiological system. Conclusion Public sources contained little information about nonsystematic AEs, including serious AEs. Grouping might make nonsystematic AEs easier to detect; however, most public sources did not report grouped AEs. Standards are needed to improve the collection and reporting of nonsystematic AEs so that stakeholders can use trials to assess the balance of potential benefits and harms.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Specifying the methods of assessing, grouping, and analysing harms in the protocol helps to identify and deter the selective reporting of results in publications and registries.
“Specifying the methods of assessing, grouping, and analysing harms in the protocol helps to identify and deter the selective reporting of results in publications and registries.280 281”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [281]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Abraham, J. M. (2010) · Brill | Nijhoff eBooks · doi:10.1163/ej.9789004163300.i-1081.897 · Cited by 2,612 · see citing works
The ClinicalTrials.gov Results Database — Update and Key Issues
Zarin, D. A., Tse, T., Williams, R. J., Califf, R. M., & Ide, N. C. (2011) · New England Journal of Medicine · doi:10.1056/nejmsa1012065 · Cited by 838 · see citing works
DeAngelis, C. D., Drazen, J. M., Frizelle, F., Haug, C. J., Hoey, J., Horton, R. C., Kotzin, S., Laine, C. M., Marušić, A., Overbeke, A. J. P. M., et al. (2004) · JAMA · doi:10.1001/jama.292.11.1363 · Cited by 579 · see citing works
Trial Reporting in ClinicalTrials.gov — The Final Rule
Zarin, D. A., Tse, T., Williams, R. J., & Carr, S. (2016) · New England Journal of Medicine · doi:10.1056/nejmsr1611785 · Cited by 332 · see citing works
Noury, J. C. L., Nardo, J. M., Healy, D., Jureidini, J. N., Raven, M. K., Tufănaru, C., & Abi‐Jaoude, E. (2015) · BMJ · doi:10.1136/bmj.h4320 · Cited by 329 · see citing works
Reporting of Safety Results in Published Reports of Randomized Controlled Trials
(2009) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.306 · Cited by 287 · see citing works
Golder, S., Loke, Y. K., Wright, K., & Norman, G. (2016) · PLOS Medicine · doi:10.1371/journal.pmed.1002127 · Cited by 277 · see citing works
Timing and Completeness of Trial Results Posted at ClinicalTrials.gov and Published in Journals
Riveros, C., Dechartres, A., Perrodeau, E., Haneef, R., Boutron, I., & Ravaud, P. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001566 · Cited by 269 · see citing works
Effect of reporting bias on meta-analyses of drug trials: reanalysis of meta-analyses
Hart, B., Lundh, A., & Bero, L. (2012) · BMJ · doi:10.1136/bmj.d7202 · Cited by 255 · see citing works
Hartung, D. M., Zarin, D. A., Guise, J., McDonagh, M. S., Paynter, R. A., & Helfand, M. (2014) · Annals of Internal Medicine · doi:10.7326/m13-0480 · Cited by 239 · see citing works
Mayo-Wilson, E., Fusco, N., Li, T., Hong, H., Canner, J. K., & Dickersin, K. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.05.007 · Cited by 131 · see citing works
Self-citationReporting of adverse drug reactions in randomised controlled trials – a systematic survey
Loke, Y. K., & Derry, S. (2001) · BMC Clinical Pharmacology · doi:10.1186/1472-6904-1-3 · Cited by 128 · see citing works
Lineberry, N. B., Berlin, J. A., Mansi, B. A., Glasser, S. C., Berkwits, M., Klem, C., Bhattacharya, A., Citrome, L., Enck, R. E., Fletcher, J., et al. (2016) · BMJ · doi:10.1136/bmj.i5078 · Cited by 115 · see citing works
Carlesso, L. C., MacDermid, J. C., & Santaguida, L. (2010) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2010.3229 · Cited by 109 · see citing works
Dickersin, K., & Chalmers, I. (2011) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2011.11k042 · Cited by 108 · see citing works
Self-citationCherry-picking by trialists and meta-analysts can drive conclusions about intervention efficacy
Mayo-Wilson, E., Li, T., Fusco, N., Bertizzolo, L., Canner, J. K., Cowley, T., Doshi, P., Ehmsen, J., Gresham, G., Guo, N., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.07.014 · Cited by 108 · see citing works
Self-citationRodgers, M., Brown, J. V. E., Heirs, M. K., Higgins, J. P. T., Mannion, R., Simmonds, M. C., & Stewart, L. A. (2013) · BMJ · doi:10.1136/bmj.f3981 · Cited by 86 · see citing works
Characteristics of Published Comparative Effectiveness Studies of Medications
Hochman, M. (2010) · JAMA · doi:10.1001/jama.2010.240 · Cited by 81 · see citing works
Harms are assessed inconsistently and reported inadequately part 1: systematic adverse events
Mayo-Wilson, E., Fusco, N., Li, T., Hong, H., Canner, J. K., Dickersin, K., Bertizzolo, L., Cowley, T., Doshi, P., Ehmsen, J., et al. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.04.022 · Cited by 63 · see citing works
Self-citationReporting of Harm in Randomized Controlled Trials Published in the Urological Literature
Breau, R. H., Gaboury, I., Scales, C. D., Fesperman, S. F., WATTERSON, J. D., & Dahm, P. (2010) · The Journal of Urology · doi:10.1016/j.juro.2010.01.030 · Cited by 59 · see citing works
Low quality of reporting adverse drug reactions in paediatric randomised controlled trials
de Vries, T. W., & van Roon, E. N. (2010) · Archives of Disease in Childhood · doi:10.1136/adc.2009.175562 · Cited by 57 · see citing works
Pope, A., Adams, C. E., Paton, C., Weaver, T. D., & Barnes, T. R. E. (2010) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.109.070961 · Cited by 57 · see citing works
Neuraminidase inhibitors for preventing and treating influenza in healthy adults and children
(2012) · Prescriber · doi:10.1002/psb.878 · Cited by 40 · see citing works
The unintended consequences of argument dilution in direct-to-consumer drug advertisements
Sivanathan, N., & Kakkar, H. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0223-1 · Cited by 39 · see citing works
Are manufacturers sharing data as promised?
Mayo‐Wilson, E., Doshi, P., & Dickersin, K. (2015) · BMJ · doi:10.1136/bmj.h4169 · Cited by 26 · see citing works
Self-citationStandards for design and measurement would make clinical research reproducible and usable
Dickersin, K., & Mayo‐Wilson, E. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708273114 · Cited by 26 · see citing works
Self-citationValue and usability of unpublished data sources for systematic reviews and network meta-analyses
Halfpenny, N. J. A., Quigley, J. M., Thompson, J. C., & Scott, D. A. (2016) · BMJ Evidence-Based Medicine · doi:10.1136/ebmed-2016-110494 · Cited by 23 · see citing works
Caveat emptor: the combined effects of multiplicity and selective reporting
Li, T., Mayo‐Wilson, E., Fusco, N., Hong, H., & Dickersin, K. (2018) · Trials · doi:10.1186/s13063-018-2888-9 · Cited by 21 · see citing works
Self-citationMayo‐Wilson, E., Golozar, A., Cowley, T., Fusco, N., Gresham, G. K., Haythornthwaite, J. A., Tolbert, E., Payne, J. L., Rosman, L. M., Hutfless, S. M., et al. (2018) · Pilot and Feasibility Studies · doi:10.1186/s40814-018-0284-6 · Cited by 14 · see citing works
Self-citationMayo-Wilson, E., Hutfless, S., Li, T.-J., Gresham, G., Fusco, N., Ehmsen, J., Heyward, J., Vedula, S., Lock, D., Haythornthwaite, J., et al. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0134-z · Cited by 14 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 12
- [25][25] International conference on harmonisation of technical requirements for registration of pharmaceuticals for human use. In: Introductory guide MedDRA version 17.0. Available at https://www.meddra.org/ sites/default/files/guidance/file/intguide\_17\_0\_english.pdf. Accessed May 12, 2018. -
- [30][30] International conference on harmonisation of technical requirements for registration of pharmaceuticals for human use. In: ICH 19. harmonised tripartite guideline: structure and content of clinical study reports E3. Available at http://www.ich.org/products/guidelines/ efficacy/efficacy-single/article/structure-and-content-of-clinical-studyreports.html. Accessed May 12, 2018. -
- [32][32] [Parke-Davis. Research report: 720-03908. A double-blind placebocontrolled trial of gabapentin for treatment of painful diabetic peripheral neuropathy 1998: Protocol Number: 945-210.](http://refhub.elsevier.com/S0895-4356(18)31109-0/sref32) -
- [33][33] [Parke-Davis. Research report: 995-00070. Double-blind, randomized, placebo-controlled, parallel groups, multi-center trial to determine the efficacy and safety of Neurontin (gabapentin) in subjects with peripheral neuropathy (post-herpetic neuralgia) 1998: Protocol Number: 945-211.](http://refhub.elsevier.com/S0895-4356(18)31109-0/sref33) -
- [34][34] [Parke-Davis. Research report: 720-04130. A double-blind placebocontrolled trial with 3 doses of gabapentin for treatment of painful diabetic neuropathy 2000: Protocol Number: 945-224.](http://refhub.elsevier.com/S0895-4356(18)31109-0/sref34) -
- [35][35] [Parke-Davis. Research report: 430-00125. A double blind placebo controlled trial of gabapentin for the treatment of patients exhibiting symptoms of neuropathic pain 2000: Protocol Number: 945-430-306 (NN 026).](http://refhub.elsevier.com/S0895-4356(18)31109-0/sref35) -
- [36][36] [Parke-Davis. Research report: 430-00124. A double-blind placebo controlled trial of gabapentin for the treatment of post herpetic neuralgia 2000: Protocol Number: 945-430-295 (NN 025).](http://refhub.elsevier.com/S0895-4356(18)31109-0/sref36) -
- [37][37] [Pfizer. Final study report: A 15 week randomized, double-blind, placebo controlled, parallel-group, multicenter study of Neurontin (gabapentin) for efficacy and quality of life in patients with painful diabetic peripheral neuropahty 2005: Protocol A945-1008.](http://refhub.elsevier.com/S0895-4356(18)31109-0/sref37) -
- [38][38] [AstraZeneca. A multicenter, double-blind, randomized, placebocontrolled, double- dummy trial of the use of quetiapine fumarate (SEROQUEL[Registered]) in the treatment of patients with bipolar depression 2005: Study code: 5077US/0049.](http://refhub.elsevier.com/S0895-4356(18)31109-0/sref38) -
- [39][39] [AstraZeneca. A confirmatory multicenter, double-blind, randomized, placebo-controlled study of the use of quetiapine fumarate (SEROQUEL) in the treatment of patients with bipolar depression [D1447C00135] 2005.](http://refhub.elsevier.com/S0895-4356(18)31109-0/sref39) -
- [40][40] [ABBYY. FineReader.. 11th ed. Milpitas, CA: ABBYY; 2011.](http://refhub.elsevier.com/S0895-4356(18)31109-0/sref40) -
- [45][45] [Mayo-Wilson E, Fusco N, Li T, Hong H, Canner JK, Dickersin K. Opportunities for selective reporting of non-systematic adverse events in randomized controlled trials: an observational study 2018: Submitted.](http://refhub.elsevier.com/S0895-4356(18)31109-0/sref45) -
Cited by
Sorted by citations
SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials
Hróbjartsson, A., Boutron, I., Hopewell, S., Moher, D., Schulz, K. F., Collins, G. S., Tunn, R., Aggarwal, R., Berkwits, M., Berlin, J. A., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081660 · Cited by 171 · see citing works
Harms are assessed inconsistently and reported inadequately part 1: systematic adverse events
Mayo-Wilson, E., Fusco, N., Li, T., Hong, H., Canner, J. K., Dickersin, K., Bertizzolo, L., Cowley, T., Doshi, P., Ehmsen, J., et al. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.04.022 · Cited by 63 · see citing works
Self-citationHarms in Systematic Reviews Paper 1: An introduction to research on harms
Qureshi, R., Mayo-Wilson, E., & Li, T. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.10.023 · Cited by 63 · see citing works
Self-citationGrant, S., Azhar, G., Han, E., Booth, M., Motala, A., Larkin, J., & Hempel, S. (2021) · PLOS Medicine · doi:10.1371/journal.pmed.1003822 · Cited by 31 · see citing works
- Authors
- Mayo-Wilson, E., Fusco, N., Li, T., Hong, H., Canner, J. K., Dickersin, K., Bertizzolo, L., Cowley, T., Doshi, P., Ehmsen, J., Gresham, G., Guo, N., Haythornthwaite, J., Heyward, J., Pham, D., Payne, J., Rosman, L., Stuart, E., Suarez-Cuervo, C., Tolbert, E., Twose, C., & Vedula, S.
- Affiliations
- Johns Hopkins University (US)
- ORCID
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2019-09
- Volume
- 113
- Pages
- 11-19
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W4229830654
- Cited by
- 109
- References
- 30
- Citations by year
- 2026: 5 · 2025: 15 · 2024: 27 · 2023: 5 · 2022: 40 · 2021: 9 · 2020: 4 · 2019: 4
- FWCI
- 10.55
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Clinical Epidemiology (publishedVersion, cc-by-nc-nd)
- Pure Amsterdam UMC (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- IUScholarWorks Open (Indiana University) (submittedVersion)
- Funders
- Patient-Centered Outcomes Research Institute
- Topics
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Toxicology › Pharmacovigilance and Adverse Drug Reactions
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Pharmacology › Pharmaceutical industry and healthcare
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- serious adverse events, clinical trial reporting, gabapentin, neuropathic pain, quetiapine, bipolar depression, benefit-harm balance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review