Discrepancies between registered and published primary outcome specifications in analgesic trials: ACTTION systematic review and recommendations
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
The National Institutes of Health released the trial registry ClinicalTrials.gov in 2000 to increase public reporting and clinical trial transparency. This systematic review examined whether registered primary outcome specifications (POS; ie, definitions, timing, and analytic plans) in analgesic treatment trials correspond with published POS. Trials with accompanying publications (n = 87) were selected from the Repository of Registered Analgesic Clinical Trials (RReACT) database of all postherpetic neuralgia, diabetic peripheral neuropathy, and fibromyalgia clinical trials registered at ClinicalTrials.gov as of December 1, 2011. POS never matched precisely; discrepancies occurred in 79% of the registry-publication pairs (21% failed to register or publish primary outcomes [PO]). These percentages did not differ significantly between industry and non-industry-sponsored trials. Thirty percent of the trials contained unambiguous POS discrepancies (eg, omitting a registered PO from the publication, "demoting" a registered PO to a published secondary outcome), with a statistically significantly higher percentage of non-industry-sponsored than industry-sponsored trials containing unambiguous POS discrepancies. POS discrepancies due to ambiguous reporting included vaguely worded PO registration; or failing to report the timing of PO assessment, statistical analysis used for the PO, or method to address missing PO data. At best, POS discrepancies may be attributable to insufficient registry requirements, carelessness (eg, failing to report PO assessment timing), or difficulty uploading registry information. At worst, discrepancies could indicate investigator impropriety (eg, registering imprecise PO ["pain"], then publishing whichever pain assessment produced statistically significant results). Improvements in PO registration, as well as journal policies requiring consistency between registered and published PO descriptions, are needed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · cited 3×
“Selective outcome reporting, or publishing only a subset of randomized clinical trial outcomes that are found to be statistically significant, may inaccurately inflate estimates of treatment efficacy [6,9,18,21].”
BackgroundResultSystematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546 · cited 2×
“Selective outcome reporting, or publishing only a subset of randomized clinical trial outcomes that are found to be statistically significant, may inaccurately inflate estimates of treatment efficacy [6,9,18,21].”
BackgroundResultKirkham, J. J., Dwan, K. M., Altman, D. G., Gamble, C., Dodd, S., Smyth, R., & Williamson, P. R. (2010) · BMJ · doi:10.1136/bmj.c365 · Cited by 1,133
Als-Nielsen, B., Chen, W., Gluud, C., & Kjaergard, L. L. (2003) · JAMA · doi:10.1001/jama.290.7.921 · Cited by 746 · cited 2×
“Prior research has demonstrated that trials receiving pharmaceutical industry funding may present biased results [37– 39], perhaps more frequently than non-industry-funded trials [2,4].”
ResultOutcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research
Chan, A.-W. (2004) · Canadian Medical Association Journal · doi:10.1503/cmaj.1041086 · Cited by 444
Outcome Reporting Among Drug Trials Registered in ClinicalTrials.gov
Bourgeois, F. T., Murthy, S., & Mandl, K. D. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-153-3-201008030-00006 · Cited by 332 · cited 2×
“Prior research has demonstrated that trials receiving pharmaceutical industry funding may present biased results [37– 39], perhaps more frequently than non-industry-funded trials [2,4].”
ResultRising, K., Bacchetti, P., & Bero, L. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050217 · Cited by 328 · cited 1×
“Although selective outcome reporting may overestimate treatment effects, comparisons of study protocols with published articles reveal that investigators often publish incomplete reports of trial outcomes or manipulate the data to present the results more favorably [1,6,7,9,30,35–37,39].”
ResultMMRM vs. LOCF: A Comprehensive Comparison Based on Simulation Study and 25 NDA Datasets
Siddiqui, O., Hung, H. M. J., & O'Neill, R. (2009) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400802609797 · Cited by 301 · cited 1×
“In addition, a prespecified approach to address missing PO data (eg, baseline observation carried forward [BOCF], last observation carried forward [LOCF], mixed-effect model repeated measures [MMRM] analysis, multiple imputation) should be registered given that distinct approaches make different assumptions about the…”
MethodTesting for the Presence of Positive-Outcome Bias in Peer Review: A Randomized Controlled Trial
Emerson, G. B., Warme, W. J., Wolf, F. M., Heckman, J. D., Brand, R. A., & Leopold, S. S. (2010) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.406 · Cited by 245
Cited by
Comparison of registered and published outcomes in randomized controlled trials: a systematic review
Jones, C. W., Keil, L. G., Holland, W. C., Caughey, M. C., & Platts-Mills, T. F. (2015) · BMC Medicine · doi:10.1186/s12916-015-0520-3 · Cited by 237
“a registered primary outcome [15, 19, 20, 30, 34]; for four studies the most common discrepancy was publication of an unregistered primary outcome [7, 22, 31, 36]; one study reported equal numbers of these two types of discrepancies [26]; for three studies the most commonly observed discrepancy was reporting the regis…”
ResultReproducible and replicable pain research: a critical review
Lee, H., Lamb, S. E., Bagg, M. K., Toomey, E., Cashin, A. G., & Moseley, G. L. (2018) · Pain · doi:10.1097/j.pain.0000000000001254 · Cited by 150
Gewandter, J. S., McKeown, A., McDermott, M. P., Dworkin, J. D., Smith, S. M., Gross, R. A., Hunsinger, M., Lin, A. H., Rappaport, B. A., Rice, A. S. C., et al. (2015) · The Journal of Pain · doi:10.1016/j.jpain.2014.10.003 · Cited by 47
Self-citationTARG Meta-Research Group & Collaborators (2023) · BMJ Open · doi:10.1136/bmjopen-2023-076264 · Cited by 33
Metadata
- Authors
- Smith, S. M., Wang, A. T., Pereira, A., Chang, D. R., McKeown, A., Greene, K., Rowbotham, M. C., Burke, L. B., Coplan, P., Gilron, I., Hertz, S. H., Katz, N. P., Lin, A. H., McDermott, M. P., Papadopoulos, E. J., Rappaport, B. A., Sweeney, M., Turk, D. C., & Dworkin, R. H.
- Venue
- Pain
- Published
- 2013-12
- Volume
- 154
- Issue
- 12
- Pages
- 2769-2774
- ISSN
- 0304-3959 (ISSN-L)
- OpenAlex
- W1997205313
- Cited by
- 33
- References
- 12
- FWCI
- 1.93
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Discrepancies between registered and published primary outcome specifications in analgesic trials: ACTTION systematic review and recommendations. https://app.cochat.ai/papers/10.1016/j.pain.2013.08.011
- The paper
- Smith, S. M., Wang, A. T., Pereira, A., Chang, D. R., McKeown, A., Greene, K., Rowbotham, M. C., Burke, L. B., Coplan, P., Gilron, I., Hertz, S. H., Katz, N. P., Lin, A. H., McDermott, M. P., Papadopoulos, E. J., Rappaport, B. A., Sweeney, M., Turk, D. C., & Dworkin, R. H. (2013). Discrepancies between registered and published primary outcome specifications in analgesic trials: ACTTION systematic review and recommendations. Pain. https://doi.org/10.1016/j.pain.2013.08.011
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.