Systematic review protocol assessing the processes for linking clinical trial registries and their published results
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index; 14 of the 23 sources its claims cite were checked for support.
Abstract
Introduction: Clinical trial registries are an important source of information for tracking clinical trials from their inception through to their reporting, and have been used to measure publication bias and outcome reporting bias. Our aim is to survey and quantify the processes that have been used to identify links between clinical trial registries and published trial reports in studies that rely on these links to evaluate the completeness and accuracy of trial reporting. Methods and analysis: We will identify studies that describe a process for identifying the links between a trial registry included in the WHO International Clinical Trial Registry Platform and published trial results, and use those links to evaluate the completeness and accuracy of trial reporting. Information extracted from the studies will include the purpose and application domain of the study, registries used or searched, processes by which the links were identified, the study period and proportions for which links were found. We will summarise what is known about the number and availability of links between clinical trial registries and published results, and examine how automatic linking, inference and inquiry processes have been used to identify links since the introduction of trial registries. Ethics and dissemination: The systematic review is focused on the analysis of secondary data and does not require ethics approval. The results of the systematic review will be used to inform standard processes used to identify links to and from clinical trial registries in studies that evaluate the completeness and accuracy of clinical trial reports, as well as systematic reviews. Our findings will be disseminated by publishing the systematic review in a peer-reviewed journal, and by engaging with stakeholders from clinical trial registries and bibliographic databases.
Overview
CoChat Summary
TL;DR
This protocol outlines a systematic review to quantify how studies link WHO ICTRP clinical trial registry entries to published trial results, classifying links as automatic, inferred, or inquired. It reports no review results yet; it specifies planned searches, extraction, and synthesis methods.
Key findings
- No empirical review findings are reported; this is a protocol. Its stated objective is to quantify the processes used to link clinical trial registrations to published results in studies examining the completeness and accuracy of trial reporting.
- The protocol will classify links as automatic (using a unique registry identifier), inferred (using trial characteristics to search and reconcile links), or inquired (contacting trial investigators or authors).
- It will pool overall proportions of trials for which links were identified, separately for studies starting from registry entries versus published reports, and will use linear regression relative to midpoints of data collection periods to examine changes over time.
- The search strategy was developed using 50 known eligible articles and was designed to return all 50 without an unmanageable number of irrelevant articles.
Methods
- Design: systematic review protocol. Inclusion: English-language studies using one or more WHO ICTRP registries to compare registered and published information, determine the proportion of published trial reports that were registered, or the proportion of registered trials that were published. Exclusion: studies not reporting the number of trials for which links were identified, or studies describing a trial or reviewing clinical evidence.
- Data sources: PubMed and EMBASE, plus hand-searching reference lists of included studies. Two reviewers will screen articles; disagreements will be resolved by a third author and discussion. Duplicates will be removed by comparing DOIs where possible and manually checking titles, authors, and journal names.
- Extraction and synthesis: two reviewers will independently extract data on registry entries, published reports, registries used, study purpose, application domain, link-identification processes, and proportions of links found. Proportions will be pooled separately by direction of linkage, with contributions of automatic, inferred, and inquired links estimated where available.
Limitations
- Stated: excluding non-English studies may miss articles describing registries based in non-English-speaking countries.
- Stated: many included studies are designed for purposes other than identifying links, so descriptions of link processes may be limited, potentially limiting the ability to determine proportions captured automatically, by inference, or by inquiry.
- Evident from the text: as a protocol, no review results or conclusions are yet available.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 0 Not valid · 2 Not checked · 9 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The manner in which these processes are used vary from study to study and are known to be time-consuming.9 26 27”
- Also stated in: § Ethics and dissemination · plain
“The processes used to link clinical trial registries to published reports of clinical trials vary across studies that rely on those links to evaluate the accuracy and completeness of trial reports, and this systematic review will quantify these differences to inform the way this is performed in the future.”
§ Systematic review protocol assessing the processes for linking clinical trial registries and their published results > Introduction
What the sources say
- Not checked yetcites [9] Bourgeois FT, Murthy S, Mandl KD Outcome reporting among drug trials registered in ClinicalTrials.gov. Ann Intern Med 2010; 153: 158– 66. 10.7326/0003-4819-153-3-201008030-00006 20679560 PMC3374868 source
- Not checked yetcites [26] Mathieu S, Boutron I, Moher D Comparison of registered and published primary outcomes in randomized controlled trials. JAMA 2009; 302: 977– 84. 10.1001/jama.2009.1242 19724045 source
- Partly supportedcites [27] Walker KF, Stevenson G, Thornton JG Discrepancies between registration and publication of randomised controlled trials: an observational study. JRSM Open 2014; 5: 2042533313517688 10.1177/2042533313517688 25057391 PMC4012655 sourceExperimental — accuracy not yet measured
Our copy of Walker et al. (2014) illustrates, rather than asserts, that registry-to-publication linkage procedures differ between studies: the Methods (p. n/a) describe their own route ('using the trial registration number in the published paper where it was available. Where a trial registration number was unavailable, we searched ... ISRCTN, ClinicalTrials.gov (NCT) and the registry of the country of the first author'), and the Discussion contrasts Ewart et al.'s snapshot approach with their own use of archived registry data. However, no passage in our copy states that these processes are time-consuming (searched: time-consuming/laborious/effort/resources; the only 'wastes resources' remark is a quotation from Dickersin and Chalmers about biased reporting, not about linkage procedures), so that half of the citing sentence is not supported by this source. (LLM, conf=0.68)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Ethics and dissemination · plain
None of the sources cited for this claim have been checked yet.
In the paper
“The manner in which these processes are used vary from study to study and are known to be time-consuming.9 26 27”
§ Systematic review protocol assessing the processes for linking clinical trial registries and their published results > Introduction
What the sources say
- Not checked yetcites [9] Bourgeois FT, Murthy S, Mandl KD Outcome reporting among drug trials registered in ClinicalTrials.gov. Ann Intern Med 2010; 153: 158– 66. 10.7326/0003-4819-153-3-201008030-00006 20679560 PMC3374868 source
- Not checked yetcites [26] Mathieu S, Boutron I, Moher D Comparison of registered and published primary outcomes in randomized controlled trials. JAMA 2009; 302: 977– 84. 10.1001/jama.2009.1242 19724045 source
- Could not verifycites [27] Walker KF, Stevenson G, Thornton JG Discrepancies between registration and publication of randomised controlled trials: an observational study. JRSM Open 2014; 5: 2042533313517688 10.1177/2042533313517688 25057391 PMC4012655 sourceExperimental — accuracy not yet measured
Our copy of Walker et al. (2014) is complete and describes how registry records were matched to publications (Methods: reading full-text RCTs, comparing registry information with the corresponding publication, examining archived registry data), and it shows the approach differing between studies (Discussion: Ewart et al. examined registry data only as it appeared on the day of examination and did not use the archive, whereas the authors did; papers examined by a single author each). However, no passage — searched for 'time-consuming', 'labour-intensive', burden/workload of linking registries to reports — states or implies that these processes are time-consuming, which is the point the citation is offered for. Nothing in our copy contradicts it either, so the claim cannot be settled from this source. (LLM, conf=0.70)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Clinical trial registries are an important source of information for tracking clinical trials from their inception through to their reporting, and have been used to measure publication bias and outcome reporting bias.”
- Also stated in: § Introduction · plain
“a number of studies have examined publication bias6–17 and outcome reporting bias,18–27 using one or more of the registries.”
§ Systematic review protocol assessing the processes for linking clinical trial registries and their published results > Abstract > Introduction
What the sources say
- Partly supportedcites [6] Jones CW, Handler L, Crowell KE Non-publication of large randomized clinical trials: cross sectional analysis. BMJ 2013; 347: f6104 10.1136/bmj.f6104 24169943 PMC3812466 sourceExperimental — accuracy not yet measured
The Introduction says trial registration allows comparison of published trials with all registered trials to assess publication bias. The Methods (“Trial results”) also describes checking whether results were provided for outcomes in the original registry, but the paper does not say it used registries to measure outcome reporting bias. (LLM, conf=0.84)
- Supportedcites [7] Riveros C, Dechartres A, Perrodeau E Timing and completeness of trial results posted at ClinicalTrials.gov and published in journals. PLoS Med 2013; 10: e1001566; discussion e1001566 10.1371/journal.pmed.1001566 24311990 PMC3849189 source
In the Discussion (Implications; page unavailable), the paper explicitly describes trial registries as tools for exploring publication bias and selective reporting of outcomes. The Discussion also reports a previous study that assessed publication of registered trials, while this paper compares results posted at ClinicalTrials.gov with published reports. (LLM, conf=0.88)
- Supportedcites [8] Dwan K, Gamble C, Williamson PR Systematic review of the empirical evidence of study publication bias and outcome reporting bias—an updated review. PLoS ONE 2013; 8: e66844 10.1371/journal.pone.0066844 23861749 PMC3702538 source
The Introduction says studies compare trial publications with registry entries to investigate changed or omitted outcomes. The Results (Excluded Studies) also notes investigations of trial registries; its references include work on underpublication of registered trials and outcome reporting among registered trials. Although registry-based studies were excluded from this review’s inception-cohort analysis, the paper supports the claim that registries have been used to assess both biases. (LLM, conf=0.86)
- Not checked yetcites [9] Bourgeois FT, Murthy S, Mandl KD Outcome reporting among drug trials registered in ClinicalTrials.gov. Ann Intern Med 2010; 153: 158– 66. 10.7326/0003-4819-153-3-201008030-00006 20679560 PMC3374868 source
- Partly supportedcites [10] Vawdrey DK, Hripcsak G Publication bias in clinical trials of electronic health records. J Biomed Inform 2013; 46: 139– 41. 10.1016/j.jbi.2012.08.007 22975314 PMC3662474 sourceExperimental — accuracy not yet measured
The Methods describe using ClinicalTrials.gov records to identify trials and determine whether their results were published, supporting the publication-bias part of the claim. The paper does not report using registry records to measure outcome reporting bias, such as discrepancies between registered and published outcomes. No page numbers are available in our copy. (LLM, conf=0.88)
- Not checked yetcites [11] Thornton A, Lee P Publication bias in meta-analysis: its causes and consequences. J Clin Epidemiol 2000; 53: 207– 16. 10.1016/S0895-4356(99)00161-4 10729693 source
- Not checked yetcites [12] Ioannidis JP Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. JAMA 1998; 279: 281– 6. 9450711 source
- Partly supportedcites [13] Ross JS, Mocanu M, Lampropulos JF Time to publication among completed clinical trials. JAMA Intern Med 2013; 173: 828– 8. 10.1001/jamainternmed.2013.136 23460252 PMC3691813 sourceExperimental — accuracy not yet measured
The Methods describe using ClinicalTrials.gov identifiers to link trials to publications, and the Discussion reports that 30%–50% of registered studies are never published. This supports using registries to examine publication, but the paper does not report using them to measure outcome reporting bias; that term appears only in a reference title. (LLM, conf=0.87)
- Partly supportedcites [14] Ross JS, Mulvey GK, Hines EM Trial publication after registration in ClinicalTrials.Gov: a cross-sectional analysis. PLoS Med 2009; 6: e1000144 10.1371/journal.pmed.1000144 19901971 PMC2728480 sourceExperimental — accuracy not yet measured
The Introduction and Discussion use ClinicalTrials.gov registrations to assess whether completed trials were published, supporting the publication-bias part of the claim. The Discussion says incomplete primary-outcome information made outcome reporting bias difficult or impossible to detect in this study; it does not establish that registries were used to measure that bias. (LLM, conf=0.87)
- Partly supportedcites [15] Ross JS, Tse T, Zarin DA Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis. BMJ 2012; 344: d7292 10.1136/bmj.d7292 22214755 PMC3623605 sourceExperimental — accuracy not yet measured
The Methods (Publication status; page not provided) describe using ClinicalTrials.gov records to track whether registered trials were published, supporting the publication-tracking part of the claim. The Methods (Study variables; page not provided) list registered outcome measures, but the paper does not compare those measures with published outcomes to measure outcome reporting bias. (LLM, conf=0.84)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Introduction · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These databases were selected because they are known to have good coverage of clinical research,39 40”
§ Systematic review protocol assessing the processes for linking clinical trial registries and their published results > Methods > Search strategy
What the sources say
- Supportedcites [39] Bramer WM, Giustini D, Kramer BM Comparing the coverage, recall, and precision of searches for 120 systematic reviews in Embase, MEDLINE, and Google Scholar: a prospective study. Syst Rev 2016; 5: 39 10.1186/s13643-016-0215-7 26932789 PMC4772334 source
The Abstract Results report 92.3% coverage for MEDLINE alone and 97.5% for Embase and MEDLINE combined among references included in 120 systematic reviews. The paper measures MEDLINE rather than PubMed directly, but its findings support the broad claim that these clinical-research databases have good coverage. (LLM, conf=0.88)
- Partly supportedcites [40] Preston L, Carroll C, Gardois P Improving search efficiency for systematic reviews of diagnostic test accuracy: an exploratory study to assess the viability of limiting to MEDLINE, EMBASE and reference checking. Syst Rev 2015; 4: 82 10.1186/s13643-015-0074-7 26113080 PMC4482161 sourceExperimental — accuracy not yet measured
The Background describes MEDLINE and EMBASE as major general bibliographic databases in the health sciences. The Results report that they indexed 91% and 92%, respectively, of citations in nine diagnostic-test-accuracy reviews. The paper does not establish comparable coverage for PubMed specifically or for clinical research generally. (LLM, conf=0.82)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Clinical trial registries are sometimes used to identify trials for inclusion in systematic reviews.30–32”
§ Systematic review protocol assessing the processes for linking clinical trial registries and their published results > Introduction
What the sources say
- Supportedcites [30] Jones CW, Keil LG, Weaver MA Clinical trials registries are under-utilized in the conduct of systematic reviews: a cross-sectional analysis. Syst Rev 2014; 3: 126– 6. 10.1186/2046-4053-3-126 25348628 PMC4217330 source
The Background states the authors' objective was to determine what proportion of systematic review authors 'searched clinical trials registries in order to identify relevant unpublished studies', and notes that commonly referenced guidelines recommend a registry search as part of a comprehensive search strategy. The Abstract Results (p. 1) quantify actual use: 41 of 117 reviews (35%) reported searching a registry, and of the 29 giving detailed results, 15 (52%) identified at least one completed trial and 18 (62%) at least one ongoing trial. The Discussion adds that registry searches 'may reveal the existence of ongoing or recently completed trials'. Together these support the hedged claim that registries are sometimes used to identify trials for systematic reviews. (LLM, conf=0.85)
- Supportedcites [31] matched to “Automated dose dispensing service for primary healthcare patients: a systematic review” (2013) source
The Methods (Literature search) section lists the Cochrane central register of controlled trials among the databases searched in April 2012 to identify studies for this systematic review, and the Abstract (Methods) repeats that the search covered 10 databases including the Cochrane Library. The paper therefore exemplifies the hedged claim that trial registers are sometimes used to identify trials for inclusion in systematic reviews. Our copy does not discuss prospective trial registries such as ClinicalTrials.gov, but the claim only requires an instance of the practice. (LLM, conf=0.80)
- Supportedcites [32] Schroll JB, Bero L, Gøtzsche PC Searching for unpublished data for Cochrane reviews: cross-sectional study. BMJ 2013; 346: f2231 10.1136/bmj.f2231 23613540 PMC3633324 source
The Introduction (our copy) lists national/international trial registers (e.g. clinicaltrials.gov) among the sources the Cochrane handbook suggests for finding unpublished data for reviews, and the Discussion reports that trial registers were actually used by review authors (non-commercial registers 6.3%, company-owned registers 0.9% of respondents as sources of information), with the authors stating 'Trial registers should always be consulted' and that 'Searching a trial register (clinicaltrials.gov or similar) is also a good idea.' This directly supports the claim that registries are sometimes used to identify trials for systematic reviews (here, Cochrane reviews), though the paper frames registry use as a route to unpublished data rather than measuring registry searching across all systematic reviews. (LLM, conf=0.85)
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
2 more claims
Create a free account to see all 15 claims and to verify the 9 references still open.
- Probably not a substantial claim. 6
- It may state two separate claims as one. 2
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The protocol for this systematic review was published in 2016 [22] (see Additional file 3).”
From A systematic review of the processes used to link clinical trial registrations to their published results (2017) · cites this paper as [22]
Citations
Cites
Publication bias in meta-analysis its causes and consequences
Thornton, A. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00161-4 · Cited by 1,291
Kirkham, J. J., Dwan, K. M., Altman, D. G., Gamble, C., Dodd, S., Smyth, R., & Williamson, P. R. (2010) · BMJ · doi:10.1136/bmj.c365 · Cited by 1,133
Dwan, K., Gamble, C., Williamson, P. R., Kirkham, J. J., & the Reporting Bias Group (2013) · PLoS ONE · doi:10.1371/journal.pone.0066844 · Cited by 1,127
The ClinicalTrials.gov Results Database — Update and Key Issues
Zarin, D. A., Tse, T., Williams, R. J., Califf, R. M., & Ide, N. C. (2011) · New England Journal of Medicine · doi:10.1056/nejmsa1012065 · Cited by 838
Comparison of Registered and Published Primary Outcomes in Randomized Controlled Trials
Mathieu, S. (2009) · JAMA · doi:10.1001/jama.2009.1242 · Cited by 730
O’Mara-Eves, A., Thomas, J., McNaught, J., Miwa, M., & Ananiadou, S. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-5 · Cited by 681
Ioannidis, J. P. A. (1998) · JAMA · doi:10.1001/jama.279.4.281 · Cited by 632
Dickersin, K. (2003) · JAMA · doi:10.1001/jama.290.4.516 · Cited by 512
When and how to update systematic reviews: consensus and checklist
Garner, P., Hopewell, S., Chandler, J., MacLehose, H., Schünemann, H. J., Akl, E. A., Beyene, J., Chang, S., Churchill, R., Dearness, K., et al. (2016) · BMJ · doi:10.1136/bmj.i3507 · Cited by 426
Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis
Ross, J. S., Mulvey, G. K., Hines, E. M., Nissen, S. E., & Krumholz, H. M. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000144 · Cited by 401
Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis
Ross, J. S., Tse, T., Zarin, D. A., Xu, H., Zhou, L., & Krumholz, H. M. (2012) · BMJ · doi:10.1136/bmj.d7292 · Cited by 371
De Angelis, C. D., Drazen, J. M., Frizelle, F. A., Haug, C., Hoey, J., Horton, R., Kotzin, S., Laine, C., Marusic, A., Overbeke, A. J. P. M., et al. (2005) · New England Journal of Medicine · doi:10.1056/nejme058127 · Cited by 354
O’Mara-Eves, A., Thomas, J., McNaught, J., Miwa, M., & Ananiadou, S. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0031-5 · Cited by 353
Non-publication of large randomized clinical trials: cross sectional analysis
Jones, C. W., Handler, L., Crowell, K. E., Keil, L. G., Weaver, M. A., & Platts-Mills, T. F. (2013) · BMJ · doi:10.1136/bmj.f6104 · Cited by 350 · cited 1×
“information to be extracted includes the following: (1) the number of trial registry entries examined or identified in the study; (2) the number of published trial reports examined or identified in the study; (3) the trial registry or registries used; (4) the purpose of the study (such as measuring publication bias, o…”
MethodOutcome Reporting Among Drug Trials Registered in ClinicalTrials.gov
Bourgeois, F. T., Murthy, S., & Mandl, K. D. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-153-3-201008030-00006 · Cited by 332
Page, M. J., McKenzie, J. E., Kirkham, J., Dwan, K., Kramer, S., Green, S., & Forbes, A. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000035.pub2 · Cited by 281
Timing and Completeness of Trial Results Posted at ClinicalTrials.gov and Published in Journals
Riveros, C., Dechartres, A., Perrodeau, E., Haneef, R., Boutron, I., & Ravaud, P. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001566 · Cited by 269 · cited 1×
“information to be extracted includes the following: (1) the number of trial registry entries examined or identified in the study; (2) the number of published trial reports examined or identified in the study; (3) the trial registry or registries used; (4) the purpose of the study (such as measuring publication bias, o…”
MethodComparison of protocols and registry entries to published reports for randomised controlled trials
Dwan, K., Altman, D. G., Cresswell, L., Blundell, M., Gamble, C. L., & Williamson, P. R. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000031.pub2 · Cited by 243
Comparison of registered and published outcomes in randomized controlled trials: a systematic review
Jones, C. W., Keil, L. G., Holland, W. C., Caughey, M. C., & Platts-Mills, T. F. (2015) · BMC Medicine · doi:10.1186/s12916-015-0520-3 · Cited by 237
Bramer, W. M., Giustini, D., & Kramer, B. M. R. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0215-7 · Cited by 202
Automated dose dispensing service for primary healthcare patients: a systematic review
Sinnemäki, J., Sihvo, S., Isojärvi, J., Blom, M., Airaksinen, M., & Mäntylä, A. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-1 · Cited by 173
Tang, E., Ravaud, P., Riveros, C., Perrodeau, E., & Dechartres, A. (2015) · BMC Medicine · doi:10.1186/s12916-015-0430-4 · Cited by 128
Publication of Trials Funded by the National Heart, Lung, and Blood Institute
Gordon, D., Taddei-Peters, W., Mascette, A., Antman, M., Kaufmann, P. G., & Lauer, M. S. (2013) · New England Journal of Medicine · doi:10.1056/nejmsa1300237 · Cited by 120
Time to publication among completed clinical trials
Ross, J. S., Mocanu, M., Lampropulos, J. F., Tse, T., & Krumholz, H. M. (2013) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.136 · Cited by 114
Better Access to Information about Clinical Trials
McCray, A. T. (2000) · Annals of Internal Medicine · doi:10.7326/0003-4819-133-8-200010170-00013 · Cited by 99 · cited 1×
“information to be extracted includes the following: (1) the number of trial registry entries examined or identified in the study; (2) the number of published trial reports examined or identified in the study; (3) the trial registry or registries used; (4) the purpose of the study (such as measuring publication bias, o…”
MethodLinking ClinicalTrials.gov and PubMed to Track Results of Interventional Human Clinical Trials
Huser, V., & Cimino, J. J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0068409 · Cited by 90
Updating Systematic Reviews: An International Survey
Garritty, C., Tsertsvadze, A., Tricco, A. C., Sampson, M., & Moher, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009914 · Cited by 62
Jones, C. W., Keil, L. G., Weaver, M. A., & Platts-Mills, T. F. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-126 · Cited by 61
Cohen, A. M., Ambert, K., & McDonagh, M. (2012) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-12-33 · Cited by 57
A multicomponent decision tool for prioritising the updating of systematic reviews
Takwoingi, Y., Hopewell, S., Tovey, D., & Sutton, A. J. (2013) · BMJ · doi:10.1136/bmj.f7191 · Cited by 57
Manheimer, E., & Anderson, D. (2002) · BMJ · doi:10.1136/bmj.325.7363.528 · Cited by 56
Undisclosed Changes in Outcomes in Randomized Controlled Trials: An Observational Study
Ewart, R., Lausen, H., & Millian, N. (2009) · The Annals of Family Medicine · doi:10.1370/afm.1017 · Cited by 50
Pranić, S. M., & Marušić, A. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.07.007 · Cited by 46
Walker, K. F., Stevenson, G., & Thornton, J. G. (2014) · JRSM Open · doi:10.1177/2042533313517688 · Cited by 45
Searching for unpublished data for Cochrane reviews: cross sectional study
Schroll, J. B., Bero, L., & Gotzsche, P. C. (2013) · BMJ · doi:10.1136/bmj.f2231 · Cited by 43
Publication bias in clinical trials of electronic health records
Vawdrey, D. K., & Hripcsak, G. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2012.08.007 · Cited by 38
De Oliveira, G. S., Jung, M. J., & McCarthy, R. J. (2015) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000000824 · Cited by 35
Preston, L., Carroll, C., Gardois, P., Paisley, S., & Kaltenthaler, E. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0074-7 · Cited by 32
Strategies for obtaining unpublished drug trial data: a qualitative interview study
Wolfe, N., Gøtzsche, P. C., & Bero, L. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-31 · Cited by 30
Precision and negative predictive value of links between ClinicalTrials.gov and PubMed.
Huser, V., & Cimino, J. J. (2012) · PubMed Central · Cited by 27
de Jong, J. P., ter Riet, G., & Willems, D. L. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.01.018 · Cited by 12
Cited by
Gicquel, L., Ordonneau, P., Blot, E., Toillon, C., Ingrand, P., & Romo, L. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00094 · Cited by 123
Time-to-update of systematic reviews relative to the availability of new evidence
Bashir, R., Surian, D., & Dunn, A. G. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0856-9 · Cited by 72
Self-citationPowell-Smith, A., & Goldacre, B. (2016) · F1000Research · doi:10.12688/f1000research.10010.1 · Cited by 58
Lameijer, C. M., ten Duis, H. J., van Dusseldorp, I., Dijkstra, P. U., & van der Sluis, C. K. (2017) · Archives of Orthopaedic and Trauma Surgery · doi:10.1007/s00402-017-2765-0 · Cited by 52
Bashir, R., Bourgeois, F. T., & Dunn, A. G. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0518-3 · Cited by 47
Self-citation
Metadata
- Authors
- Bashir, R., & Dunn, A. G.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Bashir, Rabia
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2016-10
- Volume
- 6
- Issue
- 10
- Pages
- e013048
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC5073522
- OpenAlex
- W2529217325
- Semantic Scholar
- e4c1f98bd04834d99674f5494b06887134069e05
- Cited by
- 10
- References
- 41
- Citations by year
- 2022: 1 · 2021: 1 · 2018: 2 · 2017: 5 · 2016: 1
- FWCI
- 0.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Open (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- HighWire Press Open Archive (acceptedVersion)
- Funders
- Macquarie University
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- clinical trial registries, publication bias, selective reporting, automatic linking, bibliographic databases
- MeSH terms
- Systematic Reviews as Topic, Humans, Publishing, Registries, Research Design, Databases, Bibliographic, Information Storage and Retrieval, Publication Bias, Biomedical Research, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.