The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Relative Citation Impact of Various Study Designs in the Health Sciences
Abstract
CONTEXT: The relative merits of various study designs and their placement in hierarchies of evidence are often discussed. However, there is limited knowledge about the relative citation impact of articles using various study designs. OBJECTIVE: To determine whether the type of study design affects the rate of citation in subsequent articles. DESIGN AND SETTING: We measured the citation impact of articles using various study designs--including meta-analyses, randomized controlled trials, cohort studies, case-control studies, case reports, nonsystematic reviews, and decision analysis or cost-effectiveness analysis--published in 1991 and in 2001 for a sample of 2646 articles. MAIN OUTCOME MEASURE: The citation count through the end of the second year after the year of publication and the total received citations. RESULTS: Meta-analyses received more citations than any other study design both in 1991 (P<.05 for all comparisons) and in 2001 (P<.001 for all comparisons) and both in the first 2 years and in the longer term. More than 10 citations in the first 2 years were received by 32.4% of meta-analyses published in 1991 and 43.6% of meta-analyses published in 2001. Randomized controlled trials did not differ significantly from epidemiological studies and nonsystematic review articles in 1991 but clearly became the second-cited study design in 2001. Epidemiological studies, nonsystematic review articles, and decision and cost-effectiveness analyses had relatively similar impact; case reports received negligible citations. Meta-analyses were cited significantly more often than all other designs after adjusting for year of publication, high journal impact factor, and country of origin. When limited to studies addressing treatment effects, meta-analyses received more citations than randomized trials. CONCLUSION: Overall, the citation impact of various study designs is commensurate with most proposed hierarchies of evidence.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Grading quality of evidence and strength of recommendations
(2004) · BMJ · doi:10.1136/bmj.328.7454.1490 · Cited by 8,477
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Concato, J., Shah, N., & Horwitz, R. I. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422507 · Cited by 3,563
A comparison of observational studies and randomized, controlled trials.
Benson, K., & Hartz, A. J. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422506 · Cited by 2,347
A new system for grading recommendations in evidence based guidelines
Harbour, R., & Miller, J. (2001) · BMJ · doi:10.1136/bmj.323.7308.334 · Cited by 1,637
Systems to rate the strength of scientific evidence.
West, S. L., King, V., Carey, T. S., Lohr, K. N., Mckoy, N. A., Sutton, S. F., & Lux, L. J. (2002) · PubMed · Cited by 923
Comparison of Evidence of Treatment Effects in Randomized and Nonrandomized Studies
Ioannidis, J. P. A. (2001) · JAMA · doi:10.1001/jama.286.7.821 · Cited by 919
The Medical Review Article: State of the Science
MULROW, C. D. (1987) · Annals of Internal Medicine · doi:10.7326/0003-4819-106-3-485 · Cited by 856
When are observational studies as credible as randomised trials?
Vandenbroucke, J. P. (2004) · The Lancet · doi:10.1016/s0140-6736(04)16261-2 · Cited by 538
Fortnightly Review: How can impact factors be improved?
Garfield, E. (1996) · BMJ · doi:10.1136/bmj.313.7054.411 · Cited by 484
Lawlor, D. A., Smith, G. D., Bruckdorfer, K. R., Kundu, D., & Ebrahim, S. (2004) · The Lancet · doi:10.1016/s0140-6736(04)16260-0 · Cited by 438
Shapiro, S. (1994) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117324 · Cited by 349
Meta-analysis: Statistical alchemy for the 21st century
Feinstein, A. R. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00110-c · Cited by 339
Weale, A. R., Bailey, M., & Lear, P. A. (2004) · BMC Medical Research Methodology · doi:10.1186/1471-2288-4-14 · Cited by 157
The Medical Review Article Revisited: Has the Science Improved?
McAlister, F. A., Clark, H. D., van Walraven, C., Straus, S. E., Lawson, F. M. E., Moher, D., & Mulrow, C. D. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-131-12-199912210-00007 · Cited by 149
The Randomized Controlled Trial Gets a Middle-aged Checkup
Jadad, A. R., & Rennie, D. (1998) · JAMA · doi:10.1001/jama.279.4.319 · Cited by 143
Discussion Sections in Reports of Controlled Trials Published in General Medical Journals
Clarke, M. J. (2002) · JAMA · doi:10.1001/jama.287.21.2799 · Cited by 126
Any casualties in the clash of randomised and observational evidence?
Ioannidis, J. P. A., Haidich, A., & Lau, J. (2001) · BMJ · doi:10.1136/bmj.322.7291.879 · Cited by 107
Systematic reviews: a cross-sectional study of location and citation counts
Montori, V. M., Wilczynski, N. L., Morgan, D. R., Haynes, R. B., & the Hedges Team (2003) · BMC Medicine · doi:10.1186/1741-7015-1-2 · Cited by 105
Doubling the Impact: Publication of Systematic Review Articles in Orthopaedic Journals
Bhandari, M., Montori, V. M., Devereaux, P. J., Wilczynski, N. L., Morgan, D. R., & Haynes, R. B. (2004) · Journal of Bone and Joint Surgery · doi:10.2106/00004623-200405000-00019 · Cited by 66
Does anybody read "evidence-based" articles?
Loke, Y. K., & Derry, S. (2003) · BMC Medical Research Methodology · doi:10.1186/1471-2288-3-14 · Cited by 28
Stampfer, M. J. (1997) · Controlled Clinical Trials · doi:10.1016/s0197-2456(97)00050-0 · Cited by 16
Cited by
Avoidable waste in the production and reporting of research evidence
Chalmers, I., & Glasziou, P. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60329-9 · Cited by 2,208
CARE guidelines for case reports: explanation and elaboration document
Riley, D. S., Barber, M. S., Kienle, G. S., Aronson, J. K., von Schoen-Angerer, T., Tugwell, P., Kiene, H., Helfand, M., Altman, D. G., Sox, H., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.04.026 · Cited by 2,287
Synthesizing information systems knowledge: A typology of literature reviews
Paré, G., Trudel, M.-C., Jaana, M., & Kitsiou, S. (2015) · Information & Management · doi:10.1016/j.im.2014.08.008 · Cited by 1,987
Meta-analysis and the science of research synthesis
Gurevitch, J., Koricheva, J., Nakagawa, S., & Stewart, G. (2018) · Nature · doi:10.1038/nature25753 · Cited by 1,709
Salanti, G. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1037 · Cited by 1,729
Metadata
- Authors
- Patsopoulos, N. A.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2005-05-18
- Volume
- 293
- Issue
- 19
- Pages
- 2362
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2052432047
- Cited by
- 498
- References
- 22
- FWCI
- 24.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.