Methodological quality in clinical trials and bibliometric indicators: no evidence of correlations
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Rigorous research, including pre-registered replications, does not necessarily correlate with popularity in terms of citations.
“Others have similarly remarked that rigorous research, including pre-registered replications, does not necessarily correlate with popularity in terms of citations (Akcan et al., 2013; Hardwicke et al., 2021).”
From Can ChatGPT be used to predict citation counts, readership, and social media interaction? An exploration among 2222 scientific abstracts (2024) · cites this paper as Akcan et al., 2013
Cites
Users' guides to the medical literature
Guyatt, G. H. (1993) · JAMA · doi:10.1001/jama.270.17.2096 · Cited by 2,970 · see citing works
The History and Meaning of the Journal Impact Factor
Garfield, E. (2006) · JAMA · doi:10.1001/jama.295.1.90 · Cited by 2,770 · see citing works
Users' Guides to the Medical Literature
Guyatt, G. H. (1993) · JAMA · doi:10.1001/jama.1993.03510210084032 · Cited by 941 · see citing works
Users' Guides to the Medical Literature
Guyatt, G. H. (1994) · JAMA · doi:10.1001/jama.1994.03510250075039 · Cited by 693 · see citing works
Callaham, M. (2002) · JAMA · doi:10.1001/jama.287.21.2847 · Cited by 644 · see citing works
(2014) · Wilderness and Environmental Medicine · doi:10.1016/j.wem.2014.09.008 · Cited by 583 · see citing works
How to Use an Article About Therapy or Prevention
Guyatt, G. H., Sackett, D. L., & Cook, D. J. (1995) · Cited by 357 · see citing works
Association of Journal Quality Indicators With Methodological Quality of Clinical Research Articles
Lee, K. P. (2002) · JAMA · doi:10.1001/jama.287.21.2805 · Cited by 284 · see citing works
The relationship between quality of research and citation frequency
Nieminen, P. A., Carpenter, J. R., Rücker, G., & Schumacher, M. C. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-42 · Cited by 185 · see citing works
Antibiotic Prophylaxis in Surgical Procedures
Guglielmo, B. J. (1983) · Archives of Surgery · doi:10.1001/archsurg.1983.01390080045013 · Cited by 162 · see citing works
Journal impact factor in the era of expanding literature.
Andersen, J., Belmont, J. M., & Cho, C. T. (2006) · PubMed · Cited by 125 · see citing works
Banta, D., & Jonsson, E. (2009) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462309090321 · Cited by 121 · see citing works
Factors associated with citation rates in the orthopedic literature.
Bhandari, M., Busse, J. W., Devereaux, P. J., Montori, V. M., Swiontkowski, M. F., Tornetta, P., Einhorn, T. A., Khera, V., & Schemitsch, E. H. (2007) · PubMed Central · Cited by 120 · see citing works
West, R., & McIlwaine, A. (2002) · Addiction · doi:10.1046/j.1360-0443.2002.00104.x · Cited by 89 · see citing works
Critical Appraisal of Scientific Articles
du Prel, J., Röhrig, B., & Blettner, M. (2009) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.2009.0100 · Cited by 63 · see citing works
Akre, O., Barone‐Adesi, F., Pettersson, A., Pearce, N. E., Merletti, F., & Richiardi, L. (2009) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2009.088690 · Cited by 44 · see citing works
Validity of the Impact Factor of Journals as a Measure of Randomized Controlled Trial Quality
Barbui, C., Cipriani, A., Malvini, L., & Tansella, M. (2006) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v67n0106 · Cited by 35 · see citing works
National bias in citations in urology journals: parochialism or availability?
Grangé (1999) · British Journal of Urology · doi:10.1046/j.1464-410x.1999.00267.x · Cited by 33 · see citing works
Methodology and Analytic Techniques Used in Clinical Research
Kuroki, L. M., Allsworth, J. E., & Peipert, J. F. (2009) · Obstetrics and Gynecology · doi:10.1097/aog.0b013e3181b5c9e8 · Cited by 27 · see citing works
Lundberg, J., Brommels, M., Skår, J., & Tomson, G. B. (2008) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462307080099 · Cited by 11 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Factors affecting citation rates of research articles
Onodera, N., & Yoshikane, F. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23209 · Cited by 202 · see citing works
Scientific citations favor positive results: a systematic review and meta-analysis.
Duyx, B., Urlings, M. J. E., Swaen, G. M. H., Bouter, L. M., & Zeegers, M. P. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.06.002 · Cited by 197 · see citing works
de Winter, J. (2024) · Scientometrics · doi:10.1007/s11192-024-04939-y · Cited by 34 · see citing works
“Others have similarly remarked that rigorous research, including pre-registered replications, does not necessarily correlate with popularity in terms of citations (Akcan et al., 2013; Hardwicke et al., 2021).”
Comparative science mapping: a novel conceptual structure analysis with metadata
Aria, M., Cuccurullo, C., D’Aniello, L., Misuraca, M., & Spano, M. (2024) · Scientometrics · doi:10.1007/s11192-024-05161-6 · Cited by 34 · see citing works
Thelwall, M. A., & Kousha, K. (2016) · Scientometrics · doi:10.1007/s11192-016-2112-1 · Cited by 26 · see citing works
Scientific Impact and Clinical Influence: Identifying Landmark Studies in Burns
Ring, J., Castanov, V., McLaren, C., Hajjar, A. E. J., & Jeschke, M. G. (2020) · Journal of Burn Care & Research · doi:10.1093/jbcr/iraa083 · Cited by 5 · see citing works
Schwartz, S. M., Barpujari, A., Finnerup, N. B., & Raja, S. N. (2021) · Pain · doi:10.1097/j.pain.0000000000002426 · Cited by 4 · see citing works
Determinants of societal and academic recognition: Evidence from randomised controlled trials
Sotudeh, H., Asadi, A., & Yousefi, Z. (2021) · Journal of Information Science · doi:10.1177/01655515211039665 · Cited by 2 · see citing works
Nedostaci sadašnjeg sistema vrednovanja naučnika – kako ga usavršiti?
Vučković-Dekić, L. (2014) · Биомедицинска истраживања · doi:10.7251/bii1402072v · Cited by 1 · see citing works
Nilius, H., Kuster, L., Boss, R., Boschetti, L., Mihalek, N., Ferreira, A. S., Naas, S., Jegerlehner, S. N., Largiadèr, C. R., NAKAS, C., et al. (2026) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2026.112270
- Authors
- Akcan, D., Axelsson, S., Bergh, C., Davidson, T., & Rosén, M.
- Affiliations
- SBU - Swedish Agency for Health Technology Assessment and Assessment of Social Services (SE)
- Sahlgrenska University Hospital (SE)
- Linköping University (SE)
- Karolinska Institutet (SE)
- Corresponding author
- Rosén, Måns
- Venue
- Scientometrics
- Published
- 2013-01-29
- Volume
- 96
- Issue
- 1
- Pages
- 297-303
- ISSN
- 0138-9130 (ISSN-L)
- 1588-2861
- OpenAlex
- W2011398410
- Cited by
- 11
- References
- 22
- Citations by year
- 2026: 1 · 2024: 2 · 2023: 1 · 2021: 2 · 2020: 1 · 2017: 1 · 2016: 1 · 2014: 2
- FWCI
- 1.02
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Scientometrics (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- bibliometric indicators, citation counts, journal impact factor, methodological quality, clinical trials, research quality assessment, research funding allocation, internal validity, dropout rates
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
