Measuring academic research impact: Creating a citation profile using the conceptual framework for implementation fidelity as a case study
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A document might be cited more than once at different places in the citing document for different reasons.
“A document might be cited more than once at different places in the citing document for different reasons (Carroll, 2016).”
From Core Elements in the Process of Citing Publications: Conceptual Overview of the Literature (2018) · cites this paper as Carroll, 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Part of this paper’s reference list could not be split into single entries.
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553 · see citing works
A conceptual framework for implementation fidelity
Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007) · Implementation Science · doi:10.1186/1748-5908-2-40 · Cited by 2,559 · see citing works
Self-citationPorta, M. (2026) · doi:10.1093/acref/9780197663639.001.0001 · Cited by 2,175 · see citing works
Wilsdon, J., Allen, L., Belfiore, E., Campbell, P., Curry, S., Hill, S. A., Jones, R. D., Kain, R. J. P., Kerridge, S., Thelwall, M. A., et al. (2015) · Digital Education Resource Archive (University College London) · doi:10.13140/rg.2.1.4929.1363 · Cited by 738 · see citing works
Google Scholar as a new source for citation analysis
Harzing, A.-W. K., & van der Wal, R. (2007) · Ethics in Science and Environmental Politics · doi:10.3354/esep00076 · Cited by 677 · see citing works
The Metric Tide: Independent Review of the Role of Metrics in Research Assessment and Management
Wilsdon, J. (2015) · doi:10.4135/9781473978782 · Cited by 610 · see citing works
Psychotherapeutic benefits of compassion-focused therapy: an early systematic review
Leaviss, J., & Uttley, L. (2015) · Psychological Medicine · doi:10.1017/s0033291714002141 · Cited by 546 · see citing works
Using the Knowledge to Action Framework in practice: a citation analysis and systematic review
Field, B., Booth, A., Ilott, I., & Gerrish, K. (2014) · Implementation Science · doi:10.1186/s13012-014-0172-2 · Cited by 454 · see citing works
van Leeuwen, T. N., Moed, H. F., Tijssen, R., Visser, M. S., & van Raan, A. F. J. (2001) · Scientometrics · doi:10.1023/a:1010549719484 · Cited by 433 · see citing works
Time to publication for results of clinical trials
Hopewell, S., Clarke, M. J., Stewart, L., & Tierney, J. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000011.pub2 · Cited by 243 · see citing works
Carroll, C., Rick, J., Pilgrim, H., Cameron, J., & Hillage, J. (2010) · Disability and Rehabilitation · doi:10.3109/09638280903186301 · Cited by 214 · see citing works
Self-citationLast, J. M. (1986) · International Journal of Epidemiology · doi:10.1093/ije/15.2.277 · Cited by 196 · see citing works
Hasson, H., Blomberg, S., & Dunér, A. (2012) · Implementation Science · doi:10.1186/1748-5908-7-23 · Cited by 194 · see citing works
Beyond citation analysis: a model for assessment of research impact
Sarli, C. C., Dubinsky, E., & Holmes, K. (2010) · Journal of the Medical Library Association JMLA · doi:10.3163/1536-5050.98.1.008 · Cited by 135 · see citing works
Bibliometrics of systematic reviews: analysis of citation rates and journal impact factors
Royle, P., Kandala, N., Barnard, K. D., & Waugh, N. R. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-74 · Cited by 122 · see citing works
Article processing charges in OA journals: relationship between price and quality
Björk, B., & Solomon, D. (2015) · Scientometrics · doi:10.1007/s11192-015-1556-z · Cited by 119 · see citing works
National research impact indicators from Mendeley readers
Fairclough, R., & Thelwall, M. A. (2015) · RePEc: Research Papers in Economics · Cited by 57 · see citing works
On measuring scholarly influence by citations
Ravallion, M. D., & Wagstaff, A. R. (2011) · Scientometrics · doi:10.1007/s11192-011-0375-0 · Cited by 53 · see citing works
National research impact indicators from Mendeley readers
Fairclough, R., & Thelwall, M. (2015) · Journal of Informetrics · doi:10.1016/j.joi.2015.08.003 · Cited by 45 · see citing works
Denicolo, P. M. (2014) · SAGE Publications Ltd eBooks · doi:10.4135/9781473913950 · Cited by 30 · see citing works
Lortie, C., Aarssen, L., Budden, A., & Leimu, R. (2012) · Scientometrics · doi:10.1007/s11192-012-0822-6 · Cited by 27 · see citing works
Chandler, C. (2014) · SAGE Publications Ltd eBooks · doi:10.4135/9781473913950.n1 · Cited by 15 · see citing works
Implementing EBLIP: if it works in Edmonton will it work in Newcastle?
Booth, A. (2008) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2008.00772.x · Cited by 6 · see citing works
Flagged first, then by citations
3 of the 26 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Core Elements in the Process of Citing Publications: Conceptual Overview of the Literature
Tahamtan, I., & Bornmann, L. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.01.002 · Cited by 149 · see citing works
Bornmann, L., Wray, K. B., & Haunschild, R. (2019) · Scientometrics · doi:10.1007/s11192-019-03326-2 · Cited by 54 · see citing works
Ajibade, S.-S. M., Zaidi, A. T., Luhayb, A. S. M. A., Adediran, A. O., Voumik, L. C., & Rabbi, F. (2023) · International Journal of Energy Economics and Policy · doi:10.32479/ijeep.14832 · Cited by 41 · see citing works
Tattersall, A., & Carroll, C. (2018) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2017.00009 · Cited by 35 · see citing works
Self-citationWang, M., Ren, J., Li, S., & Chen, G. (2019) · IEEE Access · doi:10.1109/access.2019.2927016 · Cited by 15 · see citing works
Quality and impact considerations in bibliometrics: a reply to Ricker (in press)
Bornmann, L., & Haunschild, R. (2017) · Scientometrics · doi:10.1007/s11192-017-2373-3 · Cited by 14 · see citing works
Assessing books’ academic impacts via integrated computation of multi-level citation information
Zhou, Q. (2022) · The Electronic Library · doi:10.1108/el-03-2022-0060 · Cited by 11 · see citing works
Application of Machine Learning in Energy Storage: A Scientometric Research of a Decade
Ajibade, S.-S. M., Bashir, F. M., Dodo, Y. A., Dayupay, J. P., Calzada, L. M. D. L., & Adediran, A. O. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-48981-5_10 · Cited by 9 · see citing works
Bornmann, L., Ye, A. Y., & Ye, F. Y. (2017) · Scientometrics · doi:10.1007/s11192-017-2521-9 · Cited by 8 · see citing works
DE MK Építőmérnöki Tanszék, D., & Csomós, G. (2019) · Földrajzi Közlemények · doi:10.32643/fk.143.3.6 · Cited by 3 · see citing works
Carroll, C., & Tattersall, A. (2020) · Value in Health · doi:10.1016/j.jval.2020.01.012 · Cited by 3 · see citing works
Self-citationPaper Impact Effectiveness (PIE): A New Way to Measure the Impact of Research Papers
Halaweh, M. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.05.163 · Cited by 2 · see citing works
Response to the commentary “to the bone”
McMahon, S. A., Muula, A. S., & Allegri, M. D. (2019) · SSM - Population Health · doi:10.1016/j.ssmph.2019.100380
- Authors
- Carroll, C.
- Affiliations
- University of Sheffield (GB)
- Corresponding author
- Carroll, Christopher
- ORCID
- Carroll, Christopher
- Venue
- Scientometrics
- Published
- 2016-07-25
- Volume
- 109
- Issue
- 2
- Pages
- 1329-1340
- ISSN
- 0138-9130 (ISSN-L)
- 1588-2861
- OpenAlex
- W2505251935
- Cited by
- 14
- References
- 26
- Citations by year
- 2024: 1 · 2023: 2 · 2022: 1 · 2020: 1 · 2019: 4 · 2018: 3 · 2017: 2
- FWCI
- 2.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Scientometrics (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- citation impact, implementation fidelity, conceptual framework, citation metrics, research impact assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
