Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level
Open accessPublished version of a preprint
The DOI matches its Crossref record; 87 of the 91 references it cites were found in a registry or an index; 1 of the 30 sources its claims cite were checked for support.
Abstract
Despite their recognized limitations, bibliometric assessments of scientific productivity have been widely adopted. We describe here an improved method to quantify the influence of a research article by making novel use of its co-citation network to field-normalize the number of citations it has received. Article citation rates are divided by an expected citation rate that is derived from performance of articles in the same field and benchmarked to a peer comparison group. The resulting Relative Citation Ratio is article level and field independent and provides an alternative to the invalid practice of using journal impact factors to identify influential papers. To illustrate one application of our method, we analyzed 88,835 articles published between 2003 and 2010 and found that the National Institutes of Health awardees who authored those papers occupy relatively stable positions of influence across all disciplines. We demonstrate that the values generated by this method strongly correlate with the opinions of subject matter experts in biomedical research and suggest that the same approach should be generally applicable to articles published in all areas of science. A beta version of iCite, our web tool for calculating Relative Citation Ratios of articles listed in PubMed, is available at https://icite.od.nih.gov.
Verification finished with gaps
Some checks didn’t finish. The results below cover the steps that did.
- Registry recordVerified
- Full textRead the full text
- Reference list87 references found
- Reference check87 of 87 references checked
- StatisticsRecomputed
- Claims86 claims anchored to a quote
- Cited sourcesChecked
- Self-checkDidn’t finish — the rest of the report still applies.
- VerificationFindings verified
Overview
CoChat Summary
## TL;DR
The paper introduces Relative Citation Ratio (RCR), an article-level, field-normalized citation metric built from co-citation networks and benchmarked to a peer group. The authors report that RCR correlates strongly with expert judgments, behaves better than several existing bibliometrics in their tests, and is available through the iCite web tool.
## Key findings
- Co-citation networks were used to define an article’s field; in a validation study, diagnostic words were more likely to be shared between an article and papers in its co-citation network than between that article and papers in the same journal, based on 1,397 articles and 249,981 pairwise comparisons within co-citation networks versus 28,516,576 comparisons with same-journal articles.
- In a benchmark set of 35,837 papers published in 2009 by NIH R01 recipients, FCRs based on co-citation networks had lower variance than FCRs based on cited or citing networks, and lower variance than ACRs or JIFs (p < 10−4 for the variance comparisons reported).
- RCR correlated well with subject matter expert ratings across three validation datasets: 2,193 Faculty of 1000-rated articles, 430 STPI-rated articles, and 290 NIH-rated articles.
- In an NIH case study of 88,835 articles from 3,089 continuously funded R01 principal investigators, 53% of investigators in the top RCR quintile stayed there across two 4-year periods, and 53% of those in the bottom quintile stayed at the bottom; among more than 200,000 articles analyzed for FCR stability, only 0.2% had an RCR drop of 0.1 or more between 2012 and 2014, and less than 2% dropped at all.
## Methods
- The metric was built from an article’s co-citation network: papers citing the reference article were used to assemble the set of co-cited papers, whose journal citation rates were averaged to form the field citation rate (FCR); the article’s article citation rate (ACR) was then normalized by FCR and benchmarked to a peer group to yield RCR.
- Citation analyses used the Thomson Reuters Web of Science dataset from 2002–2012 (extended to 2014 for FCR stability analyses), focusing on journals in which NIH R01-funded researchers published; grant and PI data came from NIH RePORTER, SPIRES, and IMPAC-II.
- Validation included cosine-similarity content analysis with IN-SPIRE on 1,397 articles from six journals, expert-comparison analyses, and regression/variance tests; RCR benchmarking used OLS for large-scale analyses and quantile regression as an alternative for smaller, skewed settings.
## Limitations
- The paper states that RCR cannot be calculated immediately after publication; enough citations must accrue first, and the authors note that 93% of co-citation-network-based FCRs stabilize after a paper has been cited five times.
- The authors explicitly say they have not determined whether small differences in RCR, such as 1.0 versus 1.2, reliably reflect meaningful differences in influence.
- The paper also states that citation metrics cannot fully capture article value, are not a substitute for reading the paper, and RCR is not designed as a measure of long-term impact or as a metric for applied research; these are stated limitations of scope.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



![Fig 4 RCRs correspond with expert reviewer scores. (A–C) Bubble plots of reviewer scores versus RCR for three different datasets. Articles are binned by reviewer score; bubble area is proportionate to the number of articles in that bin. (A) F1000 scores for 2,193 R01-funded papers published in 2009. Faculty reviewers rated the articles on a scale of one to three (“good,” “very good,” and “exceptional”, respectively); those scores were summed into a composite F1000 score for each article (S3 Fig). (B) Reviewer scores of 430 HHMI and NIH-funded papers collected by STPI. (C) Scores of 290 R01-funded articles reviewed by experts from the NIH Intramural Research Program. Black line, linear regression. (D) Box-and-whisker plots illustrating the distribution of journal impact factors (JIFs) citations per year (CPY) and RCRs for two areas of NIH-funded research from 2007–2011. Cell biology, n = 5,936; neurological function, n = 5,417. *** p < 0.001, Kruskal-Wallis with Dunn’s multiple comparison test. n.s., not significant. Mean represented by a “+.” (E) Comparison of RCRs (orange) and Thompson Reuters ratios (blue) [17,28] for the same 544 articles with a low denominator. Data points are partially transparent to allow coordinates with multiple papers (darker) to be more clearly identified.](https://figures.cochat.ai/paper-figures/e792b94297fa4418b200b0579a2ea0b9/relative-citation-ratio-rcr-a-new-metric-that-uses-citation-rates-to-measure-figure-4.jpg)


![Fig 7 Properties of RCRs at the article and investigator level. (A, B) Frequency distribution of article-level RCRs (A) and JIFs (B), from 88,835 papers (authored by 3,089 R01-funded principal investigators [PIs]) for which co-citation networks were generated. Article RCRs are well fit by a log-normal distribution (R2 = 0.99), and JIFs less so (R2 = 0.79). (C) Box-and-whisker plots summarizing JIFs for the same papers, binned by impact factor quintile (line, median; box, 25th–75th percentiles; whiskers, 10th–90th percentiles). (D) RCR for the same papers using the same bins by JIF quintile (same scale as C). Although the median RCR for each bin generally corresponds to the impact factor quintile, there is a wide range of article RCRs in each category. (E) Box-and-whisker plots summarizing RCRs of these same papers published in selected journals. In each journal, there are papers with article RCRs surpassing the median RCR of the highest impact factor journals (left three). The impact factor of each journal is shown above. (F, G) Frequency distribution of investigator-level RCRs (F) and JIFs (G), representing the mean values for papers authored by each of 3,089 R01-funded PIs. Dashed line in (F), mode of RCR for PIs.](https://figures.cochat.ai/paper-figures/7111239ea73541aeace7efe3f230790e/relative-citation-ratio-rcr-a-new-metric-that-uses-citation-rates-to-measure-figure-7.jpg)

Verification
Claims the paper makes
1 Valid · 1 Not valid · 18 Not checked · 66 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Strikingly, this analysis showed that diagnostic words are much more likely to be shared between an article and the papers in its co-citation network than between that same article and the papers that appear alongside it in its journal of publication (Fig 2).”
§ Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level > Results > Co-citation Networks Represent an Article’s Area of Influence
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We demonstrate that the values generated by this method strongly correlate with the opinions of subject matter experts in biomedical research”
§ Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level > Abstract
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“though journals with the highest impact factors have the highest median RCR”
§ Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level > Results > Quantifying How Past Influence Predicts Future Performance We next undertook a large case study of all 88,835 articles published by NIH investigators who maintained continuous R01 funding from fiscal year (FY) 2003 through FY2010 to ask how the RCR of publications from individual investigators changed over this 8-y interval. Each of these investigators had succeeded at least once in renewing one or more of their projects through the NIH competitive peer review process. In aggregate, the RCR values for these articles are well matched to a log-normal distribution (Fig 7); in contrast, as noted previously by others, the distribution of impact factors of the journals in which they were published is non-normal (Fig 7A and 7B) [53,54]. Sorting into quintiles based on JIF demonstrates that, though journals with the highest impact factors have the highest median RCR, influential publications can be found in virtually all journals (Fig 7C and 7D); these data call into question the assertion that journal of publication is the strongest quality signal for researchers who are young or otherwise unknown to a field [55]. Focusing on a dozen representative journals with a wide range of JIFs further substantiates the finding that influential science appears in many venues and reveals noteworthy departures from the correlation between JIF and median RCR (see S1 Text). For example, NIH-funded articles in both Organic Letters (JIF = 4.7) and the Journal of the Acoustical Society of America (JIF = 1.6) have a higher median RCR than those in Nucleic Acids Research (JIF = 7.1; Fig 7E). As part of this case study, we also calculated the average RCR and average JIF for papers published by each of the 3,089 NIH R01 principal investigators (PIs) represented in the dataset of 88,835 articles. In aggregate, the average RCR and JIF values for NIH R01 PIs exhibited log-normal distributions (Fig 7F and 7G) with substantially different hierarchical ordering (S8 Fig). This raised a further question concerning PIs with RCR values near the mode of the log-normal distribution (dashed line in Fig 7F): as measured by the ability to publish work that influences their respective fields, to what extent does their performance fluctuate? We addressed this question by dividing the 8-y window (FY2003 through FY2010) in half. Average RCRs in the first time period (FY2003 through FY2006) were sorted into quintiles, and the percentage of PIs in the second time period (FY2007 through FY2010) that remained in the same quintile, or moved to a higher or lower quintile, was calculated (Fig 8). The position of PIs in these quintiles appeared to be relatively immobile; 53% of PIs in the top quintile remained at the top, and 53% of those in the bottom quintile remained at the bottom (Fig 8A). For each PI, we also calculated a weighted RCR (the number of articles multiplied by their average RCR); comparing on this basis yielded almost identical results (Fig 8B). It is worth noting that average FCRs for investigators were extremely stable from one 4-y period to the next (Pearson r = 0.92, Table 2), Since FCRs are the quantitative representation of co-citation networks, this further suggests that each co-citation network is successfully capturing the corresponding investigator’s field of research. Another possible interpretation of the above data is that PI RCRs perform an unbiased random walk from their initial state with a large diffusion rate. Considered from this frame, it could be said that 47% of PIs who started in the top quintile moved out of it during the second 4-y period we analyzed. To test this hypothesis directly, we performed a mean reversion test, which determines whether or not the set of values under consideration will return to an average, or mean, value over time. If drift in PI RCR were simply a random walk, then the change in RCR should by definition be independent of starting RCR, and plotting these two values against each other should result in a straight line with a slope of zero. However, the results show that change in RCR is dependent on starting RCR value (p < 0.001, linear regression analysis, n = 3,089, Fig 8C). Furthermore, randomly shuffling PI RCRs from the second 4-y period gives a slope that is significantly different than that observed for the real data (p < 0.001, extra sum-of-squares F-test, n = 3,089, Fig 8C), ruling out the possibility that these values are randomly sampled from the same distribution in each time interval.
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The RCR metric is ranking invariant when the same number of uncited articles is added to two groups of equal size (Supporting Equations S7–S9 in S1 Text).”
§ Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level > Results > Expert Validation of RCR as a Measure of Influence For the work presented here, we chose as a benchmark the full set of 311,497 RAs published from 2002 through 2012 by NIH R01 awardees. To measure the degree of correspondence between our method and expert opinion, we compared RCRs generated by OLS benchmarking of ACR/FCR values with three independent sets of postpublication evaluations by subject matter experts (details in S1 Text). We compared RCR with expert rankings (Fig 4) for 2,193 articles published in 2009 and evaluated by Faculty of 1000 members (Fig 4A and S3 Fig), as well as rankings of 430 Howard Hughes Medical Institute- or NIH-funded articles published between 2005 and 2011 and evaluated in a study conducted by the Science and Technology Policy Institute (STPI, Fig 4B and S4 Fig), and finally, 290 articles published in 2009 by extramurally funded NIH investigators and evaluated by NIH intramural investigators in a study of our own design (Fig 4C; S5, S6 and S7 Figs). All three approaches demonstrate that RCR values are well correlated with reviewers’ judgments. We asked experts in the latter study to provide, in addition to an overall score, scores for several independent subcriteria: likely impact of the research, importance of the question being addressed, robustness of the study, appropriateness of the methods, and human health relevance. Random Forest analysis [38] indicated that their scores for likely impact were weighted most heavily in determining their overall evaluation (S6 Fig). In addition to correlating with expert opinion, RCR is ranking invariant, which is considered to be a desirable property of bibliometric indicators [39,40]. In short, an indicator is ranking invariant when it is used to place two groups of articles in hierarchical order, and the relative positions in that order do not change when uncited articles are added to each group. The RCR metric is ranking invariant when the same number of uncited articles is added to two groups of equal size (Supporting Equations S7–S9 in S1 Text). RCR is also ranking invariant when the same proportion of uncited articles is added to two groups of unequal size (Supporting Equations S10–S11 in S1 Text). This demonstrates that the RCR method can be used effectively and safely in evaluating the relative influence of large groups of publications.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The average TR ratio for these papers is 1.67, and the average RCR is 0.67.”
§ Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level > Results > Comparison of RCR to Existing Bibliometrics
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
50 more claims
Create a free account to see all 86 claims and to verify the 29 references still open.
- Probably not a substantial claim. 18
- It may state two separate claims as one. 16
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The RCR methodology was validated using citation data from about 90,000 published papers emanating from NIH-funded research and comparing calculated RCRs to the opinions on manuscript reach of recognized experts in selected fields.”
From Structure, function, and productivity from the National Dental Practice-Based Research Network. (2022) · cites this paper as [11]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As one of several methods to quantify publication quality or its impact on the field, the RCR has performed better than journal impact factor, citations per year, or the Thompson–Reuters ratio [11,26,27].”
From Structure, function, and productivity from the National Dental Practice-Based Research Network. (2022) · cites this paper as [11]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The wRCR was considered a measure of influence, with higher values representing the most cited publications 22 .”
From Global mapping of randomized controlled trials in dentistry (2024) · cites this paper as [22]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“the Relative Citation Ratio (RCR) was developed to quantify the influence of a research article that is article level and independent of the scientific field [11].”
From Structure, function, and productivity from the National Dental Practice-Based Research Network. (2022) · cites this paper as [11]
The cited source says what the claim attributes to it.
In the citing paper
“That the median RCR of Network publications exceeded 1.0 and the weighted RCR substantially exceeded the total number of publications upon which the analysis was based, demonstrate that the network’s publications have had a greater-than-average influence in their fields [11].”
From Structure, function, and productivity from the National Dental Practice-Based Research Network. (2022) · cites this paper as [11]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
This check didn’t finish.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
(1999) · Cited by 12,854
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669 · cited 4×
“In recent years, decisionmakers have increasingly turned to numerical approaches such as counting first or corresponding author publications, using the impact factor of the journals in which those publications appear, and computing Hirsch or H-index values (2).”
BackgroundMethodInfluentialCo‐citation in the scientific literature: A new measure of the relationship between two documents
Small, H. (1973) · Journal of the American Society for Information Science · doi:10.1002/asi.4630240406 · Cited by 5,345 · cited 1×
“There are a priori three types of article-linked citation networks [35].”
BackgroundKoenker, R. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511754098 · Cited by 4,551
Bibliometrics: The Leiden Manifesto for Research Metrics
Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015) · Nature · doi:10.1038/520429a · Cited by 2,828 · cited 2×
“These authors [41] also found that RCR is better correlated with expert opinion than citation percentiles, which is the measure bibliometricians have previously recommended as best for evaluating the impact of published work [43].”
BackgroundGarfield, E. (1972) · Science · doi:10.1126/science.178.4060.471 · Cited by 2,788 · cited 4×
“For reasons of algorithmic parsimony we used the JCRs for the year each article in the co-citation network was published; a different choice at this step would be expected to have little if any effect, since almost all JCRs are quite stable over time ( Supporting Figure S1; Supporting Table S1 ).”
MethodInfluentialThe History and Meaning of the Journal Impact Factor
Garfield, E. (2006) · JAMA · doi:10.1001/jama.295.1.90 · Cited by 2,770 · cited 1×
“Journal impact factor (JIF) was for a time seen as a valuable indicator of scientific quality because it serves as a convenient, and not wholly inaccurate, proxy for expert opinion [8].”
BackgroundWhy the impact factor of journals should not be used for evaluating research
Seglen, P. O. (1997) · BMJ · doi:10.1136/bmj.314.7079.497 · Cited by 2,447
Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market
Salganik, M. J., Dodds, P. S., & Watts, D. J. (2006) · Science · doi:10.1126/science.1121066 · Cited by 2,231 · cited 2×
“The results of a landmark study on the relationship between quality and success in a competitive market suggest that the ultimate winners in such contests are determined not only by the intrinsic value of the work but also by more intangible social variables [66].”
Background
Cited by
Items 201–300 of 515
Metrics and Rankings: Myths and Fallacies
Manolopoulos, Y., & Katsaros, D. (2017) · Communications in computer and information science · doi:10.1007/978-3-319-57135-5_19 · Cited by 11
“The basic idea behind RCR is clever, however the study reported in [9], establishes that the RCR correlates highly with established field-normalized indicators, but the correlation between RCR and peer assessments is only low to medium.”
BackgroundType 1 diabetes in children: a scientometric assessment of Indian research output from 1990 to 2019
Dayal, D., Gupta, B. M., Gupta, S., & Gupta, A. (2021) · International Journal of Diabetes in Developing Countries · doi:10.1007/s13410-021-00919-7 · Cited by 10
de Lima, C., Neto, M. F. D. S., Costa, R. F. A., Franco, J. O., Calfi, G. S., Paiva, B. S. R., & Paiva, C. E. (2021) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2021.03.017 · Cited by 9
Patel, P. A., & Ali, M. J. (2022) · Seminars in Ophthalmology · doi:10.1080/08820538.2022.2088981 · Cited by 9
“Another criticism is that this measure may be influenced by self-citations, although that effect is likely quite limited.(5)”
BackgroundInfluentialScaling Scientometrics: Dimensions on Google BigQuery as an Infrastructure for Large-Scale Analysis
Hook, D. W., & Porter, S. J. (2021) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2021.656233 · Cited by 8
“Most in academia agree that formal research publication dates from 1665 with the first issue of the Philosophical Transaction of the Royal Society [29].”
MethodInfluentialDoose, M., Mollica, M. A., Acevedo, A. M., Tesauro, G., Gallicchio, L. M., Reed, C., Guida, J., Maher, M. E., Srinivasan, S., & Tonorezos, E. S. (2024) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djae073 · Cited by 10
Current Applications of Raman Spectroscopy in Intraoperative Neurosurgery
Rivera, D., Young, T., Rao, A., Zhang, J. Y., Brown, C. S., Huo, L., Williams, T. D., Rodriguez, B., & Schüpper, A. J. (2024) · Biomedicines · doi:10.3390/biomedicines12102363 · Cited by 11
Limited diffusion of scientific knowledge forecasts collapse
Kang, D., Danziger, R. S., Rehman, J., & Evans, J. A. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02041-0 · Cited by 11
“The citation metric manifests some distortion, however, from the inflation of citation counts with historical growth in articles 13 and the unequal size of fields 14 .”
Extracellular RNA communication: A decade of NIH common fund support illuminates exRNA biology
Amolegbe, S. M., Johnston, N., Ambrosi, A., Ganguly, A., Howcroft, T. K., Kuo, L. S., Labosky, P. A., Rudnicki, D. D., Satterlee, J. S., Tagle, D. A., et al. (2025) · Journal of Extracellular Vesicles · doi:10.1002/jev2.70016 · Cited by 10
Mishra, A., Lee, H., Jeoung, S., Torvik, V. I., & Diesner, J. (2025) · PLoS ONE · doi:10.1371/journal.pone.0316890 · Cited by 9
Qua, K., Yu, F., Patel, T., Dave, G., Cornelius, K. E., & Pelfrey, C. M. (2021) · Journal of Medical Internet Research · doi:10.2196/29239 · Cited by 8
“We used iCite data to understand the impact of the publications compared with the average of NIH-funded publications published in the same year and field [18].”
Ho, S. Y.-C., Chien, T., Huang, C., & Tsai, K. (2022) · Medicine · doi:10.1097/md.0000000000031335 · Cited by 8
“The RCRs for each article were extracted from the icite analysis,[24] implying that the RCR values measure the scientific influence of each paper by field and time, adjusting the citations it has received and benchmarking to the median for National Institutes of Health publications.[5] Another hypothesis proposed that…”
MethodRavi, M., Tewari, N., Atif, M., Srivastav, S., Shrivastava, N., & Rahul, M. (2023) · Dental Traumatology · doi:10.1111/edt.12893 · Cited by 8
Teh, P. L., & Uwasomba, C. F. (2024) · Journal of Social Computing · doi:10.23919/jsc.2024.0011 · Cited by 14
Globalised vs averaged: Bias and ranking performance on the author level
Dunaiski, M., Geldenhuys, J., & Visser, W. (2019) · Journal of Informetrics · doi:10.1016/j.joi.2019.01.006 · Cited by 8
Sudah, S. Y., Faccone, R. D., Denard, P. J., & Menendez, M. E. (2022) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2022.03.017 · Cited by 8
Dijanic, C. N., Sudah, S. Y., Michel, C., Smith, T. A., Patankar, A. G., Manzi, J. E., Faccone, R. D., Kerrigan, D. J., Menendez, M. E., & Cohen, J. (2022) · North American Spine Society Journal (NASSJ) · doi:10.1016/j.xnsj.2022.100143 · Cited by 8
“[7] Hutchins BI, Yuan X, Anderson JM, Santangelo GM.”
BackgroundVia, G. G., Brueggeman, D. A., Lyons, J. G., Ely, I., Froehle, A. W., & Krishnamurthy, A. (2022) · Arthroplasty · doi:10.1186/s42836-022-00146-3 · Cited by 8
Smith, T. A., Sudah, S. Y., Manzi, J. E., Michel, C., Kerrigan, D. J., Dijanic, C. N., Constantinescu, D. S., Menendez, M. E., & Plyler, R. J. (2023) · Orthopaedic Journal of Sports Medicine · doi:10.1177/23259671221137845 · Cited by 8
“The RCR utilizes a co-citation network of an article to normalize its research impact to that of others in the field and compares this performance with a peer comparison group.(7) Specifically, the RCR is calculated as the total number of citations per year of a particular publication divided by the mean number of cit…”
MethodThe k-step h-index in citation networks at the paper, author, and institution levels
Yang, A. J., Wu, L., Zhang, Q., Wang, H., & Deng, S. (2023) · Journal of Informetrics · doi:10.1016/j.joi.2023.101456 · Cited by 10
Ündar, A. (2017) · Artificial Organs · doi:10.1111/aor.13079 · Cited by 8
Waypoints for Evaluating Big Science*
Bianco, W. T., Gerhart, D., & Nicholson‐Crotty, S. (2017) · Social Science Quarterly · doi:10.1111/ssqu.12467 · Cited by 8
Rooted citation graphs density metrics for research papers influence evaluation
Giatsidis, C., Nikolentzos, G., Zhang, C., Tang, J., & Vazirgiannis, M. (2019) · Journal of Informetrics · doi:10.1016/j.joi.2019.03.006 · Cited by 10
Introducing the MAVEN Leadership Training Initiative to diversify the scientific workforce
Wang, Y. C., Brondolo, E. N., Monane, R., Kiernan, M., Davidson, K. W., The MAVEN Leadership Team, Alfano, C. M., Diamond, B., Duer-Hefele, J., Hill‐Briggs, F., et al. (2021) · eLife · doi:10.7554/elife.69063 · Cited by 8
“The Major Educational Score Index, which will be used to assess productivity, is calculated by summing four normalized variables: h-index (Hirsch, 2005), annual relative citation ratio (Hutchins et al., 2016), annual number of publications in journals with an impact factor above 5, and annual federal grant income.”
MethodNi, C., & Hutchins, B. I. (2025) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.25009 · Cited by 7
Self-citationArabi, S., Ni, C., & Hutchins, B. I. (2025) · PLoS Biology · doi:10.1371/journal.pbio.3003532 · Cited by 8
Self-citationWang, H., Bajaj, S. S., Heiler, J. C., Krishnan, A., Williams, K. M., Woo, Y.-P. J., & Boyd, J. H. (2022) · JTCVS Open · doi:10.1016/j.xjon.2021.10.063 · Cited by 7
“Scholarly impact was assessed using the relative citation ratio (RCR), a field-normalized metric developed and validated by the NIH.(14) Briefly, the RCR represents the citation rate of an article divided by the citation rate of R01-funded articles in the same field.”
MethodDimensions: A Research Tool for Librarians
Petersen, D. W. (2022) · Journal of Electronic Resources in Medical Libraries · doi:10.1080/15424065.2022.2113348 · Cited by 9
“These metrics can be helpful indicators of a paper’s quality and/or popularity and provide quantitative indicators about a paper without using a journal impact factor (Hutchins et al., 2016).”
BackgroundLevin, G., Pareja, R., Harrison, R. F., Ramirez, P. T., & Meyer, R. (2023) · International Journal of Gynecological Cancer · doi:10.1136/ijgc-2023-004380 · Cited by 7
Via, G. G., Brueggeman, D. A., Lyons, J. G., Frommeyer, T. C., Froehle, A. W., & Krishnamurthy, A. (2023) · Journal of Orthopaedics · doi:10.1016/j.jor.2023.03.015 · Cited by 7
Kolsky, M. R., Grossman, E., Levy, Y., & Klang, E. (2023) · The Journal of Climate Change and Health · doi:10.1016/j.joclim.2023.100272 · Cited by 9
Measuring an individual researcher’s impact: new directions and challenges
Senior, M., & Fazel, S. (2019) · Evidence-Based Mental Health · doi:10.1136/ebmental-2019-300122 · Cited by 7
Benefits of basic research from the Superfund Research Program
Suk, W. A., Heacock, M. L., Trottier, B. A., Amolegbe, S. M., Avakian, M. D., Carlin, D. J., Henry, H. F., Lopez, A. R., & Skalla, L. A. (2020) · Reviews on Environmental Health · doi:10.1515/reveh-2019-0104 · Cited by 7
“We also utilized National Institutes of Health (NIH)’s new tool, iCite, to access a dashboard of bibliometrics for SRP-funded publications including the Relative Citation Ratio (RCR), a field-normalized metric that shows the citation impact of articles relative to the average NIH-funded paper (24).”
MethodInfluentialAltmetric and bibliometric analysis of influential articles in reproductive biology, 1980–2019
Park, S. U., Blackledge, K. T., Ananth, C. V., Sauer, M. V., & Brandt, J. S. (2022) · Reproductive BioMedicine Online · doi:10.1016/j.rbmo.2022.04.005 · Cited by 8
Llewellyn, N. M., Weber, A. A., Fitzpatrick, A. M., & Nehl, E. J. (2022) · Translational Pediatrics · doi:10.21037/tp-21-506 · Cited by 7
“ Relative Citation Ratio (RCR) (31), a state of the art field-normalized citation metric that calculates the citation impact of an article relative to the average NIH-funded paper in its co-citation network.”
BackgroundInfluentialYeung, A. W. K. (2020) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.00136 · Cited by 7
Oncology palliative care: access barriers: bibliometric study
Neto, M. F. D. S., Paiva, C. E., de Lima, C., Ribeiro, A. G., & Paiva, B. S. R. (2021) · BMJ Supportive & Palliative Care · doi:10.1136/bmjspcare-2021-003387 · Cited by 7
“22 The adjusted RCR is the sum of the articles in a group.”
BackgroundElucidating the structure and function of the nucleus—The NIH Common Fund 4D Nucleome program
Roy, A. L., Conroy, R., Taylor, V. G., Mietz, J. A., Fingerman, I. M., Pazin, M. J., Smith, P., Hutter, C. M., Singer, D. S., & Wilder, E. L. (2023) · Molecular Cell · doi:10.1016/j.molcel.2022.12.025 · Cited by 10
Bibliometric analysis of genetic counseling publications in Asia: Insights and implications
Abad, P. J. B., Tumulak, M. J. R., Yoon, S., Laurino, M., & Hasan, Q. A. (2024) · Genetics in Medicine Open · doi:10.1016/j.gimo.2024.101861 · Cited by 6
Hausner, C. J., Yi, M., Patel, M., Franchino, J. T., & Day, C. S. (2026) · PLoS ONE · doi:10.1371/journal.pone.0343160 · Cited by 6
Decoding the nuances of scholarly output and publication metrics in orthodontics
Gandedkar, N. H., Allareddy, V., & Vaiid, N. (2024) · Seminars in Orthodontics · doi:10.1053/j.sodo.2024.05.013 · Cited by 7
Elzaher, M. A. S. A., El-Kholany, E. A., Bakr, Y. M., Khattab, E. S. A. E. H., & Ghazy, M. B. M. (2024) · Research Journal of Pharmacy and Technology · doi:10.52711/0974-360x.2024.00430 · Cited by 7
Applying Data Feminism Principles to Assess Bias in English and Arabic NLP Research
Mayeda, C., Singh, A., Mahale, A., Sakr, L. S., & ElSherief, M. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732119 · Cited by 7
“To consider relative impact of papers, we computed a Relative Citation Ratio (RCR), a metric that measures the influence of each publication, normalized to the mean citations received by other publications in the same year and area of research [33].”
Journal- or article-based citation measure? A study of academic promotion at a Swiss university
Steck, N., Stalder, L., & Egger, M. (2020) · F1000Research · doi:10.12688/f1000research.26579.1 · Cited by 6
Health Literacy Research Funded by the NIH for Disease Prevention
Villani, J., & Trivedi, N. S. (2020) · HLRP Health Literacy Research and Practice · doi:10.3928/24748307-20200928-01 · Cited by 6
“The scientific impact of the grants was also measured using the relative citation ratio (RCR) (Hutchins et al., 2016) assigned to each published scientific article that listed one of the grants as a source of funding according to the NIH’s internal database on extramural research funding.”
MethodMethods for identifying biomedical translation: a systematic review.
Padilla‐Cabello, J., Santisteban‐Espejo, A., Heradio, R., Cobo, M. J., Martín‐Piedra, M. Á., & Moral-Muñoz, J. A. (2022) · PubMed · Cited by 6
Rigor and reproducibility for data analysis and design in the study of eating disorders
Susanin, A., Boyar, A., Costello, K., Fraiman, A., Misrok, A. L., Sears, M., & Hildebrandt, T. (2022) · International Journal of Eating Disorders · doi:10.1002/eat.23774 · Cited by 10
Didzbalis, C. J., Cohen, D. A., Herzog, I., Park, J. B., Weisberger, J. S., & Lee, E. S. (2022) · Plastic & Reconstructive Surgery Global Open · doi:10.1097/gox.0000000000004564 · Cited by 6
Dilday, J. C., Gallagher, S. P., Bram, R., Williams, E. C., Grigorian, A., Matsushima, K., Schellenberg, M. A., Inaba, K., & Martin, M. J. (2023) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0000000000004009 · Cited by 6
Herzog, I., Mendiratta, D., Liggio, D. F., Ahn, D. B., Vosbikian, M. M., Kaushal, N. K., & Chu, A. (2023) · JAAOS Global Research and Reviews · doi:10.5435/jaaosglobal-d-23-00080 · Cited by 6
Correlation between journal metrics-based academic evaluation and researchers’ ethics
Ivanović, L., Baaden, P., Jovanović, M., & Ivanović, D. (2023) · Accountability in Research · doi:10.1080/08989621.2023.2295415 · Cited by 6
“Citations are a traditional metric and can be calculated for publications: journal articles, books and book chapters, as well as for other types or outputs, e.g., research data, software or code (Hutchins et al. 2016).”
Wang, X. (2024) · Journal of Informetrics · doi:10.1016/j.joi.2024.101531 · Cited by 6
Qua, K., & Pelfrey, C. M. (2020) · Journal of Clinical and Translational Science · doi:10.1017/cts.2020.516 · Cited by 6
“RCR, relative citation ratio. in other words, howmany publications a scholar produces within a time period.”
MethodInfluentialThe 50 Most‐Cited Papers on Bankart Lesions
Bondar, K. J., Damodar, D. M., Schiller, N. C., McCormick, J. R., Condron, N. B., Verma, N. N., & Cole, B. J. (2021) · Arthroscopy Sports Medicine and Rehabilitation · doi:10.1016/j.asmr.2021.03.001 · Cited by 6
Metric indicators for the evaluation of graduate programs in Brazil: from Qualis to multi-criteria
Castro, P. H. G. R. P., & Filho, D. O. (2022) · Anais da Academia Brasileira de Ciências · doi:10.1590/0001-3765202220210962 · Cited by 8
A bibliometric analysis of global research trends of inflammation in cervical cancer: A review
Kang, M., Qiu, J., Wei, H., & Li, J. (2023) · Medicine · doi:10.1097/md.0000000000036598 · Cited by 8
“[19,21] The title, publication year, authors, country, institution, keywords, journal, citation frequency, and relative citation ratio (obtained from the National Institutes of Health [NIH] Open Citation Collection: https:// icite.od.nih.gov/analysis) were obtained for each article.”
MethodNecessary but not sufficient: unique author identifiers
Harrison, A. M., & Harrison, A. M. (2016) · BMJ Innovations · doi:10.1136/bmjinnov-2016-000135 · Cited by 6
Within the Numbers: Rethinking Bibliometric Evaluation in Academic Medicine
Alter, N. E., Daiem, M., Cornely, R. M., Abbott, E. N., Savitz, B. L., Torres‐Guzman, R. A., Gutama, B. W., Perdikis, G., & Lineaweaver, W. C. (2025) · Journal of Craniofacial Surgery · doi:10.1097/scs.0000000000011866 · Cited by 5
Lewerenz, S., Chronaki, C. E., do Carmo, A. O., & Martins, H. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106184 · Cited by 5
Harris, A. B., Benes, G. A., Ghanem, D., Cartagena-Reyes, M. A., Jain, A., & LaPorte, D. M. (2023) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.23.00358 · Cited by 6
Llewellyn, N. M., Nehl, E. J., Dave, G., DiazGranados, D., Flynn, D., Fournier, D. M., Hoyo, V., Pelfrey, C. M., & Casey, S. L. (2023) · Clinical and Translational Science · doi:10.1111/cts.13700 · Cited by 6
“43 To illustrate a sample of highly influential research, we list portfolio articles with the 10 highest RCR scores (Table 2).”
BackgroundInfluentialWoolley, T., Stubbs, J. R., Sprague, E., Suiter, A. M., Sarli, C. C., Strandenes, G., & Spinella, P. C. (2022) · Transfusion · doi:10.1111/trf.16956 · Cited by 5
“The RCR represents a citation-based measure of the scientific influence of one or more articles and is calculated as the cites/year of each paper, normalized to the citations per year received by papers funded by the NIH in the same field and year.(9) The process(9) ensures that a paper with an RCR of 1.”
MethodThe relative citation ratio (RCR) as a novel bibliometric among 2511 academic orthopedic surgeons
Gupta, A., Meeter, A. M., Norin, J., Ippolito, J. A., & Beebe, K. S. (2022) · Journal of Orthopaedic Research® · doi:10.1002/jor.25490 · Cited by 6
“In 2015, the National Institutes of Health (NIH) created a new article‐level metric called the relative citation ratio (RCR) that was designed to overcome these issues with the h‐index.(13) The RCR is defined as the total number of citations per year earned by a publication divided by the average citations per year re…”
BackgroundMcCoy, E. E., Katz, R., Louden, D. N., Oshima, E., Murtha, A. P., Gyamfi‐Bannerman, C., Santoro, N. F., Howell, E. A., Halvorson, L. M., Reed, S. D., et al. (2023) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2023.06.050 · Cited by 5
Guan, L. S., Henderson, M. N., Singh, H., Guyer, O., & Massaro‐Giordano, M. (2024) · Cornea · doi:10.1097/ico.0000000000003512 · Cited by 5
“12 This quanti fi es an article ’ s impact relative to others in its fi eld and standardizes it to an NIH RCR value of 1.”
Spiroski, M. Z. (2016) · Open Access Macedonian Journal of Medical Sciences · doi:10.3889/oamjms.2016.069 · Cited by 5
Heuristics, not plumage: A response to Osterloh and Frey's discussion paper on ‘Borrowed plumes’
Wooding, S. (2019) · Research Policy · doi:10.1016/j.respol.2019.103871 · Cited by 5
Noguchi, Y., Kaneko, M., & Narukawa, M. (2020) · Therapeutic Innovation & Regulatory Science · doi:10.1007/s43441-020-00177-5 · Cited by 5
Sharma, K., Moyer, J., Liggins, C., Garcı́a-Cazarı́n, M. L., Mandal, R. J., Wanke, K. L., & Meissner, H. I. (2023) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntad024 · Cited by 5
Mohandoss, A. A., & Thavarajah, R. (2016) · Indian Journal of Psychological Medicine · doi:10.4103/0253-7176.185945 · Cited by 5
“[11] As with any citation‐based metrics, fundamentally RCR can never estimate the fullest, nonmeasurable impact such as clinical translational or newer dimension or a paradigm shift or importance of making progress in solving the problem being addressed.[9] Additionally, values such as RCR are dynamic and highly susce…”
BackgroundMethodInfluentialDilday, J. C., Wu, J., Williams, E. C., Grigorian, A., Emigh, B. J., Matsushima, K., Schellenberg, M. A., Inaba, K., & Martin, M. J. (2024) · Trauma Surgery & Acute Care Open · doi:10.1136/tsaco-2023-001291 · Cited by 4
Auditing citation polarization during the early COVID-19 pandemic
You, T., Lee, J. Y., Park, J., & Yun, J. (2024) · Quantitative Science Studies · doi:10.1162/qss_a_00326 · Cited by 5
“The design of the indicator is similar to the MNCS, yet the expected value is calculated based on co-cited papers (Hutchins et al., 2016).”
Methode-Health Interventions for Promoting Physical Activity in Aging Adults: A Scoping Review
Walha, R., Koubaa, N., Chagnon, M., Lortie-Milner, É., Aubertin‐Leheudre, M., Levasseur, M., & Boissy, P. (2025) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2024.0414 · Cited by 5
Forecasting novel therapeutic development in biomedical research
Arabi, S., & Hutchins, B. I. (2026) · Communications Medicine · doi:10.1038/s43856-026-01838-6 · Cited by 5
Self-citationHenderson, M. N., Singh, H., Guan, L. S., Li, A., & Prenner, J. L. (2024) · Ophthalmology Glaucoma · doi:10.1016/j.ogla.2024.06.004 · Cited by 4
Bibliometrics for Social Validation
Hicks, D. (2016) · PLoS ONE · doi:10.1371/journal.pone.0168597 · Cited by 4
Alshareef, A. M., Alhamid, M. F., & Saddik, A. E. (2018) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-018-0687-4 · Cited by 4
SequencEnG: an interactive knowledge base of sequencing techniques
Zhang, Y., Manjunath, M., Kim, Y., Heintz, J., & Song, J. S. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty794 · Cited by 8
“…based on benchmarking papers; 2) application in large projects such as ENCODE (ENCODE Project Consortium, 2012); 3) ranking based on Relative Citation Ratio (RCR, Hutchins et al. , 2016) score queried from iCite (https://icite.od.nih.gov/) to reflect the importance and popularity of the tool.”
MethodA bibliometric analysis of multimorbidity from 2005 to 2019
Ahmed, M. A. A., Almirall, J., Ngangue, P., Poitras, M.-È., & Fortin, M. (2020) · Journal of Comorbidity · doi:10.1177/2235042x20965283 · Cited by 7
“Regarding the Relative Citation Ratio (RCR), it is a new and attractive way to indicate whether an article is cited more or less frequently compared to publications in the same field.(7) In this study, we analyzed the correlation between the RCR and the total number of citations.”
BackgroundMethodInfluentialTucker, J. D., Hughes, M. A., Durvasula, R. V., Vinetz, J. M., McGovern, V. P., Schultz, R., Dunavan, C. P., Wilson, M. E., Milner, D. A., LaRocque, R. C., et al. (2017) · Clinical Infectious Diseases · doi:10.1093/cid/cix242 · Cited by 4
Gao, Y., Stanley, D. V., Robinson, V. C., Reid, D., & Galis, Z. S. (2017) · Circulation Research · doi:10.1161/circresaha.117.310735 · Cited by 4
Yu, H., Willis, K. A., Litovitz, A. E., Harriman, R. M., Davis, M. T., Meyer, P., Busse, B. L., Meseroll, R. A., Wijayatilake, H. D., Perkins, M. J., et al. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.02.02.429450 · Cited by 5
Self-citationAfrican Neuroscience on the Global Stage: Nigeria as a ModelPreprint
Maina, M. B., Mohammed, Y. G., Bukar, A. M., Ahmad, U., Salihu, A. T., Arrashid, I. H., Abdurrazak, M., Kwairanga, H. S., Yaro, A. U., Awadelkareem, M. A., et al. (2018) · AfricArXiv (OSF Preprints) · doi:10.31730/osf.io/ahv2t · Cited by 4
AI4Research: a survey of artificial intelligence for scientific research
Chen, Q., Yang, M., Qin, L., Liu, J., Yan, Z., Guan, J., Peng, D., Ji, Y., Li, H., Hu, M., et al. (2026) · Science China Information Sciences · doi:10.1007/s11432-025-5000-y · Cited by 4
Leite, J. H., Setti, D., & de Resende, L. M. M. (2025) · Scientometrics · doi:10.1007/s11192-025-05485-x · Cited by 6
Carlson, B. H., Laffaye, T. A., Gray, L., Bathini, A. R., Dubey, A., & Patra, D. P. (2025) · Journal of Clinical Neuroscience · doi:10.1016/j.jocn.2025.111819 · Cited by 4
Friederichs, H. (2026) · Medical Education Online · doi:10.1080/10872981.2026.2652722 · Cited by 3
“The Relative Citation Ratio (RCR) is a field-and time-normalised citation measure: For each publication, the observed citation rate is benchmarked against an expected rate of articles of the same publication year within its co-citation network [18].”
Scientific Publications and the Embedding Space of Knowledge
Marinosyan, A. K., & Grigoriev, S. G. (2026) · Russian Digital Libraries Journal · doi:10.26907/1562-5419-2026-29-2-565-594 · Cited by 3
Dark citations to Federal resources and their contribution to the public health literature
Keralis, J. M., Albertorio‐Diaz, J. R., & Hoppe, T. A. (2023) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2023.1235208 · Cited by 3
Benes, G. A., ElNemer, W. G., Avendano, J. P., Hsu, N. N., & Aiyer, A. A. (2024) · JAAOS Global Research and Reviews · doi:10.5435/jaaosglobal-d-23-00280 · Cited by 3
Bibliometric Insights into Research Hotspots and Trends in Obesity and Asthma from 2013 to 2023
Cao, P., Li, J., Wang, G., Sun, X., Zhi, L., Zhu, S., & Zhu, L. (2024) · Obesity Facts · doi:10.1159/000541474 · Cited by 4
“Citation rate serves as a crucial metric to gauge the academic impact of a paper, effectively representing the degree to which a country ’ s scienti fi c research outcomes are accepted and acknowledged by other institutions or nations [53].”
Ishaq, S., Hameed, A., Liaqat, A., Asghar, H., Kanwal, L., Qadar, L. T., Naeem, N., Zahoor, S. M., & Ahmed, T. (2025) · Neuroscience · doi:10.1016/j.neuroscience.2025.03.003 · Cited by 3
Two New Factors for the Evaluation of Scientific Performance: U and U’
Uzbay, T. I. (2019) · Turkish Journal of Pharmaceutical Sciences · doi:10.4274/tjps.35683 · Cited by 3
National Institutes of Health Research Plan on Rehabilitation: Analysis and Progress
Jackson, J. N., & Cernich, A. N. (2020) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2020.04.005 · Cited by 3
Lau, C. B., Machavariani, L., Zhou, G., & Smith, G. P. (2022) · Archives of Dermatological Research · doi:10.1007/s00403-022-02485-2 · Cited by 3
“The RCR utilizes an article’s co-citation network to normalize its impact to its particular field of study [5].”
MethodAlqahtani, M. S., Abbas, M. A. E., Muqeet, M. A., & Almohiy, H. (2022) · Sustainability · doi:10.3390/su142316079 · Cited by 3
Factors Associated With Altmetric Attention Scores for Randomized Phase III Cancer Clinical Trials
Rooney, M. K., Sharifi, B., Ludmir, E. B., Fuller, C. D., & Warner, J. L. (2023) · JCO Clinical Cancer Informatics · doi:10.1200/cci.23.00082 · Cited by 4
IMPC impact on preclinical mouse models
Hölter, S. M., Cacheiro, P., Smedley, D. P., & Lloyd, K. C. K. (2025) · Mammalian Genome · doi:10.1007/s00335-025-10104-4 · Cited by 3
“1, according to NIH iCite, a digital tracking tool for citations (Hutchins et al. 2019a, b ), influence (Hutchins et al. 2016, 2017) and the prediction of translational progress (Hutchins et al. 2019a, b), the exact number of 7468 IMPC-related publications from 2005 to 2024 have resulted in a total…”
Asfaw, Z. K., Young, T., Brown, C. S., Dedhia, M., Huo, L., Sindhu, K. K., Lazarev, S., Samstein, R. M., Green, S., & Germano, I. M. (2025) · Cancer Medicine · doi:10.1002/cam4.70673 · Cited by 3
Ferrand, É., Larivière, V., Lebel, D., & Bussières, J. (2018) · Annales Pharmaceutiques Françaises · doi:10.1016/j.pharma.2018.09.001 · Cited by 5
Metadata
- Authors
- Hutchins, B. I., Yuan, X., Anderson, J. M., & Santangelo, G. M.
- Affiliations
- National Institutes of Health (US)
- Corresponding author
- Hutchins, B. Ian
- Yuan, Xin
- Anderson, James M.
- Santangelo, George M.
- Venue
- PLoS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-09-06
- Volume
- 14
- Issue
- 9
- Pages
- e1002541
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC5012559
- OpenAlex
- W2953304564
- Cited by
- 500
- References
- 91
- Citations by year
- 2026: 43 · 2025: 51 · 2024: 52 · 2023: 62 · 2022: 68 · 2021: 48 · 2020: 44 · 2019: 45 · 2018: 36 · 2017: 32 · 2016: 17
- FWCI
- 40.48
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- public-domain
- creativecommons.org/publicdomain/zero/1.0/ (vor)
- Locations
- PLoS Biology (publishedVersion, public-domain)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, public-domain)
- PubMed Central (publishedVersion, public-domain)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (publishedVersion)
- Figshare (submittedVersion, cc-by)
- Funders
- Conselho Nacional de Desenvolvimento Científico e Tecnológico (573871/2008-6)
- Fundação de Amparo à Pesquisa do Estado de Minas Gerais (573871/2008-6)
- National Institutes of Health (Z99 OD999999)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- relative citation ratio, citation analysis, co-citation networks, field normalization, iCite
- MeSH terms
- Authorship, Humans, National Institutes of Health (U.S.), United States, Bibliometrics, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.