Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level
Open accessPublished version of a preprint
The DOI matches its Crossref record; 87 of the 91 references it cites were found in a registry or an index; 1 of the 30 sources its claims cite were checked for support.
Abstract
Despite their recognized limitations, bibliometric assessments of scientific productivity have been widely adopted. We describe here an improved method to quantify the influence of a research article by making novel use of its co-citation network to field-normalize the number of citations it has received. Article citation rates are divided by an expected citation rate that is derived from performance of articles in the same field and benchmarked to a peer comparison group. The resulting Relative Citation Ratio is article level and field independent and provides an alternative to the invalid practice of using journal impact factors to identify influential papers. To illustrate one application of our method, we analyzed 88,835 articles published between 2003 and 2010 and found that the National Institutes of Health awardees who authored those papers occupy relatively stable positions of influence across all disciplines. We demonstrate that the values generated by this method strongly correlate with the opinions of subject matter experts in biomedical research and suggest that the same approach should be generally applicable to articles published in all areas of science. A beta version of iCite, our web tool for calculating Relative Citation Ratios of articles listed in PubMed, is available at https://icite.od.nih.gov.
Verification finished with gaps
Some checks didn’t finish. The results below cover the steps that did.
- Registry recordVerified
- Full textRead the full text
- Reference list87 references found
- Reference check87 of 87 references checked
- StatisticsRecomputed
- Claims86 claims anchored to a quote
- Cited sourcesChecked
- Self-checkDidn’t finish — the rest of the report still applies.
- VerificationFindings verified
Overview
CoChat Summary
## TL;DR
The paper introduces Relative Citation Ratio (RCR), an article-level, field-normalized citation metric built from co-citation networks and benchmarked to a peer group. The authors report that RCR correlates strongly with expert judgments, behaves better than several existing bibliometrics in their tests, and is available through the iCite web tool.
## Key findings
- Co-citation networks were used to define an article’s field; in a validation study, diagnostic words were more likely to be shared between an article and papers in its co-citation network than between that article and papers in the same journal, based on 1,397 articles and 249,981 pairwise comparisons within co-citation networks versus 28,516,576 comparisons with same-journal articles.
- In a benchmark set of 35,837 papers published in 2009 by NIH R01 recipients, FCRs based on co-citation networks had lower variance than FCRs based on cited or citing networks, and lower variance than ACRs or JIFs (p < 10−4 for the variance comparisons reported).
- RCR correlated well with subject matter expert ratings across three validation datasets: 2,193 Faculty of 1000-rated articles, 430 STPI-rated articles, and 290 NIH-rated articles.
- In an NIH case study of 88,835 articles from 3,089 continuously funded R01 principal investigators, 53% of investigators in the top RCR quintile stayed there across two 4-year periods, and 53% of those in the bottom quintile stayed at the bottom; among more than 200,000 articles analyzed for FCR stability, only 0.2% had an RCR drop of 0.1 or more between 2012 and 2014, and less than 2% dropped at all.
## Methods
- The metric was built from an article’s co-citation network: papers citing the reference article were used to assemble the set of co-cited papers, whose journal citation rates were averaged to form the field citation rate (FCR); the article’s article citation rate (ACR) was then normalized by FCR and benchmarked to a peer group to yield RCR.
- Citation analyses used the Thomson Reuters Web of Science dataset from 2002–2012 (extended to 2014 for FCR stability analyses), focusing on journals in which NIH R01-funded researchers published; grant and PI data came from NIH RePORTER, SPIRES, and IMPAC-II.
- Validation included cosine-similarity content analysis with IN-SPIRE on 1,397 articles from six journals, expert-comparison analyses, and regression/variance tests; RCR benchmarking used OLS for large-scale analyses and quantile regression as an alternative for smaller, skewed settings.
## Limitations
- The paper states that RCR cannot be calculated immediately after publication; enough citations must accrue first, and the authors note that 93% of co-citation-network-based FCRs stabilize after a paper has been cited five times.
- The authors explicitly say they have not determined whether small differences in RCR, such as 1.0 versus 1.2, reliably reflect meaningful differences in influence.
- The paper also states that citation metrics cannot fully capture article value, are not a substitute for reading the paper, and RCR is not designed as a measure of long-term impact or as a metric for applied research; these are stated limitations of scope.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



![Fig 4 RCRs correspond with expert reviewer scores. (A–C) Bubble plots of reviewer scores versus RCR for three different datasets. Articles are binned by reviewer score; bubble area is proportionate to the number of articles in that bin. (A) F1000 scores for 2,193 R01-funded papers published in 2009. Faculty reviewers rated the articles on a scale of one to three (“good,” “very good,” and “exceptional”, respectively); those scores were summed into a composite F1000 score for each article (S3 Fig). (B) Reviewer scores of 430 HHMI and NIH-funded papers collected by STPI. (C) Scores of 290 R01-funded articles reviewed by experts from the NIH Intramural Research Program. Black line, linear regression. (D) Box-and-whisker plots illustrating the distribution of journal impact factors (JIFs) citations per year (CPY) and RCRs for two areas of NIH-funded research from 2007–2011. Cell biology, n = 5,936; neurological function, n = 5,417. *** p < 0.001, Kruskal-Wallis with Dunn’s multiple comparison test. n.s., not significant. Mean represented by a “+.” (E) Comparison of RCRs (orange) and Thompson Reuters ratios (blue) [17,28] for the same 544 articles with a low denominator. Data points are partially transparent to allow coordinates with multiple papers (darker) to be more clearly identified.](https://figures.cochat.ai/paper-figures/e792b94297fa4418b200b0579a2ea0b9/relative-citation-ratio-rcr-a-new-metric-that-uses-citation-rates-to-measure-figure-4.jpg)


![Fig 7 Properties of RCRs at the article and investigator level. (A, B) Frequency distribution of article-level RCRs (A) and JIFs (B), from 88,835 papers (authored by 3,089 R01-funded principal investigators [PIs]) for which co-citation networks were generated. Article RCRs are well fit by a log-normal distribution (R2 = 0.99), and JIFs less so (R2 = 0.79). (C) Box-and-whisker plots summarizing JIFs for the same papers, binned by impact factor quintile (line, median; box, 25th–75th percentiles; whiskers, 10th–90th percentiles). (D) RCR for the same papers using the same bins by JIF quintile (same scale as C). Although the median RCR for each bin generally corresponds to the impact factor quintile, there is a wide range of article RCRs in each category. (E) Box-and-whisker plots summarizing RCRs of these same papers published in selected journals. In each journal, there are papers with article RCRs surpassing the median RCR of the highest impact factor journals (left three). The impact factor of each journal is shown above. (F, G) Frequency distribution of investigator-level RCRs (F) and JIFs (G), representing the mean values for papers authored by each of 3,089 R01-funded PIs. Dashed line in (F), mode of RCR for PIs.](https://figures.cochat.ai/paper-figures/7111239ea73541aeace7efe3f230790e/relative-citation-ratio-rcr-a-new-metric-that-uses-citation-rates-to-measure-figure-7.jpg)

Verification
Claims the paper makes
1 Valid · 1 Not valid · 18 Not checked · 66 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Strikingly, this analysis showed that diagnostic words are much more likely to be shared between an article and the papers in its co-citation network than between that same article and the papers that appear alongside it in its journal of publication (Fig 2).”
§ Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level > Results > Co-citation Networks Represent an Article’s Area of Influence
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We demonstrate that the values generated by this method strongly correlate with the opinions of subject matter experts in biomedical research”
§ Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level > Abstract
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“though journals with the highest impact factors have the highest median RCR”
§ Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level > Results > Quantifying How Past Influence Predicts Future Performance We next undertook a large case study of all 88,835 articles published by NIH investigators who maintained continuous R01 funding from fiscal year (FY) 2003 through FY2010 to ask how the RCR of publications from individual investigators changed over this 8-y interval. Each of these investigators had succeeded at least once in renewing one or more of their projects through the NIH competitive peer review process. In aggregate, the RCR values for these articles are well matched to a log-normal distribution (Fig 7); in contrast, as noted previously by others, the distribution of impact factors of the journals in which they were published is non-normal (Fig 7A and 7B) [53,54]. Sorting into quintiles based on JIF demonstrates that, though journals with the highest impact factors have the highest median RCR, influential publications can be found in virtually all journals (Fig 7C and 7D); these data call into question the assertion that journal of publication is the strongest quality signal for researchers who are young or otherwise unknown to a field [55]. Focusing on a dozen representative journals with a wide range of JIFs further substantiates the finding that influential science appears in many venues and reveals noteworthy departures from the correlation between JIF and median RCR (see S1 Text). For example, NIH-funded articles in both Organic Letters (JIF = 4.7) and the Journal of the Acoustical Society of America (JIF = 1.6) have a higher median RCR than those in Nucleic Acids Research (JIF = 7.1; Fig 7E). As part of this case study, we also calculated the average RCR and average JIF for papers published by each of the 3,089 NIH R01 principal investigators (PIs) represented in the dataset of 88,835 articles. In aggregate, the average RCR and JIF values for NIH R01 PIs exhibited log-normal distributions (Fig 7F and 7G) with substantially different hierarchical ordering (S8 Fig). This raised a further question concerning PIs with RCR values near the mode of the log-normal distribution (dashed line in Fig 7F): as measured by the ability to publish work that influences their respective fields, to what extent does their performance fluctuate? We addressed this question by dividing the 8-y window (FY2003 through FY2010) in half. Average RCRs in the first time period (FY2003 through FY2006) were sorted into quintiles, and the percentage of PIs in the second time period (FY2007 through FY2010) that remained in the same quintile, or moved to a higher or lower quintile, was calculated (Fig 8). The position of PIs in these quintiles appeared to be relatively immobile; 53% of PIs in the top quintile remained at the top, and 53% of those in the bottom quintile remained at the bottom (Fig 8A). For each PI, we also calculated a weighted RCR (the number of articles multiplied by their average RCR); comparing on this basis yielded almost identical results (Fig 8B). It is worth noting that average FCRs for investigators were extremely stable from one 4-y period to the next (Pearson r = 0.92, Table 2), Since FCRs are the quantitative representation of co-citation networks, this further suggests that each co-citation network is successfully capturing the corresponding investigator’s field of research. Another possible interpretation of the above data is that PI RCRs perform an unbiased random walk from their initial state with a large diffusion rate. Considered from this frame, it could be said that 47% of PIs who started in the top quintile moved out of it during the second 4-y period we analyzed. To test this hypothesis directly, we performed a mean reversion test, which determines whether or not the set of values under consideration will return to an average, or mean, value over time. If drift in PI RCR were simply a random walk, then the change in RCR should by definition be independent of starting RCR, and plotting these two values against each other should result in a straight line with a slope of zero. However, the results show that change in RCR is dependent on starting RCR value (p < 0.001, linear regression analysis, n = 3,089, Fig 8C). Furthermore, randomly shuffling PI RCRs from the second 4-y period gives a slope that is significantly different than that observed for the real data (p < 0.001, extra sum-of-squares F-test, n = 3,089, Fig 8C), ruling out the possibility that these values are randomly sampled from the same distribution in each time interval.
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The RCR metric is ranking invariant when the same number of uncited articles is added to two groups of equal size (Supporting Equations S7–S9 in S1 Text).”
§ Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level > Results > Expert Validation of RCR as a Measure of Influence For the work presented here, we chose as a benchmark the full set of 311,497 RAs published from 2002 through 2012 by NIH R01 awardees. To measure the degree of correspondence between our method and expert opinion, we compared RCRs generated by OLS benchmarking of ACR/FCR values with three independent sets of postpublication evaluations by subject matter experts (details in S1 Text). We compared RCR with expert rankings (Fig 4) for 2,193 articles published in 2009 and evaluated by Faculty of 1000 members (Fig 4A and S3 Fig), as well as rankings of 430 Howard Hughes Medical Institute- or NIH-funded articles published between 2005 and 2011 and evaluated in a study conducted by the Science and Technology Policy Institute (STPI, Fig 4B and S4 Fig), and finally, 290 articles published in 2009 by extramurally funded NIH investigators and evaluated by NIH intramural investigators in a study of our own design (Fig 4C; S5, S6 and S7 Figs). All three approaches demonstrate that RCR values are well correlated with reviewers’ judgments. We asked experts in the latter study to provide, in addition to an overall score, scores for several independent subcriteria: likely impact of the research, importance of the question being addressed, robustness of the study, appropriateness of the methods, and human health relevance. Random Forest analysis [38] indicated that their scores for likely impact were weighted most heavily in determining their overall evaluation (S6 Fig). In addition to correlating with expert opinion, RCR is ranking invariant, which is considered to be a desirable property of bibliometric indicators [39,40]. In short, an indicator is ranking invariant when it is used to place two groups of articles in hierarchical order, and the relative positions in that order do not change when uncited articles are added to each group. The RCR metric is ranking invariant when the same number of uncited articles is added to two groups of equal size (Supporting Equations S7–S9 in S1 Text). RCR is also ranking invariant when the same proportion of uncited articles is added to two groups of unequal size (Supporting Equations S10–S11 in S1 Text). This demonstrates that the RCR method can be used effectively and safely in evaluating the relative influence of large groups of publications.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The average TR ratio for these papers is 1.67, and the average RCR is 0.67.”
§ Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level > Results > Comparison of RCR to Existing Bibliometrics
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
50 more claims
Create a free account to see all 86 claims and to verify the 29 references still open.
- Probably not a substantial claim. 18
- It may state two separate claims as one. 16
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The RCR methodology was validated using citation data from about 90,000 published papers emanating from NIH-funded research and comparing calculated RCRs to the opinions on manuscript reach of recognized experts in selected fields.”
From Structure, function, and productivity from the National Dental Practice-Based Research Network. (2022) · cites this paper as [11]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As one of several methods to quantify publication quality or its impact on the field, the RCR has performed better than journal impact factor, citations per year, or the Thompson–Reuters ratio [11,26,27].”
From Structure, function, and productivity from the National Dental Practice-Based Research Network. (2022) · cites this paper as [11]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The wRCR was considered a measure of influence, with higher values representing the most cited publications 22 .”
From Global mapping of randomized controlled trials in dentistry (2024) · cites this paper as [22]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“the Relative Citation Ratio (RCR) was developed to quantify the influence of a research article that is article level and independent of the scientific field [11].”
From Structure, function, and productivity from the National Dental Practice-Based Research Network. (2022) · cites this paper as [11]
The cited source says what the claim attributes to it.
In the citing paper
“That the median RCR of Network publications exceeded 1.0 and the weighted RCR substantially exceeded the total number of publications upon which the analysis was based, demonstrate that the network’s publications have had a greater-than-average influence in their fields [11].”
From Structure, function, and productivity from the National Dental Practice-Based Research Network. (2022) · cites this paper as [11]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
This check didn’t finish.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
(1999) · Cited by 12,854
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669 · cited 4×
“In recent years, decisionmakers have increasingly turned to numerical approaches such as counting first or corresponding author publications, using the impact factor of the journals in which those publications appear, and computing Hirsch or H-index values (2).”
BackgroundMethodInfluentialCo‐citation in the scientific literature: A new measure of the relationship between two documents
Small, H. (1973) · Journal of the American Society for Information Science · doi:10.1002/asi.4630240406 · Cited by 5,345 · cited 1×
“There are a priori three types of article-linked citation networks [35].”
BackgroundKoenker, R. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511754098 · Cited by 4,551
Bibliometrics: The Leiden Manifesto for Research Metrics
Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015) · Nature · doi:10.1038/520429a · Cited by 2,828 · cited 2×
“These authors [41] also found that RCR is better correlated with expert opinion than citation percentiles, which is the measure bibliometricians have previously recommended as best for evaluating the impact of published work [43].”
BackgroundGarfield, E. (1972) · Science · doi:10.1126/science.178.4060.471 · Cited by 2,788 · cited 4×
“For reasons of algorithmic parsimony we used the JCRs for the year each article in the co-citation network was published; a different choice at this step would be expected to have little if any effect, since almost all JCRs are quite stable over time ( Supporting Figure S1; Supporting Table S1 ).”
MethodInfluentialThe History and Meaning of the Journal Impact Factor
Garfield, E. (2006) · JAMA · doi:10.1001/jama.295.1.90 · Cited by 2,770 · cited 1×
“Journal impact factor (JIF) was for a time seen as a valuable indicator of scientific quality because it serves as a convenient, and not wholly inaccurate, proxy for expert opinion [8].”
BackgroundWhy the impact factor of journals should not be used for evaluating research
Seglen, P. O. (1997) · BMJ · doi:10.1136/bmj.314.7079.497 · Cited by 2,447
Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market
Salganik, M. J., Dodds, P. S., & Watts, D. J. (2006) · Science · doi:10.1126/science.1121066 · Cited by 2,231 · cited 2×
“The results of a landmark study on the relationship between quality and success in a competitive market suggest that the ultimate winners in such contests are determined not only by the intrinsic value of the work but also by more intangible social variables [66].”
Background
Cited by
Items 301–400 of 515
Cortas, N., & Rahal, B. (2019) · Springer eBooks · doi:10.1007/978-3-030-03774-1_15 · Cited by 3
Research-Portfolio Performance Metrics: Rapid Review
Blumenthal, M. S., Taylor, J., Leidy, E., Anderson, B., Carew, D., Bordeaux, J., & Shanley, M. G. (2019) · RAND Corporation eBooks · doi:10.7249/rr2370 · Cited by 3
“A recent tool in this regard, developed and deployed by NIH researchers, is the RCR, which makes use of papers’ co-citation networks (Hutchins et al., 2016).”
BackgroundMethodMaurya, R. K., Datana, S., Verma, S., & Bhandari, S. K. (2020) · Medical Journal Armed Forces India · doi:10.1016/j.mjafi.2020.04.013 · Cited by 3
A Metric for Evaluating a Transformation of Subscription-Based Journals into Open-Access Journals
Mielke, C., Kuballa, S., Schulze, M., & Haux, R. (2020) · Journal of Medical Systems · doi:10.1007/s10916-020-01651-1 · Cited by 3
Identifying Dominant Nodes in Semantic Taxonomies
Razis, G., Anagnostopoulos, I. E., & Zhou, H. G. (2021) · International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP) · doi:10.1109/smap53521.2021.9610779 · Cited by 3
Bibliometric and Scientometric Review of Architectural Flood Resilience for Housing
Peter, A., Majid, R. B. A., & Tukiman, N. I. (2022) · Civil Engineering and Architecture · doi:10.13189/cea.2023.110121 · Cited by 4
Eugene Garfield’s Influences upon the Future of Evaluative Informetrics
Moed, H. F. (2018) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2018.00005 · Cited by 4
The impact of preprint servers in the formation of novel ideas
Satish, S., Yao, Z., Drozdov, A., & Veytsman, B. A. (2020) · Workshop on Scholarly Document Processing (SDP) · doi:10.18653/v1/2020.sdp-1.6 · Cited by 3
An Analysis of Recent FDA Oncology Scientific Publications
Schneider, J. A., Miklos, A. C., Onken, J., Gong, Y. U. T., Calcagno, A. M., Blumenthal, G. M., Aragon, R., & Pazdur, R. (2019) · The Oncologist · doi:10.1634/theoncologist.2019-0503 · Cited by 3
“The relative citation ratio (RCR) quantifies the impact and influence of an article within the context of its research field and against publications resulting from National Institutes of Health (NIH) R01 awards [19].”
BackgroundCarroll, C., & Tattersall, A. (2020) · Value in Health · doi:10.1016/j.jval.2020.01.012 · Cited by 3
de Oliveira, T. C. (2020) · Revista de Pesquisa Cuidado é Fundamental Online · doi:10.9789/2175-5361.rpcfo.v12.9461 · Cited by 3
“2016 [acesso em 30 jun 2019]; 69(6):1074-1081.”
Hip-Hop librarianship for scholarly communication: An approach to introducing topics
Boston, A. (2019) · Journal of New Librarianship · doi:10.31229/osf.io/w5nrj · Cited by 3
Fifty years of the Journal of Perinatal Medicine : an altmetric and bibliometric study
Brandt, J. S., & Skupski, D. W. (2022) · Journal of Perinatal Medicine · doi:10.1515/jpm-2022-0461 · Cited by 3
Guidelines to Analyze Preclinical Studies Using Perinatal Derivatives
Pires, A. S., Bollini, S., Botelho, M. F., Lang, I., Ponsaerts, P., Balbi, C., Lange-Consiglio, A., Fénelon, M., Mojsilović, S. B., Berishvili, E., et al. (2023) · Methods and Protocols · doi:10.3390/mps6030045 · Cited by 3
Prediction of transformative breakthroughs in biomedical researchPreprint
Davis, M. T., Busse, B. L., Arabi, S., Meyer, P., Hoppe, T. A., Meseroll, R. A., Hutchins, B. I., Willis, K. A., & Santangelo, G. M. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2025.12.16.694385 · Cited by 6
“…the sum of hRCRs), which reflects both the number of investigators focusing on the topic and the overall level of interest in the resulting papers ( 31 ), remained below the level of control clusters until a rapid burst that began a few years prior to the appearance of the signal in year 0 (Fig.”
InfluentialSelf-citationOnline scientific research on placentophagy: a bibliometric analysis
de Oliveira, P. E., Nassif, M. S., Costa, A. C. B., Freitas, P. S., Sampaio, R. S., & Costa, I. C. P. (2024) · Revista Brasileira Ginecologia e Obstetrícia · doi:10.61622/rbgo/2024ar04 · Cited by 2
“(10) According to the methodological description, data collection was performed in a single step, on October 17th, 2021.”
Vought, V., Vought, R., Herzog, A. A., Mothy, D., Shukla, J. J., Crane, A. B., & Khouri, A. S. (2024) · Seminars in Ophthalmology · doi:10.1080/08820538.2024.2391838 · Cited by 2
“19,28 Our observation that both mean and weighted RCR trend with h-index further validates its effectiveness as a metric for productivity.”
Accelerating evidence generation: Addressing critical challenges and charting a path forward
Rim, J. G., Jackman, J. G., Hornik, C. P. V., Rutter, J. L., Warraich, H. J., Wittes, J. T., Fleisher, L. A., Anderson, B. S., Krofah, E., Kinter, E. T., et al. (2024) · Journal of Clinical and Translational Science · doi:10.1017/cts.2024.621 · Cited by 2
Fusing structural and temporal information in citation networks for identifying milestone works
Zhou, Y., Gong, F., Wang, Y., Wang, R., & Zeng, A. (2025) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2025.116004 · Cited by 3
Bader, F., Bingham, C. S., David, K. K., Gebrehiwet, H., Lantz, C. L., Peng, G. C. Y., Rangel‐Gomez, M., & Gnadt, J. (2025) · eLife · doi:10.7554/elife.106136.3 · Cited by 2
Mayhew, M. M., Kuchimanchi, N., Lee, J., Olecki, E. J., Sellers, J., Slingluff, C. L., Tsung, A., & Witt, R. G. (2025) · Annals of Surgery · doi:10.1097/sla.0000000000006880 · Cited by 2
Boughanem, D. J., Gorla, S. R., Kendall, M. A., Zander, T. L., Wolansky, R. L., Harry, S. C., Kuo, P. C., & Sujka, J. A. (2025) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2025.116798 · Cited by 2
Haupt, F., Senge, J. F., von Tengg‐Kobligk, H., & Bosbach, W. A. (2026) · PLoS ONE · doi:10.1371/journal.pone.0340697 · Cited by 2
“This conceptual distinction has led to increasing interest in RCR as a complementary or alternative metric to the h-index in promotion and funding contexts [1].”
InfluentialFalcon, D. J., Bustos, V. P., Mahmoud, A., Lin, S. J., & Lee, B. T. (2023) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000010738 · Cited by 2
Patel, P. A., Keane, C. A., Akhter, M. F., Fang, A. H., Soto, E., & Boyd, C. J. (2023) · Annals of Plastic Surgery · doi:10.1097/sap.0000000000003567 · Cited by 2
Gender differences in scholarly productivity of early‐career transfusion medicine physicians
Ipe, T. S., Tanhehco, Y. C., Booth, G. S., & Adkins, B. D. (2024) · Vox Sanguinis · doi:10.1111/vox.13606 · Cited by 2
“Academic impact was assessed using the relative citation ratio (RCR), a metric that takes into account citations for similar contemporary works to normalize impact [16].”
MethodFalcon, D. J., Bustos, V. P., Mahmoud, A., & Lee, B. T. (2024) · Annals of Plastic Surgery · doi:10.1097/sap.0000000000004038 · Cited by 2
Utilizing Relative Citation Ratio to Compare Academic Productivity by Gender in Plastic Surgery
Herzog, I., Park, J. B., Pei, M., Didzbalis, C. J., Reed, L. T., Weisberger, J. S., & Lee, E. S. (2024) · Journal of Surgical Research · doi:10.1016/j.jss.2024.09.005 · Cited by 2
Joly, B. M., Gray, C., Rand, J., Bizier, K., & Pearson, K. B. (2025) · Journal of Clinical and Translational Science · doi:10.1017/cts.2025.10076 · Cited by 2
“…approaches using bibliometric data now exist including the: g -index [24], integrated researcher productivity index [31], relative citation ratio [53], scientific quality index (SQI) [40], scholarly productivity index [44], category normalize citation impact (CNCI) [43], Ab-index [54],…”
Normalised fuzzy index for research ranking
Hedar, A.-R., Abdel-Hakim, A. E., & Alotaibi, Y. A. (2018) · Behaviour and Information Technology · doi:10.1080/0144929x.2018.1482370 · Cited by 3
“Recently, Hutchins et al. (2016) have introduced co-citation networks to quantify the in fl uence of individual research papers via multi-discipline citations-based metric called Relative Citation Ratio (RCR).”
BackgroundHersh, W. (2020) · Health informatics · doi:10.1007/978-3-030-47686-1_2 · Cited by 2
Tecnologia e inovação na pandemia da Covid-19: uma análise bibliométrica
de Macêdo, T. T. S., Palmeira, C. S., & Veras, N. V. R. (2022) · Research Society and Development · doi:10.33448/rsd-v11i14.36647 · Cited by 2
Erath, T. G., Browning, K. O., Evemy, C. G., Feinstein, M. J. P., Wiley, R. C., Klemperer, E. M., DeSarno, M., & Higgins, S. T. (2022) · Preventive Medicine · doi:10.1016/j.ypmed.2022.107335 · Cited by 3
Guareschi, S., Ravasi, M., Baldessari, D., Pozzi, S., Zaffino, T., Melazzini, M. G., & Ambrosini, A. (2023) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2023.1067981 · Cited by 2
“This module is based on the NIH Open Citation Collection, a dataset generated by the NIH Office of Portfolio Analysis from unrestricted data sources such as MedLine, PubMed Central, and CrossRef, with the aim of making the citation statistics publicly available through the NIH iCite analytic platform (Hutchins et al.,…”
MethodResultInfluentialCollaboration and citation impact: Trends in health sciences research at the University of Cape Town
Jäger, H., Chimhundu, C., Harley, Y. X. R., & Douglas, T. S. (2020) · South African Journal of Science · doi:10.17159/sajs.2020/6132 · Cited by 3
Produção científica sobre mulheres com câncer de colo uterino em hemodiálise: estudo bibliométrico
Melo, E. M. L., Frazão, J. D. M., Peixoto, I. V. P., & Valois, R. C. (2021) · Research Society and Development · doi:10.33448/rsd-v10i11.19962 · Cited by 2
Seppänen, J., Värri, H., & Ylönen, I. (2022) · Scientometrics · doi:10.1007/s11192-022-04393-8 · Cited by 2
“Even with partial overlap, Hutchins et al (2016) found that each citer added on average ca. 18 new outputs to the co-citation set in their example in biomedical sciences.”
BackgroundMethodInfluentialOpioids and Chronic Pain: Impact of the NIH Pathways to Prevention Evidence-Based Workshop Program
Klabunde, C. N., Walton, L., Shropshire, K. L., Ganoza, L. F., Hession, J., Schwartz, K., Vogt, E. A., Thomas, D. A., Smith, W. B., Parker, M. C. G., et al. (2023) · Prevention Science · doi:10.1007/s11121-023-01563-9 · Cited by 2
“1 3 using its co-citation network to field-normalize the number of citations it has received (Hutchins et al., 2016).”
MethodTantengco, O. A. G., Vink, J., & Menon, R. (2021) · The Journal of Maternal-Fetal & Neonatal Medicine · doi:10.1080/14767058.2021.1974387 · Cited by 2
“This metric allows us to quantify and compare the influence of articles within a medical field [14].”
BackgroundKlabunde, C. N., Ellis, E. M., Villani, J., Neilson, E., Schwartz, K., Vogt, E. A., & Ngo‐Metzger, Q. (2021) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2021.07.014 · Cited by 2
Pirmez, C., Brandão, A. A., & Momen, H. (2016) · Memórias do Instituto Oswaldo Cruz · doi:10.1590/0074-02760160005 · Cited by 2
“!) of the IF and related metrics has long been debated by the academic community, editors and funding agencies [see, for example, an algorithm proposed by NIH researchers as an alternative to evaluate grant proposals (Hutchins et al. 2016)].”
BackgroundfCite : a fractional citation tool to quantify an individual’s scientific research outputPreprint
Kozlowski, L. P. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/771485 · Cited by 3
“1-4, Supplementary Tables 1-5 ).”
BackgroundMethodConvergence and Inequality in Research GlobalizationPreprint
Mishra, S., & Wang, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.02052 · Cited by 3
“This challenge has led to the development of field-normalized or weighted modifications on citation counts, such as Mean Normalized Citation Score (MNCS), also known as the crown indicator [53], Relative Citation Ratio (RCR) adopted by National Institute of Health in PubMed [30], and the Field Weighted Citation Index…”
MethodHaunschild, R., & Bornmann, L. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4187591 · Cited by 2
The Field-Dependent Nature of PageRank Values in Citation NetworksPreprint
Heil, B. J., & Greene, C. S. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.01.05.522943 · Cited by 2
Comparing the outputs of intramural and extramural grants funded by National Institutes of HealthPreprint
Zheng, X. M., Yang, Q., Potnuri, J., Ni, C., & Hutchins, B. I. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.11.09.566298 · Cited by 2
Self-citationWalsh, A. C., Nienow, S., Merker, J., Decker, E., Strack, C. N., Salem, M. E., Martin, G., & Shaw, B. K. (2024) · doi:10.6028/nist.gcr.25-060 · Cited by 4
Bader, F., Bingham, C. S., David, K. K., Gebrehiwet, H., Lantz, C. L., Peng, G. C. Y., Rangel‐Gomez, M., & Gnadt, J. (2025) · eLife · doi:10.7554/elife.106136 · Cited by 2
“While this makes the RCR normalization dependent on the topic neighborhood selection, the methodology of the topic normalization is described in Hutchins et al., 2016 , and the topic neighborhood for each RCR calculation is available as part of the report.”
The art of sharing: From research to outreach in the social media era
Mohammad, M., Mohamed, A. A., Dahmen, J., Bjerre-Bastos, J. J., & Pihl, A. F. (2025) · Experimental Physiology · doi:10.1113/ep092887 · Cited by 2
“This includes normalizing journal citation rates against field-specific benchmarks to reduce disciplinary bias (Hutchins et al., 2016) and adopting a fractional h-index that allocates citations proportionally among co-authors to mitigate the effects of hyper-authorship and self-citation (Koltun &…”
Comparing the outputs of intramural and extramural grants funded by National Institutes of HealthPreprint
Zheng, X. M., Yang, Q., Potnuri, J., Ni, C., & Hutchins, B. I. (2025) · eLife · doi:10.7554/elife.108929.1 · Cited by 2
Self-citationGlobal mapping of randomized controlled trials in dentistry
Prado, M. C., Dotto, L., Agostini, B., & Sarkis-Onofre, R. (2024) · Brazilian Dental Journal · doi:10.1590/0103-644020246233 · Cited by 1
Huddleston, H. P., Kurtzman, J. S., Rahimzadeh, J., & Koehler, S. M. (2022) · Orthopedics · doi:10.3928/01477447-20220719-09 · Cited by 1
Li, X., Tang, X., & Lu, W. P. (2024) · Journal of Informetrics · doi:10.1016/j.joi.2024.101558 · Cited by 1
Halperin, S. J., Gilson, A., Dhodapkar, M. M., Prenner, M., Tuason, D. A., & Grauer, J. N. (2024) · Journal of the American Academy of Orthopaedic Surgeons · doi:10.5435/jaaos-d-24-00756 · Cited by 2
Henderson, M. N., Guan, L. S., Guyer, O., Hwang, C. J., & Perry, J. D. (2025) · Ophthalmic Plastic and Reconstructive Surgery · doi:10.1097/iop.0000000000002940 · Cited by 1
Hammond, A., & Hay, A. D. (2025) · PLoS ONE · doi:10.1371/journal.pone.0321425 · Cited by 1
“For example, a research paper with an RCR of 4.0 indicates that, on average, the article was four times more likely to be cited than comparable papers within the same field published the same year [6].”
InfluentialAssessing the Research Impact of U.S. Academic Uveitis Specialists Using the Relative Citation Ratio
Franco, J. J., Shapiro, J. N., Saukkonen, D., Azer, D. P., Roth, A. K., & Kodati, S. (2025) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2025.11.029 · Cited by 1
Maximizing the Impact of Your Academic Scholarship: Strategies for Early Career Professionals
Moye, J. A., Brown, R. E., Orkaby, A. R., Schell, B. R., & Schwartz, A. W. (2026) · Academic Psychiatry · doi:10.1007/s40596-026-02313-z · Cited by 1
“…other academics to easily understand your academic contributions • Check author (h-index) [1] and article metrics (relative citation ratio (RCR) [6], Altmetric [8]) periodically to be informed • When possible, enable data analytics (downloads/views) when first posting resources or pre-prints on…”
Ricciardone, M. D., Baker, L., Twesten, J., & Parascandola, M. J. (2024) · Tobacco Prevention & Cessation · doi:10.18332/tpc/184041 · Cited by 1
“…implemented, tobacco control interventions and policies may need to be adapted to LMIC settings in terms of their unique social, cultural, political, economic, and regulatory contexts; tobacco product availability and use patterns; and tobacco industry influence, among other factors 13,14 .”
BackgroundSamir, M., El-Kholany, E. A., Bakr, Y. M., Khattab, E. S. A. E. H., & Ghazy, M. (2024) · Delta University Scientific Journal · doi:10.21608/dusj.2024.255658.1045 · Cited by 1
Transformational Practices; Aligning Governance and Design.
Galdón, F., & Hall, A. (2024) · Proceedings of DRS · doi:10.21606/drs.2024.923 · Cited by 2
From Research to Impact: Assessing a Decade of CDC’s Public Health Science by Topic Area, 2014-2023
Ortega, J., Knuth, M., Dunkley, V. E., Kim, C., Meites, E., Yoo, B. K., Wainwright, K., Zhu, B., & Reynolds, M. G. (2026) · Public Health Reports · doi:10.1177/00333549261451188 · Cited by 2
Shackleford, K. E., & Bowman, N. D. (2025) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197689875.013.0024 · Cited by 1
Does It Matter Where the Funds Go? A Sectoral Analysis of U.S. Government-Interest Patents
Chen, D., Chang, H.-C., Huang, M., Kuan, C., & Wang, C.-C. (2025) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2025.3642877 · Cited by 1
“Building on Hutchins et al. [76], we use citation ratios and citation strength to compare GI and non-GI patents.”
Increasing Utilization and Cost of Open Access Publishing in Plastic Surgery
Zhang, J., Hallman, T. G., Arcelona, C. N., Rodriguez, G. C., Qureshi, U., Nenchev, K., Patel, R., Sriram, N., & Gosain, A. K. (2025) · Annals of Plastic Surgery · doi:10.1097/sap.0000000000004612 · Cited by 1
From mission hospital to medical research hub: the journey of AIC Kijabe Hospital
Kynes, J. M., Nthumba, P. M., Akinyi, B., Otieno, G. O., Shirk, A. M., Adam, M. B., & Osoo, M. O. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1740983 · Cited by 1
Nix, T., Smith, J., & Song, J. Y. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809969-8.00022-x · Cited by 2
Toward a Sustainable Model of Scientific Publishing
Palavalli‐Nettimi, R. (2021) · Journal of Science Policy & Governance · doi:10.38126/jspg180111 · Cited by 1
Public-Health-Forschung in Deutschland: Eine Bestandsaufnahme
Kurth, T. (2017) · Das Gesundheitswesen · doi:10.1055/s-0043-121890 · Cited by 1
Gynecologic oncology top-cited articles: an international analysis
Levin, G., Brezinov, Y., Meyer, R., & Oranim, N. (2023) · Minerva Obstetrics and Gynecology · doi:10.23736/s2724-606x.23.05391-5 · Cited by 1
Choosing Wisely: Applying Value-Based Economic Principles to Population Science Research Investment
Frick, K. D., & Helzlsouer, K. J. (2024) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-23-0883 · Cited by 1
Trends in authorship in the Journal of Cutaneous Pathology, 1981–2020
Malik, F., Tribble, J. T., & Fraga, G. R. (2024) · Journal of Cutaneous Pathology · doi:10.1111/cup.14615 · Cited by 1
Dearolf, C. R., Lee, J. S., Pickett, C. L., Santangelo, G. M., & Schor, N. F. (2024) · Academic Medicine · doi:10.1097/acm.0000000000005738 · Cited by 1
Self-citationImplication of United States abortion policies on quantity and impact of abortion‐related research
Levin, G., Brezinov, Y., Hamilton, K. M., & Meyer, R. (2024) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.17876 · Cited by 1
Unintended consequences of changes to Open Access and the Impact Factor
Gannon, F. (2024) · EMBO Reports · doi:10.1038/s44319-024-00172-z · Cited by 1
Early language learning. A bibliometric analysis of the most influential articles (2010-2022)
León, N. M., Valderrama, P., & Sáez, F. T. (2024) · Porta Linguarum Revista Interuniversitaria de Didáctica de las Lenguas Extranjeras · doi:10.30827/portalin.vi42.29518 · Cited by 1
“This fact makes finding tendencies difficult and new indicators time-nor-malized are needed (Hutchins, 2016; Gasparyan, 2021).”
BackgroundChandrabhatla, A. S., Narahari, A. K., Qiu, K. T., Vasiliadis, T. G., Nguyen, J. D. K., Singh, A., Gray, K., Strobel, R. J., Yount, K. W., Yarboro, L. T., et al. (2024) · Journal of Surgical Research · doi:10.1016/j.jss.2024.08.017 · Cited by 1
Xu, J., Xie, Q., Liu, M., Sembay, Z., Thaker, S., Payne‐Foster, P., Chen, J. Y., & Ding, Y. (2024) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/3677389.3702535 · Cited by 1
“Scientific impact was measured by the Relative Citation Ratio (RCR) [14], which normalizes citation counts based on the field and publication time, benchmarking them against PubMed publications.”
The Dimensions API: a domain specific language for scientometrics research
Kövári, A., Pasin, M., & Meduna, A. (2025) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2025.1514938 · Cited by 1
Laoh, E., Ahmad, O. B., & Liu, T. (2026) · Smart Health · doi:10.1016/j.smhl.2026.100724 · Cited by 1
The Global Benefits of Open Research
Rittman, M. (2018) · MDPI eBooks · doi:10.3390/books978-3-03897-010-1 · Cited by 2
“In addition, OA publishing facilitates the transition to new citation metrics, such as Relative Citation Ratio (RCR) [4] or Citex [5], which quantify the impact of individual articles rather than that of the journal.”
BackgroundNational Institute of Mental Health Recruitment Monitoring Policy and Clinical Trial Impact
Kane, E. I., Daumit, G. L., Fain, K. M., Saloner, B. K., Scherer, R. W., & McGinty, E. E. (2021) · Contemporary Clinical Trials · doi:10.1016/j.cct.2021.106312 · Cited by 1
Kane, E. I., Daumit, G. L., Fain, K. M., Scherer, R. W., & McGinty, E. E. (2021) · Contemporary Clinical Trials · doi:10.1016/j.cct.2021.106328 · Cited by 1
Publication Quality Following Short Summer Cancer Research Internships
Greene, H., Buckman, J. R., Waterbor, J. W., & Padilla, L. A. (2021) · Journal of Cancer Education · doi:10.1007/s13187-021-02005-2 · Cited by 1
“The RCR is a metric from NIH that serves as a citationbased measure of scientific impact [7].”
BackgroundMetrics for Evaluating the Impact of Data Sets
Champieux, R., & Coates, H. (2022) · The MIT Press eBooks · doi:10.7551/mitpress/12200.003.0016 · Cited by 1
Rating the Dominance of Concepts in Semantic Taxonomies
Razis, G., Anagnostopoulos, I. E., & Zhou, H. G. (2022) · Computers · doi:10.3390/computers11030035 · Cited by 1
“A quantification of the impact of research publications is examined in [14] where the “Relative Citation Ratio” is described, while the authors are questioning the performance of the established bibliometric metrics.”
BackgroundScientific Influence of R01 Grants Issued to Department of Surgery Investigators, 2000 to 2015
Kolb, B. L., & Kim, D. (2022) · JAMA Surgery · doi:10.1001/jamasurg.2022.3130 · Cited by 1
Twitter Gynecologic Surgery Journal Club: Impact on Citation Scores and Social Media Attention
Meyer, R., Behbehani, S., Brooks, K., Valero, C. R., Fox, C. R., Layne, A. S., Misal, M., Movilla, P. R., Lauer, J. K., Wong, A. J., et al. (2023) · Journal of Minimally Invasive Gynecology · doi:10.1016/j.jmig.2023.04.002 · Cited by 1
The first six years of meta-research at PLOS Biology
Roberts, R. G., & Editors, O. B. O. T. P. B. S. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001553 · Cited by 2
“We’ve published papers that address the way that the influence of individual papers can be measured [12] and that propose novel ways of distributing research funding [13].”
BackgroundRogers, J. L., Barpujari, A., & Reddy, V. P. (2022) · World Neurosurgery · doi:10.1016/j.wneu.2021.11.132 · Cited by 1
Scientific publishing in the Republic of Macedonia analysed with artificial intelligence
Spiroski, M. Z., & Spiroski, I. (2024) · Journal of Health and Rehabilitation Sciences · doi:10.33700/jhrs.3.1.110 · Cited by 1
Lauer, M. S. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.07.15.664939 · Cited by 1
Comparing the outputs of intramural and extramural grants funded by National Institutes of HealthPreprint
Zheng, X. M., Yang, Q., Potnuri, J., Ni, C., & Hutchins, B. I. (2025) · eLife · doi:10.7554/elife.108929 · Cited by 1
Self-citationPan, Z., & Hutchins, B. I. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.06.26.734852 · Cited by 1
Self-citationEstimating the scale of biomedical data generation using text miningPreprint
Rosenfeld, G. E., & Lin, D. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/182857
The Revolution in Scientific Publishing
Smalheiser, N. R. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-811306-6.00016-6
Government Funded Research and Publishing
Old, S. E., & Thakur, N. M. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809969-8.00023-1
Bibliometrics in Optometry and Vision Science.
Twa, M. (2018) · Optometry and Vision Science · doi:10.1097/opx.0000000000001276
“For example, the National Institutes of Health's Relative Citation Ratio is a metric that uses citations rates and citation networks to measure article-level influence across the boundaries of traditional academic disciplines.(2,3) This metric will allow program administrators to compare the value of scientific output…”
Varga, L., Deritei, D., Ercsey-Ravasz, M., Florian, R. V., Lázár, Z. I., Papp, I., & Járai-Szabó, F. (2018) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1474564
As vascular surgeons, we need to punch above our weight
Schanzer, A. S. (2020) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2019.10.023
Metadata
- Authors
- Hutchins, B. I., Yuan, X., Anderson, J. M., & Santangelo, G. M.
- Affiliations
- National Institutes of Health (US)
- Corresponding author
- Hutchins, B. Ian
- Yuan, Xin
- Anderson, James M.
- Santangelo, George M.
- Venue
- PLoS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-09-06
- Volume
- 14
- Issue
- 9
- Pages
- e1002541
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC5012559
- OpenAlex
- W2953304564
- Cited by
- 500
- References
- 91
- Citations by year
- 2026: 43 · 2025: 51 · 2024: 52 · 2023: 62 · 2022: 68 · 2021: 48 · 2020: 44 · 2019: 45 · 2018: 36 · 2017: 32 · 2016: 17
- FWCI
- 40.48
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- public-domain
- creativecommons.org/publicdomain/zero/1.0/ (vor)
- Locations
- PLoS Biology (publishedVersion, public-domain)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, public-domain)
- PubMed Central (publishedVersion, public-domain)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (publishedVersion)
- Figshare (submittedVersion, cc-by)
- Funders
- Conselho Nacional de Desenvolvimento Científico e Tecnológico (573871/2008-6)
- Fundação de Amparo à Pesquisa do Estado de Minas Gerais (573871/2008-6)
- National Institutes of Health (Z99 OD999999)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- relative citation ratio, citation analysis, co-citation networks, field normalization, iCite
- MeSH terms
- Authorship, Humans, National Institutes of Health (U.S.), United States, Bibliometrics, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.