Review Articles: The Black-Market of Scientific Currency
The DOI matches its Crossref record.
Abstract
Citations are the scientific currency that quantifies the success of an individual or journal. Impact factor, H-factor, and other derivatives of citation number determine an author’s prestige in addition to a possible monetary value when journal articles are examined for job promotion, recognition awards, and grants. Similarly, journals that are more highly cited are viewed as more competitive and to have a broader readership. The correlation states, the more highly cited a paper or journal, the greater the importance and advancement of the research field. However, these assumptions are flawed because review papers are more commonly cited than original manuscripts in all fields of research. The problem arises after publication of data, when a subsequent author, one possibly not involved in similar research, summarizes the findings in a review paper. Intuitively, authors know citing original work is preferred to referencing a review because the credit will be given to the author who planned, conducted, and published the research. However, authors continue to cite the review which then credits a different author and diminishes the value of the original work. Authors appear to not take the time to locate the original research cited within the review; rather it is easier to cite the summary of hundreds of papers presented in a logical and easily digestible format. This phenomenon is peculiar because original articles are easier to find than in the past because of computerized searches, PDFs, and online journals. Similarly, the journal where the original research was published also loses credit to another journal that publishes review papers. Journals that publish reviews have higher citation rates. Although this problem is commonly known, few authors, reviewers, and editors prevent citation misuse, as authors continue to cite review papers and journals that publish reviews disproportionately. The responsibility to properly cite references falls upon the author. If a review paper succinctly summarizes an idea, the review can be cited but it should be indicated as such, for example (reviewed by author, date). Alternatively if a new perspective not expressed in original research is presented and supported by the reviewed papers, than the review may be cited. In all other cases, the original manuscript must be cited when discussing a specific paper or idea found within a review article. If authors are not acting responsibly with citations, then manuscript reviewers must be aware of over citation of reviews and request the original research be cited. Editors have the responsibility of policing their journals to ensure the proper journal receives due credit. This is, however, much harder and therefore ultimately the responsibility is on the authors and reviewers. Review papers are necessary to summarize previously published data in a novel way or offer a new perspective; however, they are being cited at a frequency that indicates they revolutionized the field. To this end, review papers are not advancing the frontier of science and should not be cited as such. A paper’s importance is judged by the number of citations; therefore, more care is needed to ensure the proper individuals and journals receive the credit they earned.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Other challenges for meta-analysis and systematic reviews include publication bias, i.e. the underreporting of non-significant results or disconfirming evidence 61,62 , and research bias 56 , where populations, species, or systems are over- or under-represented in the literature, giving a biased view of the totality.”
From Meta-analysis and the science of research synthesis (2018) · cites this paper as [61]
Citations
Cited by
Meta-analysis and the science of research synthesis
Gurevitch, J., Koricheva, J., Nakagawa, S., & Stewart, G. (2018) · Nature · doi:10.1038/nature25753 · Cited by 1,709
“For instance, review articles have been recently decried “the black-market of scientific currency” with calls to replace citations to reviews and meta-analyses by citations of primary studies 73 .”
DOES SIZE MATTER? A CRITICAL REVIEW OF META-ANALYSIS IN AGRONOMY
Krupnik, T. J., Andersson, J., Rusinamhodzi, L., Corbeels, M., Shennan, C., & Gerard, B. G. (2019) · Experimental Agriculture · doi:10.1017/s0014479719000012 · Cited by 70
What is meta-analysis good for?
Kovaka, K. (2025) · Philosophical Studies · doi:10.1007/s11098-025-02450-5 · Cited by 2
“…parasitic on primary studies, and that those who do the hard work of collecting primary data will not receive the appropriate amount of credit, since the ultimate conclusions about natural phenomena will come from meta-analyses rather than primary phenomena (see, e.g. Cohnstaedt & Poland, 2017 ).”
Larney, S. (2026) · Drug and Alcohol Review · doi:10.1111/dar.70128 · Cited by 2
“…cited more frequently than primary studies in a given area [9], and this, combined with the use of citation metrics to measure individual researcher achievement and rank scientific journals, may incentivise researchers and journal editors to prioritise reviews over primary research [5, 10].”
The ethical and social effects of the obsession over Journal Impact Factor
Onstad, D. W., & Sime, K. R. (2024) · Annals of the Entomological Society of America · doi:10.1093/aesa/saae013 · Cited by 1
Metadata
- Authors
- Cohnstaedt, L. W., & Poland, J.
- Affiliations
- Center for Grain and Animal Health Research (US)
- Kansas State University (US)
- Corresponding author
- Cohnstaedt, Lee W.
- Venue
- Annals of the Entomological Society of America
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-09-08
- Volume
- 110
- Issue
- 1
- Pages
- 90-90
- ISSN
- 0013-8746 (ISSN-L)
- 1938-2901
- OpenAlex
- W2509643115
- Cited by
- 5
- References
- 0
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 1 · 2019: 1 · 2018: 1
- FWCI
- 0.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Annals of the Entomological Society of America (publishedVersion, public-domain)
- HighWire Press Open Archive (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Social Sciences › Education › Academic integrity and plagiarism
- Keywords
- citation practices, citation impact, journal impact factor, h-index, peer review, scholarly publishing, citation ethics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Review Articles: The Black-Market of Scientific Currency. https://app.cochat.ai/papers/10.1093/aesa/saw061
- The paper
- Cohnstaedt, L. W., & Poland, J. (2017). Review Articles: The Black-Market of Scientific Currency. Annals of the Entomological Society of America. https://doi.org/10.1093/aesa/saw061
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.