The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Citation counts for research evaluation: standards of good practice for analyzing bibliometric data and presenting and interpreting results
Open accessAbstract
With the ready accessibility of bibliometric data and the availability of ready-to-use tools for generating bibliometric indicators for evaluation purposes, there is the danger of inappropriate use.Here we present standards of good practice for analyzing bibliometric data and presenting and interpreting the results.Comparisons drawn between research groups as to research performance are valid only if (1) the scientific impact of the research groups or their publications are looked at by using box plots, Lorenz curves, and Gini coefficients to represent distribution characteristics of data (in other words, going beyond the usual arithmetic mean value), ( 2) different reference standards are used to assess the impact of research groups, and the appropriateness of the reference standards undergoes critical examination, and (3) statistical analyses comparing citation counts take into consideration that citations are a function of many influencing factors besides scientific quality.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Garfield, E. (1972) · Science · doi:10.1126/science.178.4060.471 · Cited by 2,788 · cited 1×
“…Eugene Garfield, the founder of the Institute of Scientific Information (ISI, now Thomson Scientific) already pointed out in the early 1970s that citation 2 Bornmann et al.: Citation counts for research evaluation counts are a function of many variables besides scientific quality (Garfield 1972).”
BackgroundWhat do citation counts measure? A review of studies on citing behavior
Bornmann, L., & Daniel, H. (2008) · Journal of Documentation · doi:10.1108/00220410810844150 · Cited by 1,607 · cited 2×
“They also reflect (social) factors that are unrelated to the accepted conventions of scholarly publishing (Bornmann & Daniel 2008).”
BackgroundSelf-citationMacRoberts, M. H., & MacRoberts, B. R. (1996) · Scientometrics · doi:10.1007/bf02129604 · Cited by 503
The use of bibliometric data for the measurement of university research performance
Moed, H. F., Burger, W. J. M., Frankfort, J. G., & Van Raan, A. F. J. (1985) · Research Policy · doi:10.1016/0048-7333(85)90012-5 · Cited by 472
Baldi, S. (1998) · American Sociological Review · doi:10.2307/2657504 · Cited by 335
A review of bibliometric and other science indicators and their role in research evaluation
King, J. (1987) · Journal of Information Science · doi:10.1177/016555158701300501 · Cited by 334
Some bibliometric correlates of quality in scientific research
Lawani, S. M. (1986) · Scientometrics · doi:10.1007/bf02016604 · Cited by 222
Hargens, L. L. (2000) · American Sociological Review · doi:10.2307/2657516 · Cited by 211
Does collaborative research have greater epistemic authority?
Beaver, D. D. (2004) · Scientometrics · doi:10.1023/b:scie.0000034382.85360.cd · Cited by 174
A quasi-quantitative citation model
Vinkler, P. (1987) · Scientometrics · doi:10.1007/bf02016689 · Cited by 132
Cited by
A review of the literature on citation impact indicators
Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.007 · Cited by 1,356
Bornmann, L. (2011) · Annual Review of Information Science and Technology · doi:10.1002/aris.2011.1440450112 · Cited by 567
Self-citationWang, Q., & Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.003 · Cited by 417
Müller, A. M., Maher, C. A., Vandelanotte, C., Hingle, M., Middelweerd, A., Lopez, M. L., DeSmet, A., Short, C. E., Nathan, N., Hutchesson, M. J., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.8954 · Cited by 180
Zhang, G., Ding, Y., & Milojević, S. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22850 · Cited by 169
Mas-Tur, A., Roig-Tierno, N., Sarin, S., Haon, C., Sego, T., Belkhouja, M., Porter, A., & Merigó, J. M. (2021) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2020.120487 · Cited by 147
Bornmann, L., & Marx, W. (2015) · Journal of Informetrics · doi:10.1016/j.joi.2015.01.006 · Cited by 138
Self-citationThe Mismeasure of Science: Citation Analysis
MacRoberts, M. H., & MacRoberts, B. R. (2018) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23970 · Cited by 101
García‐Pérez, M. A. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21372 · Cited by 101
Leydesdorff, L., & Shin, J. C. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21511 · Cited by 86
An Ethical Exploration of Increased Average Number of Authors Per Publication
Hosseini, M., Lewis, J., Zwart, H., & Gordijn, B. (2022) · Science and Engineering Ethics · doi:10.1007/s11948-021-00352-3 · Cited by 50
Bornmann, L. (2018) · Scientometrics · doi:10.1007/s11192-018-2855-y · Cited by 40
Self-citation
Metadata
- Authors
- Bornmann, L., Mutz, R., Neuhaus, C., & Daniel, H.
- Venue
- Ethics in Science and Environmental Politics
- Publisher
- Inter-Research Science Center
- Published
- 2008-06-03
- Volume
- 8
- Pages
- 93-102
- ISSN
- 1611-8014 (ISSN-L)
- 1863-5415
- OpenAlex
- W2033079808
- Cited by
- 359
- References
- 16
- FWCI
- 13.06
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
