Some Results on the Function and Quality of Citations
Abstract
Citations of scientific articles have been used in recent years as measures of scientific accomplishments of an individual, a group, an institution, or a country, as well as for following the temporal evolution of science in general, or a certain field of science in particular.' The use of citations for this purpose has evoked a certain amount of criticism from some who have felt that, for a variety of reasons, such measures give an ambiguous or even misleading picture of scientific developments.2 Most of these critiques, however, have lacked the
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Most prior efforts provide citation categories that are too fine-grained, some of which rarely occur in papers.
“Most of these efforts provide citation categories that are too fine-grained, some of which rarely occur in papers.”
From Structural Scaffolds for Citation Intent Classification in Scientific Publications (2019) · cites this paper as Moravcsik and Murugesan, 1975
Moravcsik and Murugesan (1975) found that the majority of citations could be assigned to the categories valuable (69 percent), organic (60 percent), and evolutionary (59 percent).
“The results in Table I show that the majority of the citations could be assigned to the categories valuable (69 percent), organic (60 percent), and evolutionary (59 percent).”
From What do citation counts measure? A review of studies on citing behavior (2008) · cites this paper as Moravcsik and Murugesan (1975)
The high number of redundant references (31 percent) was seen to cast doubt on the assumptions of the normative theory and thus the use of citations as an indicator for research impact.
“In addition, the high number of redundant references (31 percent) was seen to cast doubt on the assumptions of the normative theory and thus the use of citations as an indicator for research impact.”
From What do citation counts measure? A review of studies on citing behavior (2008) · cites this paper as Moravcsik and Murugesan (1975)
Only about 14 percent of the citations cited publications that the authors of the articles refer to as wrong or disputed papers.
“Only about 14 percent of the citations cited publications that the authors of the articles refer to as wrong or disputed papers.”
From What do citation counts measure? A review of studies on citing behavior (2008) · cites this paper as Moravcsik and Murugesan (1975)
Moravcsik and Murugesan (1975) concluded that the large fraction (41 percent) of perfunctory references raised serious doubts about the use of citations as a quality measure.
“But they also concluded that the large fraction (41 percent) of perfunctory references raised serious doubts 'about the use of citations as a quality measure, since it is then quite possible for somebody or some group to chalk up high citation counts by simply writing barely publishable papers on fashionable subjects which will then be cited as perfunctory, 'also ran' references'”
From What do citation counts measure? A review of studies on citing behavior (2008) · cites this paper as Moravcsik and Murugesan (1975)
Cited by
Sorted by citations
From translations to problematic networks: An introduction to co-word analysis
Callon, M., Courtial, J.-P., Turner, W. A., & Bauin, S. (1983) · Social Science Information · doi:10.1177/053901883022002003 · Cited by 1,951 · see citing works
What do citation counts measure? A review of studies on citing behavior
Bornmann, L., & Daniel, H. (2008) · Journal of Documentation · doi:10.1108/00220410810844150 · Cited by 1,607 · see citing works
Leydesdorff, L. (1998) · Scientometrics · doi:10.1007/bf02458391 · Cited by 347 · see citing works
Baldi, S. (1998) · American Sociological Review · doi:10.2307/2657504 · Cited by 335 · see citing works
Association of Journal Quality Indicators With Methodological Quality of Clinical Research Articles
Lee, K. P. (2002) · JAMA · doi:10.1001/jama.287.21.2805 · Cited by 284 · see citing works
Private acts and public objects: An investigation of citer motivations
Brooks, T. A. (1985) · Journal of the American Society for Information Science · doi:10.1002/asi.4630360402 · Cited by 256 · see citing works
An interview-based study of the functions of citations in academic writing across two disciplines
Harwood, N. (2009) · Journal of Pragmatics · doi:10.1016/j.pragma.2008.06.001 · Cited by 255 · see citing works
Tahamtan, I., & Bornmann, L. (2019) · Scientometrics · doi:10.1007/s11192-019-03243-4 · Cited by 236 · see citing works
Measuring the Evolution of a Scientific Field through Citation Frames
Jurgens, D., Kumar, S., Hoover, R., McFarland, D., & Jurafsky, D. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00028 · Cited by 212 · see citing works
Structural Scaffolds for Citation Intent Classification in Scientific Publications
Cohan, A., Ammar, W., van Zuylen, M., & Cady, F. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1361 · Cited by 214 · see citing works
On the shoulders of Robert Merton: Towards a normative theory of citation
Small, H. (2004) · Scientometrics · doi:10.1023/b:scie.0000027310.68393.bc · Cited by 183 · see citing works
Zhang, G., Ding, Y., & Milojević, S. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22850 · Cited by 169 · see citing works
Core Elements in the Process of Citing Publications: Conceptual Overview of the Literature
Tahamtan, I., & Bornmann, L. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.01.002 · Cited by 149 · see citing works
A quasi-quantitative citation model
Vinkler, P. (1987) · Scientometrics · doi:10.1007/bf02016689 · Cited by 132 · see citing works
A classification of citation roles for the social sciences and related fields
Peritz, B. C. (1983) · Scientometrics · doi:10.1007/bf02147226 · Cited by 105 · see citing works
Unraveling scientific impact: Citation types in marketing journals
Stremersch, S., Camacho, N., Vanneste, S., & Verniers, I. (2015) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2014.09.004 · Cited by 102 · see citing works
Towards an Automated Citation Classifier
Garzone, M., & Mercer, R. E. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45486-1_28 · Cited by 101 · see citing works
The invariant distribution of references in scientific articles
Bertin, M., Atanassova, I., Gingras, Y., & Larivière, V. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23367 · Cited by 91 · see citing works
Characteristics of a literature as predictors of relatedness between cited and citing works
Bonzi, S. (1982) · Journal of the American Society for Information Science · doi:10.1002/asi.4630330404 · Cited by 79 · see citing works
The persistence of error: a study of retracted articles on the Internet and in personal libraries
Davis, P. M. (2012) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.100.3.008 · Cited by 74 · see citing works
Predicting the impact of scientific concepts using full-text features
McKeown, K., Daume, H., Chaturvedi, S., Paparrizos, J., Thadani, K., Barrio, P., Biran, O., Bothe, S., Collins, M., Fleischmann, K. R., et al. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23612 · Cited by 73 · see citing works
Norms and functions in citation: The view of journal editors and referees in psychology
Cronin, B. (1982) · Social Science Information Studies · doi:10.1016/0143-6236(82)90001-1 · Cited by 54 · see citing works
Bordignon, F. (2020) · Scientometrics · doi:10.1007/s11192-020-03536-z · Cited by 51 · see citing works
The linguistic patterns and rhetorical structure of citation context: An approach using n-grams
Bertin, M., Atanassova, I., Sugimoto, C. R., & Lariviere, V. (2016) · Scientometrics · doi:10.1007/s11192-016-2134-8 · Cited by 50 · see citing works
Discovering discoveries: Identifying biomedical discoveries using citation contexts
Small, H., Tseng, H., & Patek, M. (2017) · Journal of Informetrics · doi:10.1016/j.joi.2016.11.001 · Cited by 47 · see citing works
Research on research evaluation
Hemlin, S. (1996) · Social Epistemology · doi:10.1080/02691729608578815 · Cited by 48 · see citing works
A meta-analysis of semantic classification of citations
Kunnath, S. N., Herrmannova, D., Pride, D., & Knoth, P. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00159 · Cited by 43 · see citing works
Quotation errors in general science journals
Smith, N., & Cumberledge, A. (2020) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2020.0538 · Cited by 32 · see citing works
Towards employing native information in citation function classification
Zhang, Y., Zhao, R., Wang, Y., Chen, H., Mahmood, A., Zaib, M., Zhang, W. E., & Sheng, Q. Z. (2022) · Scientometrics · doi:10.1007/s11192-021-04242-0 · Cited by 28 · see citing works
Higher education as a maturing field? Evidence from referencing practices
Silverman, R. J. (1985) · Research in Higher Education · doi:10.1007/bf00976825 · Cited by 27 · see citing works
CitePrompt: Using Prompts to Identify Citation Intent in Scientific Papers
Lahiri, A., Sanyal, D. K., & Mukherjee, I. (2023) · 2023 ACM/IEEE Joint Conference on Digital Libraries (JCDL) · doi:10.1109/jcdl57899.2023.00017 · Cited by 24 · see citing works
Quotation Errors in High-Impact-Factor Orthopaedic and Sports Medicine Journals
Gazendam, A., Cohen, D., Morgan, S., Ekhtiari, S., & Ghert, M. (2021) · JBJS Open Access · doi:10.2106/jbjs.oa.21.00019 · Cited by 13 · see citing works
- Authors
- Moravcsik, M. J., & Murugesan, P.
- Affiliations
- University of Oregon (US)
- Venue
- Social Studies of Science
- Publisher
- SAGE Publications
- Published
- 1975-02
- Volume
- 5
- Issue
- 1
- Pages
- 86-92
- ISSN
- 0036-8539 (ISSN-L)
- 0306-3127
- 1460-3659
- OpenAlex
- W2150569271
- Cited by
- 693
- References
- 0
- Citations by year
- 2026: 20 · 2025: 15 · 2024: 13 · 2023: 25 · 2022: 25 · 2021: 41 · 2020: 36 · 2019: 27 · 2018: 27 · 2017: 23 · 2016: 34 · 2015: 30 · 2014: 35 · 2013: 35 · 2012: 20
- FWCI
- 24.82
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Social Studies of Science (publishedVersion)
- Funders
- University of Oregon
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Keywords
- citation analysis, scientific citations, bibliometric analysis, science assessment, research evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review