Academic Evaluation: Universal Instrument? Tool for Development?
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The institution's choice of DB subscription is primarily determined by the metrics applied in national and institutional research assessment policies.
“Usually, the institution's choice of the DB subscription is primarily determined by the metrics that are applied in national and institutional research assessment policies [6].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [6]
Citations may be appropriate for assessing scientific impact of research, but they do not show impact outside the scientific community.
“Citations may be appropriate in assessing the scientific impact of the research, but they do not show the impact of the research outside the scientific community [1,3,5,6,260,264,265].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [6]
Metrics are favored over peer review because they are cheaper and faster to apply.
“The main reasons why metrics are favored over peer-review are: (1) they are cheaper and faster to apply than peer-review;”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [6]
The 'publish or perish' attitude stimulates productivity of researchers but creates a bias towards quantity, often overlooking quality.
“this 'publish or perish' attitude, on the one hand, stimulates the productivity of researchers, but, on the other, creates a bias towards quantity, often overlooking quality [2,3,6-8,44,81,163,260,263,284-288].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [6]
Publication data and citation metrics continue to play the most important role in research assessments worldwide, so indicator-based research assessments remain at the center of global debate about their validity and influence.
“because publication data and citation metrics continue to play the most important role in research assessments worldwide, indicator-based research assessments also remain at the center of the global debate, not only about their validity, but also about their influence on research activities, scientific output, and its quality [1,5-7,44,260,265,289].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [6]
Metrics are favored over peer review because they are regarded as more trustworthy and objective, believed to avoid biases from personal interest and authority relations.
“(2) they are regarded as more trustworthy and objective, because it is believed that the use of indicators may help to avoid biases that are introduced by personal interest and authority relations;”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [6]
Metrics are favored over peer review because they are perceived as more accessible and do not require involvement of scientists or subject specialists.
“(3) they are perceived as more accessible and do not require the involvement of scientists or subject specialists [6].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [6]
Cites
<i>The Structure of Scientific Revolutions</i>
Kuhn, T. S., & Schlegel, R. (1963) · Physics Today · doi:10.1063/1.3050879 · Cited by 35,538 · see citing works
The Structure of Scientific Revolutions.
Böhm, D., & Kühn, T. (1964) · The Philosophical Quarterly · doi:10.2307/2217783 · Cited by 9,193 · see citing works
(1968) · PubMed · Cited by 4,803 · see citing works
The Audit Society: Rituals of Verification
Quam, L. (1998) · BMJ · doi:10.1136/bmj.316.7133.787a · Cited by 3,608 · see citing works
The Audit Society: Rituals of VerificationPreprint
Power, M. (1999) · RePEc: Research Papers in Economics · Cited by 3,597 · see citing works
Bibliometrics: The Leiden Manifesto for Research Metrics
Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015) · Nature · doi:10.1038/520429a · Cited by 2,828 · see citing works
The Normative Structure of Science
Merton, R. Κ. (1973) · Medical Entomology and Zoology · Cited by 1,625 · see citing works
The Matthew Effect in Science, II: Cumulative Advantage and the Symbolism of Intellectual Property
Merton, R. K. (1988) · Isis · doi:10.1086/354848 · Cited by 1,397 · see citing works
Handbook of Quantitative Science and Technology Research
Moed, H. F., Glänzel, W., & Schmoch, U. (2005) · Springer eBooks · doi:10.1007/1-4020-2755-9 · Cited by 1,385 · see citing works
The Intellectual and Social Organization of the Sciences
Barber, B., & Whitley, R. D. (1986) · The Canadian Journal of Sociology · doi:10.2307/3341122 · Cited by 1,219 · see citing works
Inside the Black Box: Technology and Economics
Rosenberg, N. (1983) · doi:10.1017/cbo9780511611940 · Cited by 682 · see citing works
van Raan, A. F. J. (1996) · Scientometrics · doi:10.1007/bf02129602 · Cited by 390 · see citing works
Alberts, B. (2013) · Science · doi:10.1126/science.1240319 · Cited by 389 · see citing works
Intended and unintended consequences of a publish‐or‐perish culture: A worldwide survey
van Dalen, H. P., & Henkens, K. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22636 · Cited by 355 · see citing works
Prometheus Bound: Science in a dynamic steady state
Ziman, J. M., & Schmitt, R. W. (1995) · American Journal of Physics · doi:10.1119/1.17884 · Cited by 340 · see citing works
The Four Literatures of Social Science
Hicks, D. M. (2006) · Kluwer Academic Publishers eBooks · doi:10.1007/1-4020-2755-9_22 · Cited by 337 · see citing works
(1994) · Cambridge University Press eBooks · doi:10.1017/cbo9780511585067 · Cited by 318 · see citing works
The Intellectual and Social Organization of the Sciences
Pickles, J., & Whitley, R. (1987) · Economic Geography · doi:10.2307/144159 · Cited by 285 · see citing works
Vessuri, H., Guédon, J., & Cetto, A. M. (2013) · Current Sociology · doi:10.1177/0011392113512839 · Cited by 279 · see citing works
‘New Public Management’ and the Academic Profession: Reflections on the German Situation
Schimank, U. (2005) · Minerva · doi:10.1007/s11024-005-2472-9 · Cited by 260 · see citing works
Constitutive Effects of Performance Indicators: Getting beyond unintended consequences
Dahler‐Larsen, P. (2013) · Public Management Review · doi:10.1080/14719037.2013.770058 · Cited by 215 · see citing works
Gläser, J., & Laudel, G. (2016) · European Journal of Sociology · doi:10.1017/s0003975616000047 · Cited by 186 · see citing works
Hess, D. J. (2007) · Cited by 170 · see citing works
The Changing Governance of the Sciences : The Advent of Research Evaluation Systems
Whitley, R. D., & Gläser, J. (2007) · Research Explorer (The University of Manchester) · doi:10.1007/978-1-4020-6746-4 · Cited by 156 · see citing works
La ciencia y la tecnología en el desarrollo futuro de América Latina
Botana, N. R., & Sábato, J. F. (1993) · Arbor · Cited by 152 · see citing works
Academic Research And Researchers
Brew, A., & Lucas, L. (2009) · Cited by 132 · see citing works
Changing Governance of the Public Sciences
Whitley, R. D. (2007) · Sociology of the sciences/Sociology of the sciences yearbook · doi:10.1007/978-1-4020-6746-4_1 · Cited by 130 · see citing works
Weak knowledge demand in the South: learning divides and innovation policies
Arocena, R., & Sutz, J. (2010) · Science and Public Policy · doi:10.3152/030234210x12767691861137 · Cited by 112 · see citing works
Self-citationQuality Versus Quantity: Assessing Individual Research Performance
Sahel, J. (2011) · Science Translational Medicine · doi:10.1126/scitranslmed.3002249 · Cited by 106 · see citing works
The use of bibliometrics to measure research quality in UK higher education institutions
Adams, J. R. (2009) · Archivum Immunologiae et Therapiae Experimentalis · doi:10.1007/s00005-009-0003-3 · Cited by 104 · see citing works
The Social Construction Of Bibliometric Evaluations
Gläser, J., & Laudel, G. (2007) · Sociology of the sciences/Sociology of the sciences yearbook · doi:10.1007/978-1-4020-6746-4_5 · Cited by 103 · see citing works
Higher Education Governance and Policy Change in Western Europe
Dobbins, M., & Knill, C. (2014) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137399854 · Cited by 103 · see citing works
Evolutionary economics and the new international political economy
Mothe, J. R. D. L., & Paquet, G. (1996) · Cited by 102 · see citing works
Shapin, S. (1987) · Máthesis · Cited by 99 · see citing works
The Shift in Academic Quality Control
Hemlin, S., & Rasmussen, S. B. (2006) · Science Technology & Human Values · doi:10.1177/0162243905283639 · Cited by 98 · see citing works
Six Guiding Principles for Evaluating Mode-2 Strategies for Sustainable Development
Regeer, B. J., Hoes, A.-C., Saane, M. V. A.-V., et al. (2009) · American Journal of Evaluation · doi:10.1177/1098214009344618 · Cited by 89 · see citing works
Milanez, B. (2007) · Americanae (AECID Library) · doi:10.3395/reciis.v1i2.909 · Cited by 82 · see citing works
Evaluation of research in context: an approach and two cases
de Jong, S. P. L., van Arensbergen, P., Daemen, F., van der Meulen, B., & van den Besselaar, P. (2011) · Research Evaluation · doi:10.3152/095820211x12941371876346 · Cited by 81 · see citing works
The UK Research Assessment Exercise
Martin, B. R., & Whitley, R. D. (2010) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199590193.003.0002 · Cited by 68 · see citing works
The UK Research Assessment Exercise: A Case of Regulatory Capture?
Whitley, R., Martin, B. R., Glaeser, J., et al. (2010) · Research Explorer (The University of Manchester) · Cited by 59 · see citing works
Hicks, D. M. (2012) · Confero Essays on Education Philosophy and Politics · doi:10.3384/confero13v1121207b · Cited by 55 · see citing works
Interdisciplinarity and research on local issues: evidence from a developing country
Chavarro, D., Tang, P., & Ràfols, I. (2014) · Research Evaluation · doi:10.1093/reseval/rvu012 · Cited by 53 · see citing works
Gläser, J., & Laudel, G. (2007) · Sociology of the sciences/Sociology of the sciences yearbook · doi:10.1007/978-1-4020-6746-4_6 · Cited by 51 · see citing works
Pineiro, C. L., & Hicks, D. (2014) · Research Evaluation · doi:10.1093/reseval/rvu030 · Cited by 51 · see citing works
Reconfiguring the Public Sciences
Whitley, R. D. (2010) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199590193.003.0001 · Cited by 46 · see citing works
Whitley, R., Glaeser, J., & Engwall, L. (2010) · Research Explorer (The University of Manchester) · Cited by 38 · see citing works
Barrè, R. (2010) · Research Evaluation · doi:10.3152/095820210x512069 · Cited by 33 · see citing works
Appropriate Biotechnology in Small-Scale Agriculture: How to Reorient Research and Development
Bunders, J., & Broerse, J. E. W. (1991) · OpenGrey (Institut de l'Information Scientifique et Technique) · Cited by 30 · see citing works
Dobbins, M., & Knill, C. (2014) · Cited by 29 · see citing works
Mission Now Possible: Profile-Building and Leadership in German Universities
Meier, F., & Schimank, U. (2010) · PUB – Publications at Bielefeld University (Bielefeld University) · Cited by 23 · see citing works
Biotechnology for small-scale farmers in developing countries: analysis and assessment procedures
(1992) · Choice Reviews Online · doi:10.5860/choice.29-2708 · Cited by 23 · see citing works
Meier, F., & Schimank, U. (2010) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199590193.003.0007 · Cited by 23 · see citing works
The Dangers of Partial Bibliometric Evaluation in the Social Sciences
Hicks, D. M. (2006) · Economia Politica · doi:10.1428/22461 · Cited by 12 · see citing works
Research Funding, Authority Relations, and Scientific Production in Switzerland
Benninghoff, M., & Braun, D. (2010) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199590193.003.0003 · Cited by 12 · see citing works
Research quality assessment: Objectives, approaches, responses and consequences
McNay, I. (2009) · Cited by 10 · see citing works
The Consequences of Evaluation for Academic Research
Elzinga, A. (1988) · Science & Technology Studies · doi:10.23987/sts.54997 · Cited by 8 · see citing works
Authority Relations as Condition for, and Outcome of, Shifts in Governance
Morris, N. (2010) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199590193.003.0008 · Cited by 6 · see citing works
Use and non-use of research evaluation A literature reviewPreprint
van der Most, F. (2011) · RePEc: Research Papers in Economics · Cited by 2 · see citing works
Bianco, M., Mazzitelli, M. G., & Tomassini, C. (2014) · Redes Revista de Estudios Sociales de la Ciencia y la Tecnología · doi:10.48160/18517072re39.626 · Cited by 2 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World
Pranckutė, R. (2021) · Publications · doi:10.3390/publications9010012 · Cited by 2,696 · see citing works
To what extent is inclusion in the Web of Science an indicator of journal ‘quality’?
Chavarro, D., Ràfols, I., & Tang, P. (2018) · Research Evaluation · doi:10.1093/reseval/rvy001 · Cited by 115 · see citing works
- Authors
- Bianco, M., Gras, N., & Sutz, J.
- Affiliations
- Universidad de la República de Uruguay (UY)
- Corresponding author
- Bianco, Mariela
- Venue
- Minerva
- Published
- 2016-08-08
- Volume
- 54
- Issue
- 4
- Pages
- 399-421
- ISSN
- 0026-4695 (ISSN-L)
- 1573-1871
- OpenAlex
- W2519916377
- Cited by
- 70
- References
- 60
- Citations by year
- 2026: 4 · 2025: 1 · 2024: 8 · 2023: 8 · 2022: 13 · 2021: 4 · 2020: 8 · 2019: 6 · 2018: 12 · 2017: 6
- FWCI
- 6.67
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Minerva (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Social Sciences › Political Science and International Relations › Higher Education Governance and Development
- Social Sciences › Demography › Science, Technology, and Education in Latin America
- Keywords
- academic assessment, research evaluation, productivity indicators, universalism, research agenda, science policy, university research, research funding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
