The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Measuring the societal impact of research: Research is less and less assessed on scientific impact alone—we should aim to quantify the increasingly important contributions of science to society
Open accessAbstract
The global financial crisis has changed how nations and agencies prioritize research investment. There has been a push towards science with expected benefits for society, yet devising reliable tools to predict and measure the social impact of research remains a major challenge.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The economic benefits of publicly funded basic research: a critical review
Salter, A. J., & Martin, B. R. (2001) · Research Policy · doi:10.1016/s0048-7333(00)00091-3 · Cited by 1,358
The Research Excellence Framework and the 'impact agenda': are we creating a Frankenstein monster?
Martin, B. R. (2011) · Research Evaluation · doi:10.3152/095820211x13118583635693 · Cited by 471
The state of h index research: Is the h index the ideal way to measure research performance?
Bornmann, L., & Daniel, H. (2009) · EMBO reports · doi:10.1038/embor.2008.233 · Cited by 396
Self-citationPublic Value Mapping and Science Policy Evaluation
Bozeman, B., & Sarewitz, D. (2011) · Minerva · doi:10.1007/s11024-011-9161-7 · Cited by 308
Abbott, A., Cyranoski, D., Jones, N., Maher, B., Schiermeier, Q., & Van Noorden, R. (2010) · Nature · doi:10.1038/465860a · Cited by 261
Measuring third stream activities
Molas‐Gallart, J., Salter, A. J., Patel, P., Scott, A., & Durán, X. (2002) · Figshare · Cited by 219
Diversity, value and limitations of the journal impact factor and alternative metrics
Bornmann, L., Marx, W., Gasparyan, A. Y., & Kitas, G. D. (2012) · Rheumatology International · doi:10.1007/s00296-011-2276-1 · Cited by 178
Self-citationState of the art in assessing research impact: introduction to a special issue
Donovan, C. (2011) · Research Evaluation · doi:10.3152/095820211x13118583635918 · Cited by 170
Measuring the social impact of research
Smith, R. W. (2001) · BMJ · doi:10.1136/bmj.323.7312.528 · Cited by 154
Peer review and the ex ante assessment of societal impacts
Holbrook, J. B., & Frodeman, R. (2011) · Research Evaluation · doi:10.3152/095820211x12941371876788 · Cited by 135
Donovan, C. (2008) · New Directions for Evaluation · doi:10.1002/ev.260 · Cited by 122
Peer review and the relevance gap: ten suggestions for policy-makers
Nightingale, P., & Scott, A. (2007) · Science and Public Policy · doi:10.3152/030234207x254396 · Cited by 120
Measuring research performance during a changing relationship between science and society
Ernø-Kjølhede, E., & Hansson, F. (2011) · Research Evaluation · doi:10.3152/095820211x12941371876544 · Cited by 62
Assessing Europe's University-Based Research
Hazelkorn, E. (2010) · Cited by 57
Hanney, S. R., Packwood, T., & Buxton, M. J. (2000) · Evaluation · doi:10.1177/13563890022209181 · Cited by 57
Bornmann, L. (2010) · Scientometrics · doi:10.1007/s11192-010-0222-8 · Cited by 45
Self-citationEvaluating the societal relevance of academic research: A guide
van der Meulen, B. (2010) · Data Archiving and Networked Services (DANS) · Cited by 32
Niederkrotenthaler, T., Dorner, T. E., & Maier, M. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-588 · Cited by 31
Cited by
Bornmann, L., & Mutz, R. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23329 · Cited by 1,576
Self-citationCitations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories
Aksnes, D. W., Langfeldt, L., & Wouters, P. (2019) · Sage Open · doi:10.1177/2158244019829575 · Cited by 1,257
A Structure-Based Drug Discovery Paradigm
Batool, M., Ahmad, B., & Choi, S. (2019) · International Journal of Molecular Sciences · doi:10.3390/ijms20112783 · Cited by 744
What is societal impact of research and how can it be assessed? a literature survey
Bornmann, L. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22803 · Cited by 731
Self-citationBornmann, L. (2014) · Journal of Informetrics · doi:10.1016/j.joi.2014.09.005 · Cited by 578
Self-citation
Metadata
- Authors
- Bornmann, L.
- Venue
- EMBO reports
- Published
- 2012-07-10
- Volume
- 13
- Issue
- 8
- Pages
- 673-676
- ISSN
- 1469-221X (ISSN-L)
- 1469-3178
- OpenAlex
- W2139282251
- Cited by
- 252
- References
- 18
- FWCI
- 20.16
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.