The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
What is societal impact of research and how can it be assessed? a literature survey
Abstract
Since the 1990s, the scope of research evaluations becomes broader as the societal products (outputs), societal use (societal references), and societal benefits (changes in society) of research come into scope. Society can reap the benefits of successful research studies only if the results are converted into marketable and consumable products (e.g., medicaments, diagnostic tools, machines, and devices) or services. A series of different names have been introduced which refer to the societal impact of research: third stream activities, societal benefits, societal quality, usefulness, public values, knowledge transfer, and societal relevance. What most of these names are concerned with is the assessment of social, cultural, environmental, and economic returns (impact and effects) from results (research output) or products (research outcome) of publicly funded research. This review intends to present existing research on and practices employed in the assessment of societal impact in the form of a literature survey. The objective is for this review to serve as a basis for the development of robust and reliable methods of societal impact measurement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The New production of knowledge: the dynamics of science and research in contemporary societies
(1995) · Choice Reviews Online · doi:10.5860/choice.32-4463 · Cited by 7,046
The New Production of Knowledge: The Dynamics of Science and Research in Contemporary Societies.
Baber, Z., Gibbons, M., Limoges, C., Nowotny, H., Schwartzman, S., Scott, P., & Trow, M. (1995) · Contemporary Sociology · doi:10.2307/2076669 · Cited by 4,406
The economic benefits of publicly funded basic research: a critical review
Salter, A. J., & Martin, B. R. (2001) · Research Policy · doi:10.1016/s0048-7333(00)00091-3 · Cited by 1,358
The increasing linkage between U.S. technology and public science
Narin, F., Hamilton, K. S., & Olivastro, D. (1997) · Research Policy · doi:10.1016/s0048-7333(97)00013-9 · Cited by 1,281
Academic research and industrial innovation
Mansfield, E. (1991) · Research Policy · doi:10.1016/0048-7333(91)90080-a · Cited by 1,262
Stephan, P. (2012) · Harvard University Press eBooks · doi:10.4159/harvard.9780674062757 · Cited by 934
Expert Opinions in Forecasting: The Role of the Delphi Technique
Rowe, G., & Wright, G. (2001) · International Series in Operations Research & Management Science · doi:10.1007/978-0-306-47630-3_7 · Cited by 777
Real Science: What it Is and What it Means
Ziman, J. (2000) · doi:10.1017/cbo9780511541391 · Cited by 760
Academic research and industrial innovation: An update of empirical findings
Mansfield, E. (1998) · Research Policy · doi:10.1016/s0048-7333(97)00043-7 · Cited by 643
Bornmann, L. (2011) · Annual Review of Information Science and Technology · doi:10.1002/aris.2011.1440450112 · Cited by 567
Self-citation
Cited by
Bornmann, L., & Mutz, R. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23329 · Cited by 1,576
Self-citationFortunato, S., Bergstrom, C. T., Börner, K., Evans, J. A., Helbing, D., Milojević, S., Petersen, A. M., Radicchi, F., Sinatra, R., Uzzi, B., et al. (2018) · Science · doi:10.1126/science.aao0185 · Cited by 1,497
“The development of alternative metrics covering web (88) and social media (89) activity and societal impact (90) is critical in this regard.”
Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories
Aksnes, D. W., Langfeldt, L., & Wouters, P. (2019) · Sage Open · doi:10.1177/2158244019829575 · Cited by 1,257
Do Altmetrics Work? Twitter and Ten Other Social Web Services
Thelwall, M., Haustein, S., Larivière, V., & Sugimoto, C. R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0064841 · Cited by 907
Bornmann, L. (2014) · Journal of Informetrics · doi:10.1016/j.joi.2014.09.005 · Cited by 578
Self-citation
Metadata
- Authors
- Bornmann, L.
- Venue
- Journal of the American Society for Information Science and Technology
- Publisher
- Wiley
- Published
- 2012-12-17
- Volume
- 64
- Issue
- 2
- Pages
- 217-233
- ISSN
- 1532-2882 (ISSN-L)
- 1532-2890
- OpenAlex
- W1979116104
- Cited by
- 731
- References
- 56
- FWCI
- 22.64
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: What is societal impact of research and how can it be assessed? a literature survey. https://app.cochat.ai/papers/10.1002/asi.22803
- The paper
- Bornmann, L. (2013). What is societal impact of research and how can it be assessed? a literature survey. Journal of the American Society for Information Science and Technology. https://doi.org/10.1002/asi.22803
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
