A Review of Literature on Evaluating the Scientific, Social and Political Impact of Social Sciences and Humanities Research
Open accessAbstract
Recently, the need to contribute to the evaluation of the scientific, social, and political impact of Social Sciences and Humanities (SSH) research has become a demand of policy makers and society. The international scientific community has made significant advances that have transformed the impact of evaluation landscape. This article reviews the existing scientific knowledge on evaluation tools and techniques that are applied to assess the scientific impact of SSH research; the changing structure of social and political impacts of SSH research is investigated based on an overarching research question: to what extent do scholars attempt to apply methods, instruments, and approaches that take into account the distinctive features of SSH? The review also includes examples of European Union (EU) projects that demonstrate these impacts. This article culminates in a discussion of the development of the assessment of different impacts and identifies limitations, and areas and topics to explore in the future.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Citations may be appropriate for assessing scientific impact of research, but they do not show impact outside the scientific community.
“Citations may be appropriate in assessing the scientific impact of the research, but they do not show the impact of the research outside the scientific community [1,3,5,6,260,264,265].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [265]
Publication data and citation metrics continue to play the most important role in research assessments worldwide, so indicator-based research assessments remain at the center of global debate about their validity and influence.
“because publication data and citation metrics continue to play the most important role in research assessments worldwide, indicator-based research assessments also remain at the center of the global debate, not only about their validity, but also about their influence on research activities, scientific output, and its quality [1,5-7,44,260,265,289].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [265]
These studies are often targeted at general public and published in national language, which narrows potential audience and reduces likelihood of citation.
“These studies are also often targeted at the general public and, therefore, are often published in the national language, which narrows the size of potential audience and, consequently, reduces the likelihood of citation [87,96,260,265,294].”
From Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World (2021) · cites this paper as [265]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Risk Society, Towards a New Modernity
Leiss, W., Beck, U., Ritter, M., Lash, S. M., & Wynne, B. (1994) · The Canadian Journal of Sociology · doi:10.2307/3341155 · Cited by 12,553 · see citing works
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669 · see citing works
Risk Society: Towards a New Modernity
Boyd, W. E., Beck, U., & Shrader‐Frechette, K. (1993) · Economic Geography · doi:10.2307/143601 · Cited by 9,278 · see citing works
Price, D. J. D. S. (1963) · Columbia University Press eBooks · doi:10.7312/pric91844 · Cited by 4,340 · see citing works
Bibliometrics: The Leiden Manifesto for Research Metrics
Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015) · Nature · doi:10.1038/520429a · Cited by 2,828 · see citing works
The History and Meaning of the Journal Impact Factor
Garfield, E. (2006) · JAMA · doi:10.1001/jama.295.1.90 · Cited by 2,770 · see citing works
Not for profit: why democracy needs the humanities
Nussbaum, M. C. (2011) · Choice Reviews Online · doi:10.5860/choice.48-3075 · Cited by 1,820 · see citing works
Bibliometrics: Global gender disparities in science
Larivière, V., Ni, C., Gingras, Y., Cronin, B., & Sugimoto, C. R. (2013) · Nature · doi:10.1038/504211a · Cited by 1,499 · see citing works
Handbook of Quantitative Science and Technology Research
Moed, H. F., Glänzel, W., & Schmoch, U. (2005) · Springer eBooks · doi:10.1007/1-4020-2755-9 · Cited by 1,385 · see citing works
The Intellectual and Social Organization of the Sciences
Barber, B., & Whitley, R. D. (1986) · The Canadian Journal of Sociology · doi:10.2307/3341122 · Cited by 1,219 · see citing works
The Intellectual and Social Organization Of the Sciences
Whitley, R. (2000) · doi:10.1093/oso/9780199240531.001.0001 · Cited by 1,076 · see citing works
A new approach to the metric of journals’ scientific prestige: The SJR indicator
González-Pereira, B., Guerrero‐Bote, V. P., & Anegón, F. D. M. (2010) · Journal of Informetrics · doi:10.1016/j.joi.2010.03.002 · Cited by 867 · see citing works
Bibliometric monitoring of research performance in the Social Sciences and the Humanities: A Review
Nederhof, A. J. (2006) · Scientometrics · doi:10.1007/s11192-006-0007-2 · Cited by 785 · see citing works
What is societal impact of research and how can it be assessed? a literature survey
Bornmann, L. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22803 · Cited by 732 · see citing works
A Hirsch-type index for journals
Braun, T., Glänzel, W., & Schubert, A. P. (2006) · Scientometrics · doi:10.1007/s11192-006-0147-4 · Cited by 669 · see citing works
Self-citationBibliometrics and Citation Analysis: From the Science Citation Index to Cybermetrics
Nicolaisen, J. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21181 · Cited by 653 · see citing works
Assessment, evaluations, and definitions of research impact: A review
Penfield, T., Baker, M., Scoble, R., & Wykes, M. C. (2013) · Research Evaluation · doi:10.1093/reseval/rvt021 · Cited by 573 · see citing works
Scholarship in the digital age: information, infrastructure, and the Internet
Borgman, C. L. (2008) · Choice Reviews Online · doi:10.5860/choice.45-4424 · Cited by 571 · see citing works
Journal impact measures in bibliometric research
Glänzel, W., & Moed, H. F. (2002) · Scientometrics · doi:10.1023/a:1014848323806 · Cited by 558 · see citing works
Lam, A. (2011) · Research Policy · doi:10.1016/j.respol.2011.09.002 · Cited by 554 · see citing works
Bibliometrics and Citation Analysis: From the Science Citation Index to Cybermetrics
Bellis, N. D. (2009) · IRIS UNIMORE (University of Modena and Reggio Emilia) · Cited by 548 · see citing works
Introducing 'productive interactions' in social impact assessment
Spaapen, J., & van Drooge, L. (2011) · Research Evaluation · doi:10.3152/095820211x12941371876742 · Cited by 526 · see citing works
Scholarship in the Digital Age: Information, Infrastructure, and the Internet
Borgman, C. L. (2007) · doi:10.7551/mitpress/7434.001.0001 · Cited by 512 · see citing works
Archambault, É., Vignola-Gagné, É., Côté, G., Larivière, V., & Gingrasb, Y. (2006) · Scientometrics · doi:10.1007/s11192-006-0115-z · Cited by 507 · see citing works
Evaluation Practices and Effects of Indicator Use—A Literature Review
Rijcke, S. D., Wouters, P. F., Rushforth, A. D., Franssen, T. P., & Hammarfelt, B. (2016) · Research Evaluation · doi:10.1093/reseval/rvv038 · Cited by 467 · see citing works
Amara, N., Ouimet, M., & Landry, R. (2004) · Science Communication · doi:10.1177/1075547004267491 · Cited by 463 · see citing works
Editors, T. P. M. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030291 · Cited by 373 · see citing works
How Can Payback from Health Services Research Be Assessed?
Buxton, M. J., & Hanney, S. R. (1996) · Journal of Health Services Research & Policy · doi:10.1177/135581969600100107 · Cited by 372 · see citing works
What is Originality in the Humanities and the Social Sciences?
Guetzkow, J., Lamont, M., & Mallard, G. (2004) · American Sociological Review · doi:10.1177/000312240406900203 · Cited by 333 · see citing works
Critical Communicative Methodology: Informing Real Social Transformation Through Research
Gómez, A., Puigvert, L., & Flecha, R. (2011) · Qualitative Inquiry · doi:10.1177/1077800410397802 · Cited by 331 · see citing works
Self-citationIntelligent Policy Making for a Complex World: Pragmatism, Evidence and Learning
Sanderson, I. (2009) · Political Studies · doi:10.1111/j.1467-9248.2009.00791.x · Cited by 318 · see citing works
Small, H. (2013) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199683864.001.0001 · Cited by 287 · see citing works
Progressing research impact assessment: A ‘contributions’ approach
Morton, S. (2015) · Research Evaluation · doi:10.1093/reseval/rvv016 · Cited by 271 · see citing works
Evaluating research and innovation policy: a systems world needs systems evaluations
Arnold, E. (2004) · Research Evaluation · doi:10.3152/147154404781776509 · Cited by 259 · see citing works
Mohammadi, E., & Thelwall, M. A. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23071 · Cited by 245 · see citing works
Successful Educational Actions for Inclusion and Social Cohesion in Europe
Flecha, R. (2014) · Springer briefs in education · doi:10.1007/978-3-319-11176-6 · Cited by 230 · see citing works
Self-citationUsing altmetrics for assessing research impact in the humanities
Hammarfelt, B. (2014) · Scientometrics · doi:10.1007/s11192-014-1261-3 · Cited by 209 · see citing works
Meagher, L. R., Lyall, C., & Nutley, S. (2008) · Research Evaluation · doi:10.3152/095820208x331720 · Cited by 208 · see citing works
A New History of the Humanities
Bod, R. (2013) · doi:10.1093/acprof:oso/9780199665211.001.0001 · Cited by 191 · see citing works
Tracing 'productive interactions' to identify social impacts: an example from the social sciences
Molas‐Gallart, J., & Tang, P. (2011) · Research Evaluation · doi:10.3152/095820211x12941371876706 · Cited by 181 · see citing works
State of the art in assessing research impact: introduction to a special issue
Donovan, C. M. (2011) · Research Evaluation · doi:10.3152/095820211x13118583635918 · Cited by 170 · see citing works
Self-citationInstrumentation Between Science, State and Industry
Joerges, B., & Shinn, T. (2001) · Springer eBooks · doi:10.1007/978-94-010-9032-2 · Cited by 168 · see citing works
The 'Payback Framework' explained
Donovan, C., & Hanney, S. R. (2011) · Research Evaluation · doi:10.3152/095820211x13118583635756 · Cited by 160 · see citing works
Self-citationUnderstanding societal impact through productive interactions: ICT research as a case
de Jong, S. P. L., Barker, K. E., Cox, D., Sveinsdottir, T., & van den Besselaar, P. (2014) · Research Evaluation · doi:10.1093/reseval/rvu001 · Cited by 150 · see citing works
The Impact of the Social Sciences.
Musgrave, A. E., & Boulding, K. E. (1967) · Economica · doi:10.2307/2552042 · Cited by 142 · see citing works
Peer review and the ex ante assessment of societal impacts
Holbrook, J. B., & Frodeman, R. (2011) · Research Evaluation · doi:10.3152/095820211x12941371876788 · Cited by 135 · see citing works
Scholarly Communication and Bibliometrics.
Hackett, E. J., & Borgman, C. L. (1992) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2074817 · Cited by 124 · see citing works
Donovan, C. (2008) · New Directions for Evaluation · doi:10.1002/ev.260 · Cited by 122 · see citing works
Self-citationSivertsen, G., & Larsen, B. (2012) · Scientometrics · doi:10.1007/s11192-011-0615-3 · Cited by 114 · see citing works
Prins, A., Costas, R., van Leeuwen, T. N., & Wouters, P. F. (2016) · Research Evaluation · doi:10.1093/reseval/rvv049 · Cited by 112 · see citing works
Samuel, G. N., & Derrick, G. (2015) · Research Evaluation · doi:10.1093/reseval/rvv007 · Cited by 99 · see citing works
Science Funding and Short-Term Economic Activity
Weinberg, B. A., Owen-Smith, J. D., Rosen, R. F., et al. (2014) · Science · doi:10.1126/science.1250055 · Cited by 88 · see citing works
Benneworth, P. (2014) · Arts and Humanities in Higher Education · doi:10.1177/1474022214533888 · Cited by 85 · see citing works
Communicative Methodology: Successful actions and dialogic democracy
Flecha, R., & Soler, M. (2014) · Current Sociology · doi:10.1177/0011392113515141 · Cited by 85 · see citing works
Self-citationEvaluation of research in context: an approach and two cases
de Jong, S. P. L., van Arensbergen, P., Daemen, F., van der Meulen, B., & van den Besselaar, P. (2011) · Research Evaluation · doi:10.3152/095820211x12941371876346 · Cited by 81 · see citing works
Europe must fund social sciences
Flecha, R., Soler, M., & Sordé, T. (2015) · Nature · doi:10.1038/528193d · Cited by 81 · see citing works
Self-citationHug, S. E., Ochsner, M., & Daniel, H. (2013) · Research Evaluation · doi:10.1093/reseval/rvt008 · Cited by 80 · see citing works
Leydesdorff, L., Hammarfelt, B., & Salah, A. A. A. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21636 · Cited by 75 · see citing works
Influence flows in the academy: Using affiliation networks to assess peer effects among researchers
Rawlings, C. M., & McFarland, D. A. (2011) · Social Science Research · doi:10.1016/j.ssresearch.2010.10.002 · Cited by 69 · see citing works
Altmetrics and Other Novel Measures for Scientific Impact
Fenner, M. H. (2013) · Springer eBooks · doi:10.1007/978-3-319-00026-8_12 · Cited by 68 · see citing works
Research Assessment in the Humanities
(2016) · doi:10.1007/978-3-319-29016-4 · Cited by 68 · see citing works
Garfield, E. (1980) · The Library Quarterly · doi:10.1086/629874 · Cited by 68 · see citing works
Measuring research performance during a changing relationship between science and society
Ernø-Kjølhede, E., & Hansson, F. (2011) · Research Evaluation · doi:10.3152/095820211x12941371876544 · Cited by 62 · see citing works
Research evaluation and the assessment of public value
Molas‐Gallart, J. (2014) · Arts and Humanities in Higher Education · doi:10.1177/1474022214534381 · Cited by 60 · see citing works
How to use indicators to measure scientific performance: a balanced approach
Schmoch, U., Schubert, T., Jansen, D., et al. (2010) · Research Evaluation · doi:10.3152/095820210x492477 · Cited by 58 · see citing works
Ochsner, M., Hug, S. E., & Daniel, H. (2012) · Research Evaluation · doi:10.1093/reseval/rvs039 · Cited by 57 · see citing works
Evaluating the Benefits from Health Research and Development Centres
Hanney, S. R., Packwood, T., & Buxton, M. J. (2000) · Evaluation · doi:10.1177/13563890022209181 · Cited by 56 · see citing works
From Research to Policy: Roma Participation Through Communicative Organization
Pascual, A. M., Serradell, O., & Sordé, T. (2011) · Qualitative Inquiry · doi:10.1177/1077800410397804 · Cited by 56 · see citing works
Self-citationKlautzer, L., Hanney, S. R., Nason, E., et al. (2011) · Research Evaluation · doi:10.3152/095820211x13118583635675 · Cited by 53 · see citing works
Debate: Co-production can contribute to research impact in the social sciences
Armstrong, F., & Alsop, A. (2010) · Public Money & Management · doi:10.1080/09540962.2010.492178 · Cited by 51 · see citing works
Making an impact: New directions for arts and humanities research
Hazelkorn, E. (2014) · Arts and Humanities in Higher Education · doi:10.1177/1474022214533891 · Cited by 51 · see citing works
Mapping citation patterns of book chapters in the Book Citation Index
Torres‐Salinas, D., Sánchez, R. M. R., Robinson‐García, N., Fdez-Valdivia, J., & García, J. A. (2013) · Journal of Informetrics · doi:10.1016/j.joi.2013.01.004 · Cited by 46 · see citing works
Kuhlmann, S. (1998) · Evaluation · doi:10.1177/13563899822208491 · Cited by 45 · see citing works
Donovan, C. (2007) · Science and Public Policy · doi:10.3152/030234207x256529 · Cited by 45 · see citing works
Self-citationBrewer, J. D. (2011) · Research Evaluation · doi:10.3152/095820211x12941371876869 · Cited by 43 · see citing works
Using Dialogic Research to Overcome Poverty: from principles to action
Valls, R., & Cuxart, M. P. (2011) · European Journal of Education · doi:10.1111/j.1465-3435.2011.01473.x · Cited by 42 · see citing works
The Governance of Social Science and Everyday Epistemology
Donovan, C. (2005) · Public Administration · doi:10.1111/j.0033-3298.2005.00464.x · Cited by 38 · see citing works
Self-citationAssessing the impact of arts and humanities research at the University of Cambridge
Levitt, R., Celia, C., Diepeveen, S., et al. (2010) · Cited by 35 · see citing works
Scientific progress, risk, and development: Explaining attitudes toward science cross-nationally
Price, A. M., & Peterson, L. (2015) · International Sociology · doi:10.1177/0268580915614593 · Cited by 34 · see citing works
The Utility of the Arts and Humanities
Bérubé, M. (2003) · Arts and Humanities in Higher Education · doi:10.1177/1474022203002001003 · Cited by 33 · see citing works
Evaluating the societal relevance of academic research: A guide
van der Meulen, B. (2010) · Data Archiving and Networked Services (DANS) · Cited by 32 · see citing works
Evaluating the NHS research and development programme: will the programme give value for money?
Buxton, M. J., & Hanney, S. (1998) · Journal of the Royal Society of Medicine · doi:10.1177/014107689809135s02 · Cited by 31 · see citing works
Sordé, T., Serradell, O., Puigvert, L., et al. (2013) · European Journal of Women s Studies · doi:10.1177/1350506813510425 · Cited by 27 · see citing works
Self-citationThe Agora model of innovation systems: S&T indicators for a democratic knowledge society
Barr, R. (2001) · Research Evaluation · doi:10.3152/147154401781777150 · Cited by 26 · see citing works
Meeting in the middle: joining reflection and action in complex public sector projects
Duijn, M., Rijnveld, M., & van Hulst, M. (2010) · Public Money & Management · doi:10.1080/09540962.2010.492183 · Cited by 26 · see citing works
Complexity sciences: towards an alternative approach to understanding the use of academic research
Lemay, M. A., & Sá, C. M. (2012) · Evidence & Policy · doi:10.1332/174426412x660133 · Cited by 25 · see citing works
Towards a Bibliometric Database for the Social Sciences and Humanities
Hicks, D. M., & Wang, J. (2009) · Cited by 22 · see citing works
Wehrens, R., Bekker, M., & Bal, R. A. (2012) · Evidence & Policy · doi:10.1332/174426412x640063 · Cited by 22 · see citing works
Tracing scientific influencePreprint
Scharnhorst, A., & Garfield, E. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1010.3525 · Cited by 22 · see citing works
Self-citationManaging sensitive relations in co-produced planning research
O’Hare, P., Coaffee, J., & Hawkesworth, M. (2010) · Public Money & Management · doi:10.1080/09540962.2010.492188 · Cited by 20 · see citing works
The Mixed Blessing of Mode 2 Knowledge Production
Hessels, L. K., & van Lente, H. (2010) · Technische Universität Dortmund Eldorado (Technische Universität Dortmund) · doi:10.17877/de290r-571 · Cited by 20 · see citing works
Evaluation through impact: A different viewpoint
Reale, E., Nedeva, M., Thomas, D. A., et al. (2014) · Research Explorer (The University of Manchester) · Cited by 19 · see citing works
Self-citationThe Public Knowledge Project: Open Source Tools for Open Access to Scholarly Communication
MacGregor, J. B., Stranack, K., & Willinsky, J. M. (2013) · Springer eBooks · doi:10.1007/978-3-319-00026-8_11 · Cited by 16 · see citing works
Lepori, B., & Probst, C. (2009) · Research Evaluation · doi:10.3152/095820209x441772 · Cited by 16 · see citing works
Self-citationMeasuring the impact of scholarly journals in the humanities field
Marchi, M., & Lorenzetti, E. (2015) · Scientometrics · doi:10.1007/s11192-015-1787-z · Cited by 12 · see citing works
In the Path to Regaining Social Sciences Legitimacy through Public Sociology
Saso, C. E. (2014) · International and Multidisciplinary Journal of Social Sciences · doi:10.4471/rimcis.2014.35 · Cited by 10 · see citing works
The impact of Payback research: developing and using evidence in policy
Henshall, C. (2011) · Research Evaluation · doi:10.3152/095820211x13118583635873 · Cited by 10 · see citing works
Cotterill, S., & Richardson, L. (2010) · The Annals of the American Academy of Political and Social Science · doi:10.1177/0002716209351521 · Cited by 10 · see citing works
Use of evidence from systematic reviews to inform commissioning decisions: a case study
Chambers, D., Grant, R., Warren, E., et al. (2012) · Evidence & Policy · doi:10.1332/174426412x640054 · Cited by 10 · see citing works
Towards a bibliometric Database for the Social Sciences and Humanities
Martin, B., Tang, P., Morgan, M., et al. (2010) · Data Archiving and Networked Services (DANS) · Cited by 10 · see citing works
Palfrey, C., Thomas, P., & Phillips, C. (2012) · Policy Press eBooks · doi:10.56687/9781847429162-006 · Cited by 10 · see citing works
International social science research: craft industry or baby behemoth?*
Forbes, I., & Abrams, D. J. (2004) · International Social Science Journal · doi:10.1111/j.0020-8701.2004.00486.x · Cited by 6 · see citing works
New challenges for indicators in science and technology policy-making: a European view
Gabolde, J. (1998) · Research Evaluation · doi:10.1093/rev/7.2.99 · Cited by 6 · see citing works
Assessing the value of research for society
Spaapen, J., & Sylvain, C. (1993) · Research Evaluation · doi:10.1093/rev/3.2.117 · Cited by 4 · see citing works
What does the Web represent? From virtual ethnography to web indicators
Scharnhorst, A., van den Besselaar, P., & Wouters, P. F. (2006) · UvA-DARE (University of Amsterdam) · Cited by 3 · see citing works
Self-citationThe challenge for social science: a new role in public policy-making
Newby, H. (1994) · Research Evaluation · doi:10.1093/rev/4.1.6 · Cited by 3 · see citing works
Flagged first, then by citations
Research works printed but not linked: 6
- Blockmans, W., Engwall, L., and Weaire, D. (2014). Bibliometrics: Use and Abuse in the Review of Research Performance: Proceedings from a sympo- sium held in Stockholm, 23-25 May 2013. London: Portland Press.
- Bornmann, L. (2014) Measuring the Broader Impact of Research: The Potential of Altmetrics. Digital Libraries; Physics and Society; Applications. <http://arxiv.org/abs/1406.7091>. · arXiv
- Garfield, E. (1980) 'Is Information Retrieval in the Arts and Humanities Inherently Different from That in Science?', The Library Quarterly, 50: 40-57.
- Hammarfelt, B. (2012). 'Following the Footnotes: A Bibliometric Analysis of Citation Patterns in Literary Studies', Doctoral dissertation. Skrifter utgivna vid institutionen fo ¨r ABM vid Uppsala Universitet, Vol. 5. Uppsala: Uppsala Universitet. <http://www.diva-portal.org/smash/get/diva2:511996/FULLT EXT01.pdf>.
- Jacobs, J. A. (2011) 'Journal Rankings in Sociology: Using the H Index with Google Scholar', PSC Working Paper Series, PSC 11-05. Philadelphia: Population Studies Center, University of Pennsylvania.
- Rymer, L. (2011) 'Measuring the Impact of Research-the Context for Metric Development', in The Group of Eight (ed.), Go8 Backgounder, Vol. 23. Turner: ACT.
Cited by
Sorted by citations
Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World
Pranckutė, R. (2021) · Publications · doi:10.3390/publications9010012 · Cited by 2,696 · see citing works
Social impact in social media: A new method to evaluate the social impact of research
Pulido, C. M., Redondo-Sama, G., Sordé-Martí, T., & Flecha, R. (2018) · PLOS ONE · doi:10.1371/journal.pone.0203117 · Cited by 158 · see citing works
Self-citation
- Authors
- Reale, E., Avramov, D., Canhial, K., Donovan, C., Flecha, R., Holm, P., Larkin, C., Lepori, B., Mosoni-Fried, J., Oliver, E., Primeri, E., Puigvert, L., Scharnhorst, A., Schubert, A., Soler, M., Soòs, S., Sordé, T., Travis, C., & Van Horik, R.
- Affiliations
- Research Institute on Sustainable Economic Growth (IT)
- Population and Social Policy Consultants (BE)
- Università della Svizzera italiana (CH)
- Brunel University of London (GB)
- University of Barcelona, Gran Via de les Corts Catalanes, 585, Barcelona, Spain
- Trinity College Dublin (IE)
- Library and Information Centre of the Hungarian Academy of Sciences (HU)
- College of Health and Life Sciences, Brunel University London, Kingston Lane, Uxbridge, UK
- Royal Netherlands Academy of Arts and Sciences (NL)
- Department of Science Policy and Scientometrics, Library and Information Centre of the Hungarian Academy of Sciences (MTA KIK-TTO), Arany János u. 1, H-1051 Budapest, Hungary
- Universitat Autònoma de Barcelona (ES)
- Universitat de Barcelona (ES)
- Data Archiving and Networked Services, Royal Netherlands Academy of Arts and Sciences (DANS-KNAW), Anna van Saksenlaan 51, 2593 HW Den Haag, The Netherlands
- Corresponding author
- Reale, Emanuela
- ORCID
- Venue
- Research Evaluation
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-07-18
- Volume
- 27
- Issue
- 4
- Pages
- 298-308
- ISSN
- 0958-2029 (ISSN-L)
- 1471-5449
- OpenAlex
- W2736430167
- Cited by
- 258
- References
- 106
- Citations by year
- 2026: 16 · 2025: 18 · 2024: 25 · 2023: 34 · 2022: 36 · 2021: 43 · 2020: 42 · 2019: 29 · 2018: 12 · 2017: 3
- FWCI
- 21.12
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Research Evaluation (publishedVersion, cc-by)
- KNAW research portal (Royal Academy of Art and Sciences (KNAW)) (publishedVersion, other-oa)
- Greenwich Academic Literature Archive (University of Greenwich) (acceptedVersion)
- Dipòsit Digital de la Universitat de Barcelona (Universitat de Barcelona) (acceptedVersion)
- RECERCAT (Consorci de Serveis Universitaris de Catalunya) (acceptedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- RePEc: Research Papers in Economics (submittedVersion)
- Brunel University Research Archive (BURA) (Brunel University London) (submittedVersion)
- RECERCAT (Consorci de Serveis Universitaris de Catalunya) (submittedVersion, public-domain)
- Funders
- European Union’s Seventh Framework Programme (FP7/2014-2017, 613202)
- IMPACT-EV Evaluating the Impact and Outcomes of European SSH Research
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Social Sciences › Decision Sciences › Information Systems and Management › Research, Science, and Academia
- Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
- Keywords
- research impact assessment, humanities and social sciences, scientific impact, social impact, political influence, European Union projects, science policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review