Perverse incentives
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“fraud may be a sign of underlying counterproductive incentives that influence scientists (45,46).”
From Misconduct accounts for the majority of retracted scientific publications (2012) · cites this paper as [45]
Citations
Cites
Stephan, P. (2012) · Harvard University Press eBooks · doi:10.4159/harvard.9780674062757 · Cited by 934
Self-citationIncentives and creativity: evidence from the academic life sciences
Azoulay, P., Graff Zivin, J. S., & Manso, G. (2011) · The RAND Journal of Economics · doi:10.1111/j.1756-2171.2011.00140.x · Cited by 648
Changing Incentives to Publish
Franzoni, C., Scellato, G., & Stephan, P. (2011) · Science · doi:10.1126/science.1197286 · Cited by 230
Self-citationIncentives and Creativity: Evidence from the Academic Life Sciences
Azoulay, P., Zivin, J. G., & Manso, G. (2009) · National Bureau of Economic Research · doi:10.3386/w15466 · Cited by 64
Bonus Pay for Research Faculty
Mallon, W. T., & Korn, D. (2004) · Science · doi:10.1126/science.1094859 · Cited by 9
Research works printed but not linked: 3
- Current Population Survey, Table P-28 (United States Census Bureau, 2010); available at http://go.nature.com/neix5i
- Berg, J. 'Another Look at Measuring the Scientific Output and Impact of NIGMS Grants' (22 November 2010); available at http://go.nature.com/dae21z
- Sacks, F. The Scientist (11 September 2007); available at http://go.nature.com/bpa3xr
Cited by
Misconduct accounts for the majority of retracted scientific publications
Fang, F. C., Steen, R. G., & Casadevall, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212247109 · Cited by 1,232
Rescuing US biomedical research from its systemic flaws
Alberts, B., Kirschner, M. W., Tilghman, S., & Varmus, H. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1404402111 · Cited by 817
Edwards, M. A., & Roy, S. (2017) · Environmental Engineering Science · doi:10.1089/ees.2016.0223 · Cited by 688
Swedberg, R. (2020) · The Production of Knowledge · doi:10.1017/9781108762519.002 · Cited by 293
The Production of Knowledge: Enhancing Progress in Social Science
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519 · Cited by 241
Self-citations as strategic response to the use of metrics for career decisions
Seeber, M., Cattaneo, M., Meoli, M., & Malighetti, P. (2019) · Research Policy · doi:10.1016/j.respol.2017.12.004 · Cited by 199
Causes for the Persistence of Impact Factor Mania
Casadevall, A., & Fang, F. C. (2014) · mBio · doi:10.1128/mbio.00064-14 · Cited by 196
Martin, B. R. (2013) · Research Policy · doi:10.1016/j.respol.2013.03.011 · Cited by 170
Changing demographics of scientific careers: The rise of the temporary workforce
Milojević, S., Radicchi, F., & Walsh, J. P. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1800478115 · Cited by 158
Miedema, F. F. (2021) · Springer eBooks · doi:10.1007/978-94-024-2115-6 · Cited by 135
The impact of postdoctoral training on early careers in biomedicine
Kahn, S., & Ginther, D. K. (2017) · Nature Biotechnology · doi:10.1038/nbt.3766 · Cited by 133
The impact of research funding on scientific outputs: Evidence from six smaller European countries
Gök, A., Rigby, J., & Shapira, P. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23406 · Cited by 97
The contrasting roles of science and technology in environmental challenges
Voulvoulis, N., & Burgman, M. A. (2019) · Critical Reviews in Environmental Science and Technology · doi:10.1080/10643389.2019.1565519 · Cited by 123
Bustin, S., & Nolan, T. (2017) · European Journal of Clinical Investigation · doi:10.1111/eci.12801 · Cited by 113
Optimal incentives for collective intelligence
Mann, R. P., & Helbing, D. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1618722114 · Cited by 112
Perverse effects of output-based research funding? Butler’s Australian case revisited
van den Besselaar, P., Heyman, U., & Sandström, U. (2017) · Journal of Informetrics · doi:10.1016/j.joi.2017.05.016 · Cited by 90
Santos, J. M., Horta, H., & Heitor, M. V. (2016) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2015.12.013 · Cited by 86
Shaping the Future of Research: a perspective from junior scientists
McDowell, G. S., Gunsalus, K. T. W., MacKellar, D. C., Mazzilli, S. A., Pai, V. P., Goodwin, P. R., Walsh, E. M., Robinson-Mosher, A., Bowman, T. A., Kraemer, J. A., et al. (2015) · F1000Research · doi:10.12688/f1000research.5878.2 · Cited by 84
Incentivising international publications: institutional policymaking in Chinese higher education
Xu, X., Rose, H., & Oancea, A. (2019) · Studies in Higher Education · doi:10.1080/03075079.2019.1672646 · Cited by 72
Exploring the determinants of research performance for early-career researchers: a literature review
Lee, D. H. (2023) · Scientometrics · doi:10.1007/s11192-023-04868-2 · Cited by 65
A revealed preference analysis of PhD students’ choices over employment outcomes
Conti, A., & Visentin, F. (2015) · Research Policy · doi:10.1016/j.respol.2015.06.009 · Cited by 60
Stephan, P. E. (2013) · BioScience · doi:10.1525/bio.2013.63.4.2 · Cited by 60
Self-citationGanapati, S., & Ritchie, T. S. (2021) · PLoS ONE · doi:10.1371/journal.pone.0260328 · Cited by 58
Cortés-Sánchez, J. D., Guix, M., & Carbonell, K. B. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e07809 · Cited by 57
Факторы результативности научной деятельности: микроуровневый анализ
Fursov, K. S., Roshchina, Y. M., & Balmush, O. (2016) · Foresight-Russia · doi:10.17323/1995-459x.2016.2.44.56 · Cited by 55
Shaping the Future of Research: a perspective from junior scientists
McDowell, G. S., Gunsalus, K. T. W., MacKellar, D. C., Mazzilli, S. A., Pai, V. P., Goodwin, P. R., Walsh, E. M., Robinson-Mosher, A., Bowman, T. A., Kraemer, J. A., et al. (2014) · F1000Research · doi:10.12688/f1000research.5878.1 · Cited by 55
Project selection in NIH: A natural experiment from ARRA
Park, H., Lee, J.-S., & Kim, B. (2015) · Research Policy · doi:10.1016/j.respol.2015.03.004 · Cited by 48
A Quantitative Perspective on Ethics in Large Team Science
Petersen, A. M., Pavlidis, I. T., & Semendeferi, I. (2014) · Science and Engineering Ethics · doi:10.1007/s11948-014-9562-8 · Cited by 47
Open Science by Design: Realizing a Vision for 21st Century Research
(2018) · bepress Legal Repository · Cited by 47
Diversification versus specialization in scientific research: Which strategy pays off?
Abramo, G., D’Angelo, C. A., & Costa, F. D. (2018) · Technovation · doi:10.1016/j.technovation.2018.06.010 · Cited by 42
Ménard, C. B., & Shinton, S. (2022) · PLoS ONE · doi:10.1371/journal.pone.0274486 · Cited by 39
SSH-Impact Pathways And SSH-Integration In EU Research Framework Programmes.
König, T. (2019) · doi:10.22163/fteval.2019.362 · Cited by 37
Values of Economists Matter in the Art and Science of Economics
van Dalen, H. P. (2019) · Kyklos · doi:10.1111/kykl.12208 · Cited by 36
The rise of teamwork and career prospects in academic science
Andalón, M., de Fontenay, C., Ginther, D. K., & Lim, K. (2024) · Nature Biotechnology · doi:10.1038/s41587-024-02351-8 · Cited by 35
Training the scientific workforce: Does funding mechanism matter?
Blume‐Kohout, M. E., & Adhikari, D. (2016) · Research Policy · doi:10.1016/j.respol.2016.03.011 · Cited by 35
Moral attitudes and willingness to enhance and repair cognition with brain stimulation
Medaglia, J. D., Yaden, D. B., Helion, C., & Haslam, M. (2018) · Brain stimulation · doi:10.1016/j.brs.2018.09.014 · Cited by 35
Pre-registration and Results-Free Review in Observational and Qualitative Research
Jacobs, A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.009 · Cited by 34
Larivière, V., & Sugimoto, C. R. (2018) · Les Presses de l'Université de Montréal eBooks · doi:10.1515/9782760639522 · Cited by 32
Are Graduate Students Rational? Evidence from the Market for Biomedical Scientists
Blume‐Kohout, M. E., & Clack, J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0082759 · Cited by 31
Xu, X., Rose, H., McKinley, J., & Zhou, S. (2021) · Applied Linguistics Review · doi:10.1515/applirev-2021-0181 · Cited by 29
Hardy, M. C., Carter, A., & Bowden, N. A. (2016) · Humanities and Social Sciences Communications · doi:10.1057/palcomms.2016.93 · Cited by 29
Faupel‐Badger, J. M., Nelson, D. E., & Izmirlian, G. (2017) · PLoS ONE · doi:10.1371/journal.pone.0169859 · Cited by 28
Santos, J. M., Horta, H., & Li, H. (2022) · Scientometrics · doi:10.1007/s11192-022-04324-7 · Cited by 24
Research independence: drivers and impact on PhD students’ careers
Patsali, S., Pezzoni, M., & Visentin, F. (2024) · Studies in Higher Education · doi:10.1080/03075079.2024.2314584 · Cited by 23
Are scientists a workforce? – Or, how Dr. Frankenstein made biomedical research sick
Lazebnik, Y. A. (2015) · EMBO Reports · doi:10.15252/embr.201541266 · Cited by 23
Gerontocracy, labor market bottlenecks, and generational crises in modern science
Siler, K. (2023) · Science and Public Policy · doi:10.1093/scipol/scad064 · Cited by 21
Impact factor: Mutation, manipulation, and distortion
Juyal, D., Thawani, V., Sayana, A., & Pal, S. (2019) · Journal of Family Medicine and Primary Care · doi:10.4103/jfmpc.jfmpc_515_19 · Cited by 21
Making Research Data Accessible
Kapiszewski, D., & Karcher, S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.008 · Cited by 16
Shifting Minds: A Quantitative Reappraisal of Cognitive-Intervention Research
Moreau, D. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691620950696 · Cited by 16
The sorcerer's postdoc apprentice: uncertain funding and contingent highly skilled labour
Miller, J. M., & Feldman, M. P. (2014) · Cambridge Journal of Regions Economy and Society · doi:10.1093/cjres/rsu003 · Cited by 15
Department Chair Advice on Teaching and Research at U.S. Research Universities
Taggart, G. (2015) · Innovative Higher Education · doi:10.1007/s10755-015-9329-4 · Cited by 15
Escobar-Jiménez, C. (2022) · Revista Andina de Educación · doi:10.32719/26312816.2022.5.2.8 · Cited by 14
He, Y., Yuan, C., Chen, L., Liu, Y., Zhou, H., Xu, N., & Liao, D. J. (2018) · International Journal of Medical Sciences · doi:10.7150/ijms.23215 · Cited by 14
Robertson, A. M. (2022) · Frontiers in Climate · doi:10.3389/fclim.2022.831805 · Cited by 13
The Transformative Nature of Transparency in Research Funding
Mietchen, D. (2014) · PLoS Biology · doi:10.1371/journal.pbio.1002027 · Cited by 13
Civera, A., Meoli, M., & Paleari, S. (2021) · Studies in Higher Education · doi:10.1080/03075079.2021.1896800 · Cited by 12
Building a career planning course for STEM PhDs
Branan, J., Li, X., & Wheeler, R. (2018) · Nature Biotechnology · doi:10.1038/nbt.4312 · Cited by 12
Contributors to the American Sociological Review, 2010
Kaba, A. J. (2015) · Sociology Mind · doi:10.4236/sm.2015.52012 · Cited by 12
Volatility in federal funding of energy R&D
Schuelke‐Leech, B. (2014) · Energy Policy · doi:10.1016/j.enpol.2013.12.057 · Cited by 11
La evaluación de la ciencia y la investigación
Sanz Menéndez, L. (2014) · Revista Española de Sociología · Cited by 11
Researchers in Argentina: Scientific vocation, publication strategies and time‐management tactics
Paepe, J. L. D., Reyes, M. F., Piazza, M., Bella, C. E. D., García-Parisi, P. A., & Straccia, P. H. (2021) · Austral Ecology · doi:10.1111/aec.13055 · Cited by 10
Chasing the academic dream: Biased beliefs and scientific labor markets
Ganguli, I., Gaulé, P., & Čugalj, D. V. (2022) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2022.07.021 · Cited by 10
Epstein, N., & Elhalaby, C. (2023) · International Journal for Educational and Vocational Guidance · doi:10.1007/s10775-023-09580-4 · Cited by 8
Rietdijk, W. J. R., van der Kuy, P. H. M., & den Uil, C. A. (2023) · Learning Health Systems · doi:10.1002/lrh2.10395 · Cited by 8
Epstein, N., Eberle, J., Meuleners, J. S., Lachmann, D., Heuser, S., Herzig, S., Neuhaus, B. J., & Fischer, M. R. (2023) · GMS journal for medical education · doi:10.3205/zma001652 · Cited by 8
Ran, D., Hu, C., & Yang, Z. (2016) · Scientific Reports · doi:10.1038/srep32089 · Cited by 8
Factors to Improve Publication Productivity in Russian Universities
Vasiljeva, M. V., Osipov, G. V., Ponkratov, V. V., Ivlev, V. J., Ivleva, M. I., Карепова, С. Г., Gardanova, Z. R., & Dudnik, O. V. (2021) · Publications · doi:10.3390/publications9020021 · Cited by 8
The Changing Face of Employment at Research Universities
DePaola, T., & Kezar, A. J. (2017) · New Directions for Institutional Research · doi:10.1002/ir.20246 · Cited by 8
The effect on science of government cuts to doctoral scholarships
Rossello, G. (2025) · Studies in Higher Education · doi:10.1080/03075079.2025.2484656 · Cited by 7
Fox, S. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6040124 · Cited by 7
Historias e vidas de libertos em Campinas na segunda metade do seculo XIX
Freire, R. C. X. (1993) · doi:10.47749/t/unicamp.1993.69713 · Cited by 7
Who is Dr. Frankenstein? Or, what Professor Hayek and his friends have done to science
Lazebnik, Y. A. (2018) · Organisms. Journal of Biological Sciences · doi:10.13133/2532-5876_4_ahead1 · Cited by 6
Reliability of Inference: Analogs of Replication in Qualitative Research
Fairfield, T., & Charman, A. E. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.012 · Cited by 6
Gerring, J., Mahoney, J., & Elman, C. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.001 · Cited by 6
Waymire, G. B., & Basu, S. (2021) · Accounting Economics and Law - A Convivium · doi:10.1515/ael-2021-0001 · Cited by 6
dos Santos, V. L. P., Franco, C. R. C., Wagner, R., Silva, C. D., Favretto, G., da Cunha, R. S., Stinghen, A. E. M., Monteiro, L. M., Bussade, J. E., Manfron, J., et al. (2021) · Research Society and Development · doi:10.33448/rsd-v10i4.13289 · Cited by 6
PhDs: Adapt training for developing world
Colebunders, R. (2012) · Nature · doi:10.1038/485041a · Cited by 6
PhDs: Acquired skills good for marketplace
Dohlman, H. G. (2012) · Nature · doi:10.1038/485041b · Cited by 6
Scientific rewards for biomedical specialization are large and persistent
de Rassenfosse, G., Higham, K., & Penner, O. (2022) · BMC Biology · doi:10.1186/s12915-022-01400-5 · Cited by 5
FACTORS IN MANAGING PUBLICATION PRODUCTIVITY IN RUSSIAN UNIVERSITIES
Osipov, G. V., Ponkratov, V. V., Ivlev, V. J., Ivleva, M. I., & Карепова, С. Г. (2020) · Humanities & Social Sciences Reviews · doi:10.18510/hssr.2020.8511 · Cited by 5
Green Finance or Daltonic Finance? The Case of Eolic Energy in Bahia State in Brazil
Marques, F. T., & Rossi, R. A. (2023) · International Journal of Social Ecology and Sustainable Development · doi:10.4018/ijsesd.323658 · Cited by 5
Piston, D. W. (2012) · Nature · doi:10.1038/484440a · Cited by 5
Science as a Social Enterprise
Maiväli, Ü. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-418689-7.00007-7 · Cited by 5
Conti, A., & Liu, C. (2014) · National Bureau of Economic Research · doi:10.3386/w20037 · Cited by 5
Merci: Evaluation Report on the Impact of the ERC Starting Grant Programme
Huber, N., Wegner, A., Neufeld, J., Hornbostel, S., Meuser, M., Küsters, I., Winterhager, M., & Rimmert, C. (2015) · doi:10.22163/fteval.2015.19 · Cited by 5
Proxy failure in academia: More than just another example
Watve, M. (2024) · Behavioral and Brain Sciences · doi:10.1017/s0140525x23002984 · Cited by 4
Schmitt, K. (2024) · IEEE Technology and Society Magazine · doi:10.1109/mts.2024.3402708 · Cited by 4
Replication for Quantitative Research
Freese, J., & Peterson, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.010 · Cited by 4
When is education a disservice?
Rodgers, B. D. (2013) · The FASEB Journal · doi:10.1096/fj.13-235762 · Cited by 4
Yanik, A. A. (2021) · MIR (Modernization Innovation Research) · doi:10.18184/2079-4665.2021.12.3.222-253 · Cited by 4
Valuing Research Output: Evidence from a Chinese University
Wang, Y., Xie, X., & Yang, Y. (2022) · China Economic Review · doi:10.1016/j.chieco.2023.101964 · Cited by 4
Transparency and Reproducibility: Conceptualizing the Problem
Christensen, G., & Miguel, E. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.006 · Cited by 4
Measurement Replication in Qualitative and Quantitative Studies
Reiter, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.011 · Cited by 4
Redman, B. K., & Caplan, A. L. (2015) · Research Ethics · doi:10.1177/1747016115587157 · Cited by 3
Yusuf, N. I., & Riawan Tjandra, W. (2025) · JIL Journal of Indonesian Law · doi:10.18326/jil.v6i1.4159 · Cited by 3
Transparency and Reproducibility: Potential Solutions
Christensen, G., & Miguel, E. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.007 · Cited by 3
Gerring, J., Karcher, S., & Apfeld, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.015 · Cited by 3
Lieberman, E. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.003 · Cited by 3
Research Integrity: International Perspectives
Anderson, M. S., Adam, J. A., & Snyder, S. C. (2016) · Springer eBooks · doi:10.1007/978-981-287-098-8_40 · Cited by 3
Do observations have any role in science policy studies? A reply
van den Besselaar, P., Heyman, U., & Sandström, U. (2017) · Journal of Informetrics · doi:10.1016/j.joi.2017.05.022 · Cited by 3
Metadata
- Authors
- Stephan, P.
- Affiliations
- Georgia State University (US)
- Corresponding author
- Stephan, Paula
- ORCID
- Stephan, Paula
- Venue
- Nature
- Published
- 2012-04-04
- Volume
- 484
- Issue
- 7392
- Pages
- 29-31
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2005834521
- Cited by
- 126
- References
- 5
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 7 · 2023: 12 · 2022: 10 · 2021: 10 · 2020: 22 · 2019: 8 · 2018: 7 · 2017: 10 · 2016: 8 · 2015: 11 · 2014: 8 · 2013: 5 · 2012: 4
- FWCI
- 18.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Research, Science, and Academia
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- perverse incentives, financial incentives, research funding, science policy, research productivity
- MeSH terms
- Academies and Institutes, Workforce, Budgets, Education, Graduate, Faculty, Financial Management, Financing, Organized, Physics, Research, Research Personnel, Research Support as Topic, Universities, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.