Prevalence of questionable research practices, research misconduct and their potential explanatory factors: A survey among academic researchers in The Netherlands.
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Prevalence of research misconduct, questionable research practices (QRPs) and their associations with a range of explanatory factors has not been studied sufficiently among academic researchers. The National Survey on Research Integrity targeted all disciplinary fields and academic ranks in the Netherlands. It included questions about engagement in fabrication, falsification and 11 QRPs over the previous three years, and 12 explanatory factor scales. We ensured strict identity protection and used the randomized response method for questions on research misconduct. 6,813 respondents completed the survey. Prevalence of fabrication was 4.3% (95% CI: 2.9, 5.7) and of falsification 4.2% (95% CI: 2.8, 5.6). Prevalence of QRPs ranged from 0.6% (95% CI: 0.5, 0.9) to 17.5% (95% CI: 16.4, 18.7) with 51.3% (95% CI: 50.1, 52.5) of respondents engaging frequently in at least one QRP. Being a PhD candidate or junior researcher increased the odds of frequently engaging in at least one QRP, as did being male. Scientific norm subscription (odds ratio (OR) 0.79; 95% CI: 0.63, 1.00) and perceived likelihood of detection by reviewers (OR 0.62, 95% CI: 0.44, 0.88) were associated with engaging in less research misconduct. Publication pressure was associated with more often engaging in one or more QRPs frequently (OR 1.22, 95% CI: 1.14, 1.30). We found higher prevalence of misconduct than earlier surveys. Our results suggest that greater emphasis on scientific norm subscription, strengthening reviewers in their role as gatekeepers of research quality and curbing the “publish or perish” incentive system promotes research integrity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Research fraud may be increasing due to fierce competition for funding and promotion that often depend on publication counts. 36”
From Automated detection of over- and under-dispersion in baseline tables in randomised controlled trials. (2022) · cites this paper as [36]
Experimental — accuracy not yet measuredIn the citing paper
“In the Netherlands, surveys about research integrity have shown that 'more than half of Dutch scientists regularly engage in questionable research practices … and one in 12 admitted to committing a more serious form of research misconduct within the past 3 years: the fabrication or falsification of research results'.52,53”
From Integrity of randomized clinical trials: Performance of integrity tests and checklists requires assessment (2023) · cites this paper as [53]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
(2010) · University of Twente Research Information · Cited by 6,037
Fanelli, D. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005738 · Cited by 1,911 · cited 9×
“Our research integrity survey among academics across all disciplinary fields and ranks is one of the largest worldwide [9, 10].”
BackgroundMethodResultInfluentialStrong Evidence for Gender Differences in Risk Taking
Charness, G., & Gneezy, U. (2012) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2011.06.007 · Cited by 1,357
The Sociology of Science. Theoretical and Empirical Investigations
Namer, G., Merton, R. K., Storer, N. W., & Namer, G. (1975) · Revue Française de Sociologie · doi:10.2307/3321144 · Cited by 1,305
Missing-Data Adjustments in Large Surveys
Little, R. J. A. (1988) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1988.10509663 · Cited by 1,101 · cited 1×
“Fifty complete data sets were generated by imputing the missing values using predictive mean matching [35, 36].”
MethodReproducibility and Replicability in Science
Committee on Reproducibility and Replicability in Science, Board on Behavioral, C., Committee on National Statistics, Education, D. O. B. A. S. S. A., Nuclear and Radiation Studies Board, Studies, D. O. E. A. L., Board on Mathematical Sciences and Analytics, Committee on Applied and Theoretical Statistics, Sciences, D. O. E. A. P., Board on Research Data and Information, et al. (2019) · doi:10.17226/25303 · Cited by 924
Statistical Matching Using File Concatenation With Adjusted Weights and Multiple Imputations
Rubin, D. B. (1986) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1986.10509497 · Cited by 551 · cited 1×
“Fifty complete data sets were generated by imputing the missing values using predictive mean matching [35, 36].”
MethodThe Hong Kong Principles for assessing researchers: Fostering research integrity
Moher, D., Bouter, L., Kleinert, S., Glasziou, P., Sham, M. H., Barbour, V., Coriat, A.-M., Foeger, N., & Dirnagl, U. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000737 · Cited by 540 · cited 2×
“A safe and supportive learning environment with adequate supervision is increasingly recognized as key in this regard [38].”
BackgroundResultSelf-citationMeta-Analysis of Randomized Response Research: Thirty-Five Years of Validation
Lensvelt-Mulders, G. J. L. M., Hox, J. J., van der Heijden, P. G. M., & Maas, C. J. M. (2005) · Sociological Methods & Research · doi:10.1177/0049124104268664 · Cited by 382 · cited 4×
“The NSRI is the largest research integrity survey in academia to-date that has looked at not only prevalence of QRPs and FF but also at the largest range of possible explanatory factors in one single study across all disciplinary fields and academic ranks using the RR technique [19].”
BackgroundMethodInfluentialAsking sensitive questions indirectly
KUK, A. Y. C. (1990) · Biometrika · doi:10.1093/biomet/77.2.436 · Cited by 292
Anderson, M. S., Horn, A. S., Risbey, K. R., Ronning, E. A., De Vries, R., & Martinson, B. C. (2007) · Academic Medicine · doi:10.1097/acm.0b013e31812f764c · Cited by 269 · cited 3×
“Nevertheless, we believe our results to be valid as our main findings align well with the findings of other research integrity surveys [13, 16, 28, 31, 32].”
BackgroundResultNormal Misbehavior: Scientists Talk about the Ethics of Research
De Vries, R., Anderson, M. S., & Martinson, B. C. (2006) · Journal of Empirical Research on Human Research Ethics · doi:10.1525/jer.2006.1.1.43 · Cited by 254
Bouter, L. M., Tijdink, J., Axelsen, N., Martinson, B. C., & ter Riet, G. (2016) · Research Integrity and Peer Review · doi:10.1186/s41073-016-0024-5 · Cited by 211 · cited 1×
“The 11 QRPs were adapted from a recent study where 60% of the surveyed participants came from the biomedical disciplinary field [24].”
MethodSelf-citationNormative Dissonance in Science: Results from a National Survey of U.S. Scientists
Anderson, M. S., Martinson, B. C., & De Vries, R. (2007) · Journal of Empirical Research on Human Research Ethics · doi:10.1525/jer.2007.2.4.3 · Cited by 208 · cited 2×
“Nevertheless, we believe our results to be valid as our main findings align well with the findings of other research integrity surveys [13, 16, 28, 31, 32].”
BackgroundResultXie, Y., Wang, K., & Kong, Y. (2021) · Science and Engineering Ethics · doi:10.1007/s11948-021-00314-9 · Cited by 205 · cited 9×
“Our research integrity survey among academics across all disciplinary fields and ranks is one of the largest worldwide [9, 10].”
BackgroundMethodResultInfluentialCognitive Interviewing Methodology
(2014) · Wiley eBooks · doi:10.1002/9781118838860 · Cited by 191 · cited 3×
“Our findings on the discrepancy between subscription to scientific norms espoused by respondents and their perceived adherence to such norms by their peers corroborate earlier findings in a study among 3600 researchers in the USA [15, 16].”
MethodResultExtending the Mertonian Norms: Scientists' Subscription to Norms of Research
Anderson, M. S., Ronning, E. A., Vries, R. D., & Martinson, B. C. (2010) · The Journal of Higher Education · doi:10.1080/00221546.2010.11779057 · Cited by 184
Research integrity: nine ways to move from talk to walk
Mejlgaard, N., Bouter, L. M., Gaskell, G., Kavouras, P., Allum, N., Bendtsen, A.-K., Charitidis, C. A., Claesen, N., Dierickx, K., Domaradzka, A., et al. (2020) · Nature · doi:10.1038/d41586-020-02847-8 · Cited by 134 · cited 1×
“After several major cases of misconduct [4], the global research community is converging to a common view on ways to foster research integrity [5].”
BackgroundSelf-citationExtending the Mertonian Norms: Scientists' Subscription to Norms of Research
Anderson, M. S., Ronning, E. A., Vries, R. G. D., et al. (2010) · The Journal of Higher Education · doi:10.1353/jhe.0.0095 · Cited by 109
The Importance of Organizational Justice in Ensuring Research Integrity
Martinson, B. C., Crain, A. L., De Vries, R., & Anderson, M. S. (2010) · Journal of Empirical Research on Human Research Ethics · doi:10.1525/jer.2010.5.3.67 · Cited by 105 · cited 4×
“Nevertheless, we believe our results to be valid as our main findings align well with the findings of other research integrity surveys [13, 16, 28, 31, 32].”
BackgroundResultInfluentialAcademic economists behaving badly? A survey on three areas of unethical behavior
List, J., Bailey, C., Euzent, P., & Martin, T. (2001) · Economic Inquiry · doi:10.1111/j.1465-7295.2001.tb00058.x · Cited by 102 · cited 1×
“These numbers are concerning and only comparable to one other smaller study (n = 140) that also used the RR technique [41].”
ResultHaven, T. L., Tijdink, J. K., Martinson, B. C., & Bouter, L. M. (2019) · PLoS ONE · doi:10.1371/journal.pone.0210599 · Cited by 95
Self-citationMales Are Overrepresented among Life Science Researchers Committing Scientific Misconduct
Fang, F. C., Bennett, J. W., & Casadevall, A. (2013) · mBio · doi:10.1128/mbio.00640-12 · Cited by 92 · cited 1×
“Our finding that identifying as male is associated with higher odds of any frequent QRP and higher overall mean QRP agrees with findings by others [39, 40].”
ResultPsychology must learn a lesson from fraud case
Wicherts, J. M. (2011) · Nature · doi:10.1038/480007a · Cited by 86 · cited 3×
“Nevertheless, we believe our results to be valid as our main findings align well with the findings of other research integrity surveys [13, 16, 28, 31, 32].”
BackgroundResultSelf-citationResponsible Science: Ensuring the Integrity of the Research Process
Arrison, T. (2014) · doi:10.2172/1126508 · Cited by 81
Academic economists behaving badly? A survey on three areas of unethical behavior
List, J. (2001) · Economic Inquiry · doi:10.1093/ei/39.1.162 · Cited by 75
Navarro, M. L. A., Mas, M. D. L. M. B., & Jiménez, A. M. L. (2010) · The Spanish Journal of Psychology · doi:10.1017/s1138741600003863 · Cited by 65
Advancing science or advancing careers? Researchers’ opinions on success indicators
Aubert Bonn, N., & Pinxten, W. (2021) · PLOS ONE · doi:10.1371/journal.pone.0243664 · Cited by 54
Haven, T. L., de Goede, M., Tijdink, J. K., & Oort, F. J. (2019) · Research Integrity and Peer Review · doi:10.1186/s41073-019-0066-6 · Cited by 43
Ten Simple Rules for Protecting Research Integrity
Shaw, D., & Erren, T. C. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004388 · Cited by 39
The Analysis of Randomized Response Sum Score Variables
Cruyff, M., van den Hout, A., & van der Heijden, P. G. M. (2007) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2007.00624.x · Cited by 23 · cited 1×
“The associations of these three outcomes with the five background characteristics (S1 Table) and the explanatory factor scales (Table 1) were investigated with multiple (i) linear regression, (ii) binary logistic regression and (iii) ordinal logistic regression, respectively [17].”
MethodGopalakrishna, G., Wicherts, J. M., Vink, G., Stoop, I. A. L., van den Akker, O. R., ter Riet, G., & Bouter, L. M. (2021) · doi:10.31222/osf.io/xsn94 · Cited by 15 · cited 1×
“Elsewhere [20], we report on our findings on RRPs and their postulated explanatory factors.”
BackgroundSelf-citation
Research works printed but not linked: 5
- IAP—the Global Network of Science Academies, 2016, Doing global science: a guide to responsible conduct in the global research enterprise
- Levelt Committee, Noort Committee, Drenth Committee, 2012, Final report.
- M. Hiney, 2015, Research integrity: what it means, why it is important and how we might protect it, Science Europe
- Committee on Responsible Science, Committee on Science Engineering Medicine and Public Policy, Policy and Global Affairs, Washington, DC: National Academies of Sciences Engineering and Medicine. Fostering integrity in research: The National Academies Press; 2017.
- W Revelle, 2020, Package ‘psych’. psych: procedures for psychological, psychometric, and personality research
Cited by
Protecting against researcher bias in secondary data analysis: challenges and potential solutions
Baldwin, J. R., Pingault, J.-B., Schoeler, T., Sallis, H. M., & Munafò, M. R. (2022) · European Journal of Epidemiology · doi:10.1007/s10654-021-00839-0 · Cited by 178
“Under a system that rewards novel and statistically significant findings, it is easy for subconscious human biases to lead to QRPs.”
BackgroundInfluentialEvidence of questionable research practices in clinical prediction models
White, N. M., Parsons, R., Collins, G. S., & Barnett, A. G. (2023) · BMC Medicine · doi:10.1186/s12916-023-03048-6 · Cited by 189
“A survey of Dutch researchers reported 8% admitted to fal-sifying or manipulating data [59].”
BackgroundBig little lies: a compendium and simulation of p-hacking strategies
Stefan, A., & Schönbrodt, F. (2023) · Royal Society Open Science · doi:10.1098/rsos.220346 · Cited by 154
Isbell, D. R., BROWN, D., Chen, M., Derrick, D. J., Ghanem, R., Arvizu, M. N. G., Schnur, E., Zhang, M., & Plonsky, L. (2022) · Modern Language Journal · doi:10.1111/modl.12760 · Cited by 113
Mesquida, C., Murphy, J., Lakens, D., & Warne, J. P. (2022) · Royal Society Open Science · doi:10.1098/rsos.220946 · Cited by 116
Metadata
- Authors
- Gopalakrishna, G., ter Riet, G., Vink, G., Stoop, I., Wicherts, J. M., & Bouter, L. M.
- Affiliations
- Amsterdam University Medical Centers (NL)
- Utrecht University (NL)
- Netherlands Institute for Social Research (NL)
- Tilburg University (NL)
- Corresponding author
- Gopalakrishna, Gowri
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2022-02-16
- Volume
- 17
- Issue
- 2
- Pages
- e0263023
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC8849616
- OpenAlex
- W4212845006
- Cited by
- 296
- References
- 32
- Citations by year
- 2026: 49 · 2025: 44 · 2024: 75 · 2023: 59 · 2022: 61
- FWCI
- 69.39
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- Research portal (Tilburg University) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion, other-oa)
- VU Research Portal (publishedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Pure Amsterdam UMC (submittedVersion, cc-by)
- MetArXiv (OSF Preprints) (submittedVersion)
- MetArXiv (OSF Preprints) (submittedVersion, public-domain)
- Utrecht University Repository (Utrecht University) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- ZonMw (20-22600-98-401)
- H2020 European Research Council (726361)
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Mathematics › Statistics and Probability › Benford’s Law and Fraud Detection
- Keywords
- questionable research practices, research misconduct, fabrication, falsification, research integrity, publication pressure, publish or perish, peer review, academic researchers, doctoral students, gender differences
- MeSH terms
- Cross-Sectional Studies, Female, Humans, Male, Surveys and Questionnaires, Research Design, Research Personnel, Scientific Misconduct, Prevalence, Ethics, Research, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

