Scientific Misconduct and the Myth of Self-Correction in Science
Open accessThe DOI matches its Crossref record; 68 of the 69 references it cites were found in a registry or an index.
Abstract
The recent Stapel fraud case came as a shattering blow to the scientific community of psychologists and damaged both their image in the media and their collective self-esteem. The field responded with suggestions of how fraud could be prevented. However, the Stapel fraud is only one among many cases. Before basing recommendations on one case, it would be informative to study other cases to assess how these frauds were discovered. The authors analyze a convenience sample of fraud cases to see whether (social) psychology is more susceptible to fraud than other disciplines. They also evaluate whether the peer review process and replications work well in practice to detect fraud. There is no evidence that psychology is more vulnerable to fraud than the biomedical sciences, and most frauds are detected through information from whistleblowers with inside information. On the basis of this analysis, the authors suggest a number of strategies that might reduce the risk of scientific fraud.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
10 retracted
Wakefield, A., Murch, S., Anthony, A., Linnell, J., Casson, D., Malik, M., Berelowitz, M., Dhillon, A., Thomson, M., Harvey, P., et al. (1998) · The Lancet · doi:10.1016/s0140-6736(97)11096-0 · Cited by 3,006
RetractedRetracted Science and the Retraction Index
Fang, F. C., & Casadevall, A. (2011) · Infection and Immunity · doi:10.1128/iai.05661-11 · Cited by 405
RetractedBezwoda, W. R., Seymour, L., & Dansey, R. D. (1995) · Journal of Clinical Oncology · doi:10.1200/jco.1995.13.10.2483 · Cited by 400
RetractedAmbipolar Pentacene Field-Effect Transistors and Inverters
Schön, J. H., Berg, S., Kloc, C., & Batlogg, B. (2000) · Science · doi:10.1126/science.287.5455.1022 · Cited by 357
RetractedChandra, R. K. (2001) · Nutrition · doi:10.1016/s0899-9007(01)00610-4 · Cited by 121 · cited 4×
“He also published in the journal Nutrition Research, of which he was editor in chief, an article by Amrit Jain (2002).”
MethodInfluentialRetractedSudbø, J., Lee, J., Lippman, S., Mork, J., Sagen, S., Flatner, N., Ristimaki, A. P., Sudbø, A., Mao, L., Zhou, X. K., et al. (2005) · The Lancet · doi:10.1016/s0140-6736(05)67488-0 · Cited by 78
RetractedField-Effect Modulation of the Conductance of Single Molecules
Schön, J. H., Meng, H. F., & Bao, Z. (2001) · Science · doi:10.1126/science.1066171 · Cited by 76 · cited 1×
“These cases were identified by Simonsohn (2012) through statistical analysis of means and standard deviations in published articles.”
MethodRetractedCoping with Chaos: How Disordered Contexts Promote Stereotyping and Discrimination
Stapel, D. A., & Lindenberg, S. (2011) · Science · doi:10.1126/science.1201068 · Cited by 52
RetractedInfluence of vitamins and trace-elements on the incidence of respiratory infection in the elderly
Jain, A. L. (2002) · Nutrition Research · doi:10.1016/s0271-5317(01)00369-4 · Cited by 33
RetractedDarsee, J. R., & Heymsfield, S. B. (1981) · New England Journal of Medicine · doi:10.1056/nejm198101153040301 · Cited by 31
RetractedAn Integrative Theory of Intergroup Conflict
Tajfel, H., & Turner, J. (2000) · Organizational Identity · doi:10.1093/oso/9780199269464.003.0005 · Cited by 12,487
Psychology of intergroup relations
Austin, W. G., & Worchel, S. (1986) · Medical Entomology and Zoology · Cited by 10,626
Cohen, D. (1998) · The Women's Review of Books · doi:10.2307/4022859 · Cited by 4,261
Instructional manipulation checks: Detecting satisficing to increase statistical power
Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2009.03.009 · Cited by 3,493
Cognitive consequences of forced compliance.
Festinger, L., & Carlsmith, J. M. (1959) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0041593 · Cited by 2,945
Confirmation, disconfirmation, and information in hypothesis testing
Klayman, J., & Ha, Y.-W. (1987) · Psychological Review · doi:10.1037/0033-295x.94.2.211 · Cited by 2,094
Michalos, A. C., & Poff, D. C. (2018) · Encyclopedia of Business and Professional Ethics · doi:10.1007/978-3-319-23514-1_260-2 · Cited by 1,946
Fanelli, D. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005738 · Cited by 1,911 · cited 1×
“According to a meta-analysis of 18 such surveys, nearly 2% of respondents admitted to having fabricated or falsified data at some point (Fanelli, 2009).”
MethodKish-Gephart, J. J., Harrison, D. A., & Treviño, L. K. (2010) · Journal of Applied Psychology · doi:10.1037/a0017103 · Cited by 1,690
Ellemers, N., Kortekaas, P., & Ouwerkerk, J. W. (1999) · European Journal of Social Psychology · doi:10.1002/(sici)1099-0992(199903/05)29:2/3<371::aid-ejsp932>3.0.co;2-u · Cited by 1,452
Self-citationCheating in Academic Institutions: A Decade of Research
McCabe, D. L., Trevino, L. K., & Butterfield, K. D. (2001) · Ethics & Behavior · doi:10.1207/s15327019eb1103_2 · Cited by 1,379
Social categorization and the self-concept: A social cognitive theory of group behavior.
Turner, J. C. (2010) · Cited by 1,376
An Introduction to Social Psychology
McDougall, W. (2015) · Psychology Press eBooks · doi:10.4324/9781315724256 · Cited by 1,037
Effects of group identity on resource use in a simulated commons dilemma.
Kramer, R. M., & Brewer, M. B. (1984) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.46.5.1044 · Cited by 829
FACTORS ASSOCIATED WITH CHEATING AMONG COLLEGE STUDENTS: A Review
Whitley, B. E. (1998) · Research in Higher Education · doi:10.1023/a:1018724900565 · Cited by 782 · cited 1×
“Research on student fraud suggests that social norms toward fraud and perceived moral obligations are strong predictors of fraudulent behavior (e.g., Crown & Spiller, 1998; Whitley, 1998).”
BackgroundIslam and Liberal Democracy: A Historical Overview
Lewis, B. (1996) · Journal of Democracy · doi:10.1353/jod.1996.0030 · Cited by 635
When dissonance fails: On eliminating evaluation apprehension from attitude measurement.
Rosenberg, M. J. (1965) · Journal of Personality and Social Psychology · doi:10.1037/h0021647 · Cited by 465
Decision freedom as a determinant of the role of incentive magnitude in attitude change.
Linder, D. E., Cooper, J., & Jones, E. E. (1967) · Journal of Personality and Social Psychology · doi:10.1037/h0021220 · Cited by 370
Learning from the Literature on Collegiate Cheating: A Review of Empirical Research
Crown, D. F., & Spiller, M. S. (1998) · Journal of Business Ethics · doi:10.1023/a:1017903001888 · Cited by 330
Broad, W., Wade, N., & Armstrong, H. L. (1984) · American Journal of Physics · doi:10.1119/1.13662 · Cited by 239
Just Post It: The Lesson From Two Cases of Fabricated Data Detected by Statistics Alone
Simonsohn, U. (2013) · Psychological Science · doi:10.1177/0956797613480366 · Cited by 216
Not the First Digit! Using Benford's Law to Detect Fraudulent Scientif ic Data
Diekmann, A. (2007) · Journal of Applied Statistics · doi:10.1080/02664760601004940 · Cited by 209 · cited 1×
“However, the development of statistical methods to identify fraudulent data sets will certainly reduce fraud in science by increasing the risk of detection (for other statistical methods of fraud detection, see Diekmann, 2004, 2007).”
MethodEstimates of contingency between two dichotomous variables.
Arkes, H. R., & Harkness, A. R. (1983) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.112.1.117 · Cited by 191
(1974) · American Psychologist · doi:10.1037//0003-066x.29.9.698 · Cited by 169
Scott, W. A. (1974) · American Psychologist · doi:10.1037/h0037631 · Cited by 166 · cited 1×
“epidemiology division of the Norwegian Institute of Public Health, who had realized that the cancer patient base, which Sudbø et al. (2005) claimed to have used in a study published in the Lancet, had not yet been available in 2005 (see http:// en.”
MethodRole of undesired consequences in arousing cognitive dissonance.
Cooper, J., & Worchel, S. (1970) · Journal of Personality and Social Psychology · doi:10.1037/h0029830 · Cited by 163
Kranke, P., Apfel, C. C., & Roewer, N. (2000) · Anesthesia & Analgesia · doi:10.1213/00000539-200004000-00053 · Cited by 156
Psychology’s Woes and a Partial Cure: The Value of Replication
Roediger, H. L., III (2012) · APS observer · Cited by 123
Marsh, H. W., & Ball, S. (1989) · The Journal of Experimental Education · doi:10.1080/00220973.1989.10806503 · Cited by 120 · cited 1×
“Peer review has already come under critique, because low interrater agreement between reviewers of the same manuscript raises doubt about its efficacy in identifying good research (e.g., Daniel, 1993; Marsh & Ball, 1989; Petty, Fleming, & Fabrigar, 1999; W. A. Scott, 1974).”
BackgroundGuardians of Science: Fairness and Reliability of Peer Review
Daniel, H. (1993) · Wiley eBooks · doi:10.1002/3527602208 · Cited by 116
Fujii, Y. (2000) · Anesthesia & Analgesia · doi:10.1213/00000539-200004000-00054 · Cited by 107
An Introduction to Social Psychology
Hewstone, M., Stroebe, W., & Jonas, K. W. (2001) · Zurich Open Repository and Archive (University of Zurich) · Cited by 92
Self-citationCrocker, J., & Cooper, M. L. (2011) · Science · doi:10.1126/science.1216775 · Cited by 84
Lessons from the Pearce affair: handling scientific fraud
Lock, S. (1995) · BMJ · doi:10.1136/bmj.310.6994.1547 · Cited by 75
Culliton, B. J. (1983) · Science · doi:10.1126/science.6828878 · Cited by 73
Goodstein, D. M. (2010) · Princeton University Press eBooks · doi:10.1515/9781400834570 · Cited by 69
Kranke, P., Apfel, C. C., Eberhart, L. H., Georgieff, M., & Roewer, N. (2001) · Acta Anaesthesiologica Scandinavica · doi:10.1034/j.1399-6576.2001.045006659.x · Cited by 62
The Review Process at PSPB: Correlates of Interreviewer Agreement and Manuscript Acceptance
Petty, R. E., Fleming, M. A., & Fabrigar, L. R. (1999) · Personality and Social Psychology Bulletin · doi:10.1177/0146167299025002005 · Cited by 61
Irreproducible Experimental Results: Causes, (Mis)interpretations, and Consequences
Loscalzo, J. (2012) · Circulation · doi:10.1161/circulationaha.112.098244 · Cited by 59
de Vos, S., Brach, M. A., Budnik, A., Grewe, M., Herrmann, F., & Krutmann, J. (1994) · Journal of Investigative Dermatology · doi:10.1111/1523-1747.ep12391818 · Cited by 58
Daniel, H.-D., & Bederson, B. (1993) · Physics Today · doi:10.1063/1.2808608 · Cited by 49
Couzin, J. (2006) · Science · doi:10.1126/science.313.5791.1222 · Cited by 48
A Review of the Types of Scientific Misconduct in Biomedical Research
Kumar, M. N. (2008) · Journal of Academic Ethics · doi:10.1007/s10805-008-9068-6 · Cited by 46 · cited 2×
“and is suspected to have been Chandra himself (Kumar, 2008).”
BackgroundMethodEuropean Bulletin of Social Psychology
Classen, S., de Lemus, S., Iatridis, T., Muldoon, O. T., Naughton, C., & Walsh, S. (2012) · Cited by 43
Just Post It: The Lesson from Two Cases of Fabricated Data Detected by Statistics AlonePreprint
Simonsohn, U. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2114571 · Cited by 43
The evolution of the "scientific misconduct" issue: An historical overview.
LaFollette, M. C. (2000) · PubMed · doi:10.1177/153537020022400405 · Cited by 41
Woo Suk Hwang convicted, but not of fraud
Cyranoski, D. (2009) · Nature · doi:10.1038/4611181a · Cited by 30
Biologist spared jail for grant fraud
Reich, E. S. (2011) · Nature · doi:10.1038/474552a · Cited by 13 · cited 1×
“In a similar case, in 1997 a neuroimmunologist at Queen Mary University of London e-mailed concerns to the editor of the Journal of Experimental Medicine about a manipulated figure in one of the articles of Luk van Parijs that the journal had published (Reich, 2011).”
BackgroundStopping the rot in nutrition science
Margetts, B. (2006) · Public Health Nutrition · doi:10.1079/phn2006947 · Cited by 11 · cited 3×
“…loss among the aged to the British Medical Journal, a reviewer rejected it, because it showed all the hallmarks of having been completely invented (Margetts, 2006).4 At that time, Chandra was an eminent nutrition researcher, editor in chief of the international journal Nutrition Research and…”
BackgroundUncertainty shrouds psychologist's resignation
Yong, E. (2012) · Nature · doi:10.1038/nature.2012.10968 · Cited by 11 · cited 8×
“Sanna’s work was investigated by a committee at the University of North Carolina (his previous employer, where the alleged fraud had been committed).”
BackgroundInfluentialOn the hazards of whistleblowers and on some problems of young biomedical scientists in our time
Edsall, J. T. (1995) · Science and Engineering Ethics · doi:10.1007/bf02583249 · Cited by 10 · cited 1×
“Sprague had realized that it would have been physically impossible for Breuning to have conducted the experiments he claimed to have done (Edsall, 1995).”
BackgroundSCHULZ, W. G. (2011) · Chemical & Engineering News · doi:10.1021/cen-v089n032.p040 · Cited by 7
Final findings of scientific misconduct.
(1993) · PubMed Central · Cited by 6
Despite Occasional Scandals, Science Can Police Itself
Kraut, A. (2012) · PsycEXTRA Dataset · doi:10.1037/e556442013-008 · Cited by 5
Cyranoski, D. (2009) · Nature · doi:10.1038/4611035a · Cited by 3
Fraud case we might have seen coming
Reich, E. S. (2011) · Nature · doi:10.1038/news.2011.437 · Cited by 2 · cited 1×
“In a similar case, in 1997 a neuroimmunologist at Queen Mary University of London e-mailed concerns to the editor of the Journal of Experimental Medicine about a manipulated figure in one of the articles of Luk van Parijs that the journal had published (Reich, 2011).”
BackgroundGerman research centre widens misconduct probe
Schiermeier, Q. (2010) · Nature · doi:10.1038/news.2010.671 · Cited by 2 · cited 3×
“However, the committee also concluded that as supervisor of the pair, Bulfone-Paus bore “substantial responsibility” (Schiermeier, 2010).”
BackgroundMethodInfluentialPotential Fraud in Fig 2: JID 103:92–96, 1994
Herrmann, F. (2003) · Journal of Investigative Dermatology · doi:10.1038/sj.jid.5601896 · Cited by 1 · cited 1×
“Unfortunately, I don’t know how to reach Prof. Brach” (Herrmann, 2003).”
Background
Research works printed but not linked: 16
- 10.1037/0096-3445.112.1.117 · doi:10.1037/0096-3445.112.1.117 · Paper page
- Bezwoda W. R., 1995, Journal of Oncology, 13, 2483
- Committee on Publication Ethics. (2012). Code of conduct and best practice guidelines for journal editors. Retrieved from http://publicationethics.org/files/Code_of_conduct_for_journal_editors_Mar11.pdf
- Diekmann A., 2004, Jahrbuch der Deutschen Akademie der Naturforscher Leopoldina (Halle/Saale), LEOPOLDINA (R. 3), 49, 1
- Erasmus University of Rotterdam. (2012, June 1). Report by the committee for inquiry into scientific integrity. Retrieved from http://www.eur.nl/fileadmin/ASSETS/press/2012/Juli/report_Committee_for_inquiry_prof._Smeesters.publicversion.28_6_2012.pdf
- 10.1038/sj.jid.56011896 · doi:10.1038/sj.jid.56011896
- 10.1016/S0271-531(01)00369-4 · doi:10.1016/s0271-531(01)00369-4
- Keulemans M. (2012b, June 1). Diederik Stapel pleegde al fraude tijdens promotie in Amsterdam [Diederik Stapel already committed fraud during his dissertation in Amsterdam]. De Volkskrant. Retrieved from http://www.volkskrant.nl/vk/nl/2844/Archief/archief/article/detail/3264084/2012/06/01/Diederik-Stapel-pleegde-al-fraude-tijdens-promotie-in-Amsterdam.dhtml
- 10.1037/0022-3514.46.5.1044 · doi:10.1037/0022-3514.46.5.1044 · Paper page
- 10.1079/PHN206947 · doi:10.1079/phn206947
- Office of Research Integrity, 2001, Office of Research Integrity Annual Report 2001: Findings of scientific misconduct
- Reich E. S., 2009, Plastic fantastic
- Schulz W. G., 2011, Science & Technology, 89, 40
- Stafford N. (2010). China: Act on scientific fraud. Chemistry World. Retrieved from http://www.rsc.org/chemistryworld/News/2010/January/15011003.asp
- 10.1002/(SICI)1099-0992(199903/05)29:2/3<397::AID-EJSP936>3.0.CO;2-6 · doi:10.1002/(sici)1099-0992(199903/05)29:2/3<397::aid-ejsp936>3.0.co;2-6
- Turner J. C., 1985, Advances in group processes: Theory and research, 77
Cited by
Pashler, H., & Wagenmakers, E. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612465253 · Cited by 1,321
Edwards, M. A., & Roy, S. (2017) · Environmental Engineering Science · doi:10.1089/ees.2016.0223 · Cited by 688
“…on an unen-forceable and unwritten honor system, in relation to what is considered fair in reporting research, grant writing practices, and ‘‘selling’’ research ideas, and there is serious doubt as to whether science as a whole can actually be considered self-correcting (Stroebe et al. , 2012).”
The alleged crisis and the illusion of exact replication
Stroebe, W., & Strack, F. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691613514450 · Cited by 597
“In a recent article, Stroebe, Postmes, and Spears (2012) analyzed 40 fraud cases to identify the way by which the fraud had been detected.”
BackgroundSelf-citationPromoting Transparency in Social Science Research
Miguel, E., Camerer, C., Casey, K., Cohen, J., Esterling, K. M., Gerber, A., Glennerster, R., Green, D. P., Humphreys, M., Imbens, G., et al. (2014) · Science · doi:10.1126/science.1245317 · Cited by 540
Replication, falsification, and the crisis of confidence in social psychology
Earp, B. D., & Trafimow, D. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00621 · Cited by 472
“Should some observations be excluded?”
Background
Metadata
- Authors
- Stroebe, W., Postmes, T., & Spears, R.
- Affiliations
- University of Groningen (NL)
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2012-11
- Volume
- 7
- Issue
- 6
- Pages
- 670-688
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W2155439155
- Cited by
- 323
- References
- 69
- Citations by year
- 2026: 9 · 2025: 14 · 2024: 14 · 2023: 35 · 2022: 24 · 2021: 31 · 2020: 45 · 2019: 36 · 2018: 20 · 2017: 19 · 2016: 23 · 2015: 23 · 2014: 17 · 2013: 9 · 2012: 3
- FWCI
- 43.24
- Type
- journal article
- Language
- en
- Open access
- green
- research.rug.nl
- Licence
- other-oa
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Perspectives on Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (publishedVersion, other-oa)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, other-oa)
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Physical Sciences › Mathematics › Statistics and Probability › Benford’s Law and Fraud Detection
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- research misconduct, scientific fraud, fraud detection, peer review, replication, whistleblowers, fraud prevention
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.