Detecting fabrication in large-scale molecular omics data
Open accessPublished version of a preprint
The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Fraud is a pervasive problem and can occur as fabrication, falsification, plagiarism, or theft. The scientific community is not exempt from this universal problem and several studies have recently been caught manipulating or fabricating data. Current measures to prevent and deter scientific misconduct come in the form of the peer-review process and on-site clinical trial auditors. As recent advances in high-throughput omics technologies have moved biology into the realm of big-data, fraud detection methods must be updated for sophisticated computational fraud. In the financial sector, machine learning and digit-frequencies are successfully used to detect fraud. Drawing from these sources, we develop methods of fabrication detection in biomedical research and show that machine learning can be used to detect fraud in large-scale omic experiments. Using the gene copy-number data as input, machine learning models correctly predicted fraud with 58–100% accuracy. With digit frequency as input features, the models detected fraud with 82%-100% accuracy. All of the data and analysis scripts used in this project are available at https://github.com/MSBradshaw/FakeData .
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“In contrast to the fabrication of genome-wide research that has been estimated to require similar effort as the acquisition of genuine data (74), targeted gene research is easier to fabricate than to produce through genuine effort (27,38) (Figure 2).”
From Protection of the human gene research literature from contract cheating organizations known as research paper mills (2022) · cites this paper as [74]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016 · cited 1×
“Sticking to models included in SciKit Learn [26] with a common interface increased code reusability and allowed for quick and consistent comparison.”
MethodWickham, H., Averick, M., Bryan, J., Chang, W., McGowan, L., François, R., Grolemund, G., Hayes, A., Henry, L., Hester, J., et al. (2019) · Journal of Open Source Software · doi:10.21105/joss.01686 · Cited by 22,138 · cited 1×
“For general computing, data manipulation, and file input output we used several packages from the tidy-verse: [33] readr , tibble , and dplyr .”
MethodData Structures for Statistical Computing in Python
McKinney, W. (2010) · Proceedings of the Python in Science Conference · doi:10.25080/majora-92bf1922-00a · Cited by 11,032 · cited 1×
“3 was used for all reading and writing of files [34].”
MethodThe UK Biobank resource with deep phenotyping and genomic data
Bycroft, C., Freeman, C., Petkova, D., Band, G., Elliott, L. T., Sharp, K., Motyer, A., Vukcevic, D., Delaneau, O., O’Connell, J., et al. (2018) · Nature · doi:10.1038/s41586-018-0579-z · Cited by 8,876 · cited 1×
“Many diseases are now characterized in populations, with thousands of individuals 40 characterized for cancer [7], diabetes [8] , bone strength [9], and health care services for the 41 general populace [10].”
BackgroundThe Cancer Cell Line Encyclopedia enables predictive modelling of anticancer drug sensitivity
Barretina, J., Caponigro, G., Stransky, N., Venkatesan, K., Margolin, A. A., Kim, S., Wilson, C. J., Lehár, J., Kryukov, G. V., Sonkin, D., et al. (2012) · Nature · doi:10.1038/nature11003 · Cited by 7,950 · cited 1×
“Large-scale characterization studies are also done for cell lines and drug 42 responses [11,12].”
BackgroundMultidimensional binary search trees used for associative searching
Bentley, J. L. (1975) · Communications of the ACM · doi:10.1145/361002.361007 · Cited by 7,520 · cited 1×
“K-Nearest Neighbor (KNN): [30] this does not perform any learning per-se, but classifies based on proximity to labeled training data.”
BackgroundFriedman, J. H. (2002) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(01)00065-2 · Cited by 7,067 · cited 1×
“Gradient boosting (GBC): [27] an ensemble method based on the creation of many weak decision trees (shallow trees, sometimes containing only 2 leaf nodes).”
MethodMissForest—Non-parametric missing value imputation for mixed-type data
Stekhoven, D. J., & Bühlmann, P. (2012) · Bioinformatics · doi:10.1093/bioinformatics/btr597 · Cited by 6,156 · cited 1×
“The R package missForrest [23] was repurposed for data fabrication.”
MethodProceedings of the American philosophical society
(1838) · Journal of the Franklin Institute · doi:10.1016/s0016-0032(38)92229-x · Cited by 5,524
A Next Generation Connectivity Map: L1000 Platform and the First 1,000,000 Profiles
Subramanian, A., Narayan, R., Corsello, S. M., Peck, D. D., Natoli, T. E., Lu, X., Gould, J., Davis, J. F., Tubelli, A. A., Asiedu, J. K., et al. (2017) · Cell · doi:10.1016/j.cell.2017.10.049 · Cited by 3,515
(1999) · doi:10.1162/089976600300015565 · Cited by 2,799 · cited 1×
“Support Vector Machine (SVM): [31] is a statistical based learning method that operates by trying to maximize the size of the gap between classification categories.”
MethodMachine learning for neuroimaging with scikit-learn
Abraham, A., Pedregosa, F., Eickenberg, M., Gervais, P., Mueller, A., Kossaifi, J., Gramfort, A., Thirion, B., & Varoquaux, G. (2014) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2014.00014 · Cited by 2,384
Fanelli, D. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005738 · Cited by 1,911 · cited 2×
“colleagues had fabricated data, positive response rates rose to 14-19% [4,5].”
BackgroundThe Optimality of Naive Bayes.
Zhang, H. (2004) · Cited by 1,550
Orwoll, E., Blank, J. B., Barrett-Connor, E., Cauley, J., Cummings, S., Ensrud, K., Lewis, C., Cawthon, P. M., Marcus, R., Marshall, L. M., et al. (2005) · Contemporary Clinical Trials · doi:10.1016/j.cct.2005.05.006 · Cited by 765
SnapShot: TCGA-Analyzed Tumors
Blum, A., Wang, P., & Zenklusen, J. C. (2018) · Cell · doi:10.1016/j.cell.2018.03.059 · Cited by 746 · cited 1×
“Many diseases are now characterized in populations, with thousands of individuals characterized for cancer [7], diabetes [8], bone strength [9], and health care services for the general populace [10].”
BackgroundProteogenomic Characterization of Endometrial Carcinoma
Dou, Y., Kawaler, E. A., Cui Zhou, D., Gritsenko, M. A., Huang, C., Blumenberg, L., Karpova, A., Petyuk, V. A., Savage, S. R., Satpathy, S., et al. (2020) · Cell · doi:10.1016/j.cell.2020.01.026 · Cited by 485 · cited 1×
“The data used in this study comes from the Clinical Proteomic Tumor Analysis Consortium (CPTAC) cohort for endometrial carcinoma, which contains copy number alteration (CNA) measurements from 100 tumor samples [23, 24].”
MethodSelf-citationThe Environmental Determinants of Diabetes in the Young (TEDDY) study: study design
The TEDDY Study Group (2007) · Pediatric Diabetes · doi:10.1111/j.1399-5448.2007.00269.x · Cited by 361
The Prevalence of Inappropriate Image Duplication in Biomedical Research Publications
Bik, E. M., Casadevall, A., & Fang, F. C. (2016) · mBio · doi:10.1128/mbio.00809-16 · Cited by 287
Ensuring trial validity by data quality assurance and diversification of monitoring methods
Baigent, C., Harrell, F. E., Buyse, M., Emberson, J. R., & Altman, D. G. (2008) · Clinical Trials · doi:10.1177/1740774507087554 · Cited by 163 · cited 3×
“The emerging data deluge challenges the effectiveness of traditional auditing practices to 51 detect fraud, and several studies have suggested addressing the issue with improved 52 centralized and independent statistical monitoring [5,6,16,18].”
BackgroundAre these data real? Statistical methods for the detection of data fabrication in clinical trials
Al-Marzouki, S., Evans, S., Marshall, T., & Roberts, I. (2005) · BMJ · doi:10.1136/bmj.331.7511.267 · Cited by 131 · cited 3×
“Benford’s Law or the first digit law has been instrumental at catching fraud in various financial 126 situations [20,21] and in small scale clinical trials [3].”
BackgroundData fraud in clinical trials.
George, S. L., & Buyse, M. (2015) · Clinical Investigation · doi:10.4155/cli.14.116 · Cited by 126
Research misconduct and data fraud in clinical trials: prevalence and causal factors
George, S. L. (2015) · International Journal of Clinical Oncology · doi:10.1007/s10147-015-0887-3 · Cited by 95 · cited 1×
“We do not attempt 76 to explain why someone may choose to fabricate their data - as other study have done [6,22]; 77 our only goal is to evaluate the utility of digit-frequencies to differentiate real from fake data.”
BackgroundMonitoring the quality of conduct of clinical trials: a survey of current practices
Morrison, B. W., Cochran, C. J., White, J. G., Harley, J., Kleppinger, C. F., Liu, A., Mitchel, J. T., Nickerson, D. F., Zacharias, C. R., Kramer, J. M., et al. (2011) · Clinical Trials · doi:10.1177/1740774511402703 · Cited by 88
Badal-Valero, E., Álvarez-Jareño, J. A., & Pavía, J. M. (2017) · Forensic Science International · doi:10.1016/j.forsciint.2017.11.008 · Cited by 74
Newcomb–Benford law and the detection of frauds in international trade
Cerioli, A., Barabesi, L., Cerasa, A., Menegatti, M., & Perrotta, D. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806617115 · Cited by 69 · cited 2×
“Benford’s Law or the first digit law has been instrumental at catching fraud in various financial 126 situations [20,21] and in small scale clinical trials [3].”
BackgroundMethodRecommendations for data monitoring committees from the Clinical Trials Transformation Initiative
Calis, K. A., Archdeacon, P., Bain, R., DeMets, D., Donohue, M., Elzarrad, M. K., Forrest, A., McEachern, J., Pencina, M. J., Perlmutter, J., et al. (2017) · Clinical Trials · doi:10.1177/1740774517707743 · Cited by 58 · cited 2×
“The emerging data deluge challenges the effectiveness of traditional auditing practices to 51 detect fraud, and several studies have suggested addressing the issue with improved 52 centralized and independent statistical monitoring [5,6,16,18].”
BackgroundCaggiano, A., Angelone, R., Napolitano, F., Nele, L., & Teti, R. (2018) · Procedia CIRP · doi:10.1016/j.procir.2018.09.072 · Cited by 54
Simplified and Unified Access to Cancer Proteogenomic Data
Lindgren, C. M., Adams, D. W., Kimball, B., Boekweg, H., Tayler, S., Pugh, S. L., & Payne, S. H. (2021) · Journal of Proteome Research · doi:10.1021/acs.jproteome.0c00919 · Cited by 40 · cited 1×
“The data used in this study comes from the Clinical Proteomic Tumor Analysis Consortium (CPTAC) cohort for endometrial carcinoma, which contains copy number alteration (CNA) measurements from 100 tumor samples [23, 24].”
MethodSelf-citationYu, L., Miao, M., Liu, W., Zhang, B., & Zhang, P. (2021) · Accountability in Research · doi:10.1080/08989621.2020.1809386 · Cited by 37 · cited 4×
“The emerging data deluge challenges the effectiveness of traditional auditing practices to 51 detect fraud, and several studies have suggested addressing the issue with improved 52 centralized and independent statistical monitoring [5,6,16,18].”
BackgroundInfluentialDefending Our Public Biological Databases as a Global Critical Infrastructure
Caswell, J., Gans, J. D., Generous, N., Hudson, C. M., Merkley, E. D., Johnson, C. M., OEHMEN, C. S., Omberg, K. M., Purvine, E., Taylor, K., et al. (2019) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2019.00058 · Cited by 34 · cited 1×
“With the rise of importance of these large datasets, it becomes imperative 43 that they remain free of errors both unintentional and intentional [13].”
BackgroundDetecting Data Quality Issues in Clinical Trials: Current Practices and Recommendations
Knepper, D., Fenske, C., Nadolny, P., Bedding, A. W., Gribkova, E. I., Polzer, J. P., Neumann, J., Wilson, B., Benedict, J., & Lawton, A. (2016) · Therapeutic Innovation & Regulatory Science · doi:10.1177/2168479015620248 · Cited by 30
Kupferschmidt, K. (2018) · Science · doi:10.1126/science.361.6403.636 · Cited by 30
Scientific fraud in 20 falsified anesthesia papers: Detection using financial auditing methods
Hein, J., Zobrist, R., Konrad, C., & Schuepfer, G. (2012) · Der Anaesthesist · doi:10.1007/s00101-012-2029-x · Cited by 25
The acquired immunodeficiency syndrome and mosquitoes.
Burton, F. (1989) · PubMed · Cited by 1
The acquired immunodeficiency syndrome and mosquitoes
Burton, F., Doherty, R. R., & Liehne, P. (1989) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.1989.tb128514.x · Cited by 1
Cited by
Toward an Integrated Machine Learning Model of a Proteomics Experiment
Neely, B. A., Dorfer, V., Martens, L., Bludau, I., Bouwmeester, R., Degroeve, S., Deutsch, E. W., Gessulat, S., Käll, L., Palczynski, P., et al. (2023) · Journal of Proteome Research · doi:10.1021/acs.jproteome.2c00711 · Cited by 83
Self-citationByrne, J. A., Park, Y., Richardson, R. A. K., Pathmendra, P., Sun, M., & Stoeger, T. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkac1139 · Cited by 46
“In contrast to the fabrication of genome-wide research that has been estimated to require similar effort as the acquisition of genuine data (74), targeted gene research is easier to fabricate than to produce through genuine effort (27,38) (Figure 2).”
The ethical aspects of exposome research: a systematic review
Safarlou, C. W., Jongsma, K. R., Vermeulen, R. C. H., & Bredenoord, A. L. (2023) · Exposome · doi:10.1093/exposome/osad004 · Cited by 39
“27 Two papers address the responsibilities of researchers when submitting articles to journals.”
BackgroundBarnett, A. (2022) · F1000Research · doi:10.12688/f1000research.123002.1 · Cited by 7
“35,47 Statistical approaches have been used to detect fraud in trials using individual patient data.”
DEPower : approximate power analysis with DESeq2Preprint
Gorin, G., Guruge, D., & Goodman, L. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.02.05.704084 · Cited by 1
Metadata
- Authors
- Bradshaw, M. S., & Payne, S. H.
- Affiliations
- University of Colorado Boulder (US)
- Brigham Young University (US)
- Corresponding author
- Payne, Samuel H.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2021-11-30
- Volume
- 16
- Issue
- 11
- Pages
- e0260395
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC8631639
- OpenAlex
- W3215621314
- Cited by
- 8
- References
- 34
- Citations by year
- 2026: 1 · 2023: 4 · 2022: 3
- FWCI
- 1.31
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- Research Square (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Division of Cancer Epidemiology and Genetics, National Cancer Institute (U24 CA210972)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Benford’s Law and Fraud Detection
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- research misconduct, omics data, gene copy number, falsification
- MeSH terms
- Machine Learning, Big Data, Fraud, Humans, Scientific Misconduct, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.