Statistical Monitoring in Clinical Trials: Best Practices for Detecting Data Anomalies Suggestive of Fabrication or Misconduct
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Traditional site-monitoring techniques are not optimal in finding data fabrication and other nonrandom data distributions with the greatest potential for jeopardizing the validity of study results. TransCelerate BioPharma conducted an experiment testing the utility of statistical methods for detecting implanted fabricated data and other signals of noncompliance. METHODS: TransCelerate tested statistical monitoring on a data set from a chronic obstructive pulmonary disease (COPD) clinical study with 178 sites and 1554 subjects. Fabricated data were selectively implanted in 7 sites and 43 subjects by expert clinicians in COPD. The data set was partitioned to simulate studies of different sizes. Analyses of vital signs, spirometry, visit dates, and adverse events included distributions of standard deviations, correlations, repeated values, digit preference, and outlier/inlier detection. An interpretation team, including clinicians, statisticians, site monitoring, and data management, reviewed the results and created an algorithm to flag sites for fabricated data. RESULTS: The algorithm identified 11 sites (19%), 19 sites (31%), 28 sites (16%), and 45 sites (25%) as having potentially fabricated data for studies 2A, 2, 1A, and 1, respectively. For study 2A, 3 of 7 sites with fabricated data were detected, 5 of 7 were detected for studies 2 and 1A, and 6 of 7 for study 1. Except for study 2A, the algorithm had good sensitivity and specificity (>70%) for identifying sites with fabricated data. CONCLUSIONS: We recommend a cross-functional, collaborative approach to statistical monitoring that can adapt to study design and data source and use a combination of statistical screening techniques and confirmatory graphics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These methods have been successfully applied in the investigations of several cases of research misconduct.25,27,29”
From Assessing Research Misconduct in Randomized Controlled Trials (2021) · cites this paper as [29]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“However, there is an ongoing debate about the importance of the underlying assumptions including independent variables, exclusive use of simple randomization, no rounding of summary statistics, and no publication bias.29,30”
From Assessing Research Misconduct in Randomized Controlled Trials (2021) · cites this paper as [29]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
On the generalized distance in statistics
Mahalanobis, P. C. (1936) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 6,068
Fitzmaurice, G. M., Laird, N. M., & Ware, J. H. (2011) · Wiley Series in Probability and Statistics · doi:10.1002/9781119513469 · Cited by 4,639
(2004) · Choice Reviews Online · doi:10.5860/choice.42-2265 · Cited by 1,384
Hyperdimensional Data Analysis Using Parallel Coordinates
Wegman, E. J. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10474926 · Cited by 688
Murrell, P. R. (2005) · Cited by 178
Ensuring trial validity by data quality assurance and diversification of monitoring methods
Baigent, C., Harrell, F. E., Buyse, M., Emberson, J. R., & Altman, D. G. (2008) · Clinical Trials · doi:10.1177/1740774507087554 · Cited by 163 · cited 2×
“Traditional site-monitoring techniques may find random data errors, but they are not optimal in identifying data fabrication and other nonrandom data distributions with greatest potential for jeopardizing the validity of study results.(1,2) One strategy being used is statistical monitoring, or the use of various stati…”
BackgroundMethodA statistical approach to central monitoring of data quality in clinical trials
Venet, D., Doffagne, E., Burzykowski, T., Beckers, F., Tellier, Y., Genevois-Marlin, E., Becker, U., Bee, V., Wilson, V., Legrand, C., et al. (2012) · Clinical Trials · doi:10.1177/1740774512447898 · Cited by 107
Application of methods for central statistical monitoring in clinical trials
Kirkwood, A. A., Cox, T., & Hackshaw, A. (2013) · Clinical Trials · doi:10.1177/1740774513494504 · Cited by 75
Central statistical monitoring: Detecting fraud in clinical trials
Pogue, J. M., Devereaux, P., Thorlund, K., & Yusuf, S. (2013) · Clinical Trials · doi:10.1177/1740774512469312 · Cited by 51
Lindblad, A. S., Manukyan, Z., Purohit-Sheth, T., Gensler, G., Okwesili, P., Meeker-O’Connell, A., Ball, L., & Marler, J. R. (2014) · Clinical Trials · doi:10.1177/1740774513508028 · Cited by 48
Self-citation
Research works printed but not linked: 1
- Murrel P. R Graphics. Boca Raton, FL: Chapman and Hall/CRC; 2006.
Cited by
Brosteanu, O., Schwarz, G. L., Houben, P., Paulus, U., Strenge-Hesse, A., Zettelmeyer, U., Schneider, A., & Hasenclever, D. (2017) · Clinical Trials · doi:10.1177/1740774517724165 · Cited by 82
Methods to assess research misconduct in health-related research: A scoping review
Bordewijk, E. M., Li, W., van Eekelen, R., Wang, R., Showell, M., Mol, B. W., & van Wely, M. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.05.012 · Cited by 68
Assessing Research Misconduct in Randomized Controlled Trials
Li, W., Bordewijk, E. M., & Mol, B. W. (2021) · Obstetrics & Gynecology · doi:10.1097/aog.0000000000004513 · Cited by 37
Churová, V., Vyškovský, R., Maršálová, K., Kudláček, D., & Schwarz, D. (2021) · JMIR Medical Informatics · doi:10.2196/27172 · Cited by 35
van den Bor, R. M., Vaessen, P. W. J., Oosterman, B. J., Zuithoff, N. P. A., Grobbee, D. E., & Roes, K. C. B. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.03.018 · Cited by 22
Metadata
- Authors
- Knepper, D., Lindblad, A. S., Sharma, G., Gensler, G. R., Manukyan, Z., Matthews, A. G., & Seifu, Y.
- Affiliations
- Allergan (United States) (US)
- Emmes (United States) (US)
- Pfizer (United States) (US)
- Corresponding author
- Knepper, David
- Venue
- Therapeutic Innovation & Regulatory Science
- Published
- 2016-03
- Volume
- 50
- Issue
- 2
- Pages
- 144-154
- ISSN
- 2168-4790 (ISSN-L)
- 2168-4804
- OpenAlex
- W2307181729
- Cited by
- 19
- References
- 17
- Citations by year
- 2025: 1 · 2024: 2 · 2021: 7 · 2020: 1 · 2018: 5 · 2017: 3
- FWCI
- 2.70
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- Locations
- Therapeutic Innovation & Regulatory Science (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Bristol-Myers Squibb
- Eli Lilly and Company
- Pfizer
- AstraZeneca
- GlaxoSmithKline
- Allergan
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Benford’s Law and Fraud Detection
- Social Sciences › Education › Academic integrity and plagiarism
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- statistical monitoring, clinical trial data integrity, research misconduct, site monitoring, data anomalies, outlier detection, digit preference, spirometry, screening algorithm, sensitivity and specificity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Statistical Monitoring in Clinical Trials: Best Practices for Detecting Data Anomalies Suggestive of Fabrication or Misconduct. https://app.cochat.ai/papers/10.1177/2168479016630576
- The paper
- Knepper, D., Lindblad, A. S., Sharma, G., Gensler, G. R., Manukyan, Z., Matthews, A. G., & Seifu, Y. (2016). Statistical Monitoring in Clinical Trials: Best Practices for Detecting Data Anomalies Suggestive of Fabrication or Misconduct. Therapeutic Innovation & Regulatory Science. https://doi.org/10.1177/2168479016630576
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.