The DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.
A tutorial on sensitivity analyses in clinical trials: the what, why, when and how
Open accessAbstract
BACKGROUND: Sensitivity analyses play a crucial role in assessing the robustness of the findings or conclusions based on primary analyses of data in clinical trials. They are a critical way to assess the impact, effect or influence of key assumptions or variations--such as different methods of analysis, definitions of outcomes, protocol deviations, missing data, and outliers--on the overall conclusions of a study.The current paper is the second in a series of tutorial-type manuscripts intended to discuss and clarify aspects related to key methodological issues in the design and analysis of clinical trials. DISCUSSION: In this paper we will provide a detailed exploration of the key aspects of sensitivity analyses including: 1) what sensitivity analyses are, why they are needed, and how often they are used in practice; 2) the different types of sensitivity analyses that one can do, with examples from the literature; 3) some frequently asked questions about sensitivity analyses; and 4) some suggestions on how to report the results of sensitivity analyses in clinical trials. SUMMARY: When reporting on a clinical trial, we recommend including planned or posthoc sensitivity analyses, the corresponding rationale and results along with the discussion of the consequences of these analyses on the overall findings of the study.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To test the robustness of the data analysis strategy (given missing data associated with participant attrition), for variables that showed a significant change from T1 to T3 (for any group), a post-hoc sensitivity analysis involving multiple imputation by chained equations was performed using the mice package in R [85, 87].”
From Optimizing parenting and child outcomes following parent–child interaction therapy – toddler: a randomized controlled trial (2024) · cites this paper as [85]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Additionally, a complete-case analysis was conducted as a sensitivity analysis on observed data to corroborate the assumption of data missing at random [94].”
From Lessons Learned from an Attempted Pragmatic Randomized Controlled Trial for Improvement of Chronic Pain-Associated Disability in Green Professions: Long-Term Effectiveness of a Guided Online-Based Acceptance and Commitment Therapy (PACT-A) (2022) · cites this paper as [94]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The generality of a researcher's results under alternative relevant approaches can be checked via robustness analyses (e.g., Thabane et al., 2013, also called sensitivity or multiverse analyses) that indicate how research results vary as a function of reasonable data exclusions and alternative sensible data coding, aggregation, and analysis approaches.”
From Does preregistration improve the credibility of research findings? (2020) · cites this paper as Thabane et al., 2013
The cited source says what the claim attributes to it.
In the citing paper
“Missing data will be handled following the authors’ recommendations, using the most appropriate method depending on the reasons for the missing data and the sensitivity analysis principles.57”
From Effectiveness of a projection-based augmented reality exposure system in treating cockroach phobia: Study protocol of a randomised controlled trial (2023) · cites this paper as [57]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,385
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Global Sensitivity Analysis. The Primer
Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., Saisana, M., & Tarantola, S. (2007) · doi:10.1002/9780470725184 · Cited by 6,430
Missing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Analysis of Incomplete Multivariate Data
Booth, D. E., & Schafer, J. L. (2000) · Technometrics · doi:10.2307/1271466 · Cited by 5,627
Procedures for Detecting Outlying Observations in Samples
Grubbs, F. E. (1969) · Technometrics · doi:10.1080/00401706.1969.10490657 · Cited by 4,105
A tutorial on pilot studies: the what, why and how
Thabane, L., Ma, J., Chu, R., Cheng, J., Ismaila, A., Rios, L. P., Robson, R., Thabane, M., Giangregorio, L., & Goldsmith, C. H. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-1 · Cited by 3,384
Self-citationHilbe, J. M. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511973420 · Cited by 3,352
Research works printed but not linked: 2
- Goldsmith CH, Gafni A, Drummond MF, Torrance GW, Stoddart GL: Sensitivity Analysis and Experimental Design: The Case of Economic Evaluation of Health Care Programmes. Proceedings of the Third Canadian Conference on Health Economics 1986. 1987, Winnipeg MB: The University of Manitoba Press
- Spiegelhalter DJ, Best NG, Lunn D, Thomas A: Bayesian Analysis using BUGS: A Practical Introduction. 2009, New York, NY: Chapman and Hall
Cited by
Sorted by citations
Song, X., Zhang, J., Zhan, C., Xuan, Y., Ye, M., & Xu, C. (2015) · Journal of Hydrology · doi:10.1016/j.jhydrol.2015.02.013 · Cited by 655
Gomila, R. (2020) · Journal of Experimental Psychology General · doi:10.1037/xge0000920 · Cited by 565
Handling missing data in RCTs; a review of the top medical journals
Bell, M. L., Fiero, M., Horton, N. J., & Hsu, C.-H. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-118 · Cited by 395
An introduction to multiplicity issues in clinical trials: the what, why, when and how
Li, G., Taljaard, M., Van den Heuvel, E. R., Levine, M. A., Cook, D. J., Wells, G. A., Devereaux, P. J., & Thabane, L. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyw320 · Cited by 381
Self-citationAddressing the theory crisis in psychology
Oberauer, K., & Lewandowsky, S. (2019) · Psychonomic Bulletin & Review · doi:10.3758/s13423-019-01645-2 · Cited by 462
Metadata
- Authors
- Thabane, L., Mbuagbaw, L., Zhang, S., Samaan, Z., Marcucci, M., Ye, C., Thabane, M., Giangregorio, L., Dennis, B., Kosa, D., Debono, V. B., Dillenburg, R., Fruci, V., Bawor, M., Lee, J., Wells, G., & Goldsmith, C. H.
- Affiliations
- Population Health Research Institute (CA)
- St. Joseph’s Healthcare Hamilton (CA)
- McMaster University (CA)
- GlaxoSmithKline (Canada) (CA)
- University of Waterloo (CA)
- Korea University (KR)
- University of Ottawa (CA)
- Simon Fraser University (CA)
- Corresponding author
- Thabane, Lehana
- ORCID
- Venue
- BMC Medical Research Methodology
- Published
- 2013-07-16
- Volume
- 13
- Issue
- 1
- Pages
- 92-92
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC3720188
- OpenAlex
- W2095437242
- Cited by
- 893
- References
- 76
- Citations by year
- 2026: 76 · 2025: 113 · 2024: 107 · 2023: 109 · 2022: 90 · 2021: 84 · 2020: 90 · 2019: 52 · 2018: 57 · 2017: 43 · 2016: 31 · 2015: 28 · 2014: 11 · 2013: 1
- FWCI
- 20.82
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- uO Research (University of Ottawa) (submittedVersion, public-domain)
- Archivio Istituzionale della Ricerca (Universita Degli Studi Di Milano) (submittedVersion, other-oa)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- sensitivity analysis, clinical trials, missing data, outliers, protocol deviations, outcome definitions
- MeSH terms
- Clinical Trials as Topic, Humans, Outcome and Process Assessment, Health Care, Research Design, Sensitivity and Specificity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review