The ethical challenges raised in the design and conduct of pragmatic trials: an interview study with key stakeholders
Open accessAbstract
BACKGROUND: There is a concern that the apparent effectiveness of interventions tested in clinical trials may not be an accurate reflection of their actual effectiveness in usual practice. Pragmatic randomized controlled trials (RCTs) are designed with the intent of addressing this discrepancy. While pragmatic RCTs may increase the relevance of research findings to practice they may also raise new ethical concerns (even while reducing others). To explore this question, we interviewed key stakeholders with the aim of identifying potential ethical challenges in the design and conduct of pragmatic RCTs with a view to developing future guidance on these issues. METHODS: Interviews were conducted with clinical investigators, methodologists, patient partners, ethicists, and other knowledge users (e.g., regulators). Interviews covered experiences with pragmatic RCTs, ethical issues relevant to pragmatic RCTs, and perspectives on the appropriate oversight of pragmatic RCTs. Interviews were coded inductively by two coders. Interim and final analyses were presented to the broader team for comment and discussion before the analytic framework was finalized. RESULTS: We conducted 45 interviews between April and September 2018. Interviewees represented a range of disciplines and jurisdictions as well as varying content expertise. Issues of importance in pragmatic RCTs were (1) identification of relevant risks from trial participation and determination of what constitutes minimal risk; (2) determining when alterations to traditional informed consent approaches are appropriate; (3) the distinction between research, quality improvement, and practice; (4) the potential for broader populations to be affected by the trial and what protections they might be owed; (5) the broader range of trial stakeholders in pragmatic RCTs, and determining their roles and responsibilities; and (6) determining what constitutes "usual care" and implications for trial reporting. CONCLUSIONS: Our findings suggest both the need to discuss familiar ethical topics in new ways and that there are new ethical issues in pragmatic RCTs that need greater attention. Addressing the highlighted issues and developing guidance will require multidisciplinary input, including patient and community members, within a broader and more comprehensive analysis that extends beyond consent and attends to the identified considerations relating to risk and stakeholder roles and responsibilities.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
There is a concern that the observed effectiveness of treatments tested in clinical trials may not reflect their actual effectiveness in usual practice.
“There is namely a concern that the observed effectiveness of treatments tested in clinical trials may not reflect their actual effectiveness in usual practice (15).”
From Total Sleep Deprivation Followed by Bright Light Therapy as Rapid Relief for Depression: A Pragmatic Randomized Controlled Trial (2021) · cites this paper as [15]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · see citing works
Taylor, K. M. G., Nettleton, S., & Harding, G. (2010) · Taylor & Francis eBooks · doi:10.4324/9780203381175_chapter_9 · Cited by 14,635 · see citing works
Standards for Reporting Qualitative Research: A Synthesis of Recommendations
O’Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000388 · Cited by 12,211 · see citing works
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548 · see citing works
Improving the reporting of pragmatic trials: An extension of the CONSORT statement
Zwarenstein, M., Treweek, S., Gagnier, J. J., Altman, D. G., Tunis, S., Haynes, B., Oxman, A. D., Moher, D., & groups, F. T. C. A. P. T. I. H. (. (2008) · BMJ · doi:10.1136/bmj.a2390 · Cited by 1,813 · see citing works
Self-citationThe stepped wedge cluster randomised trial: rationale, design, analysis, and reporting
Hemming, K., Haines, T. P., Chilton, P. J., Girling, A. J., & Lilford, R. J. (2015) · BMJ · doi:10.1136/bmj.h391 · Cited by 1,410 · see citing works
Ford, I., & Norrie, J. (2016) · New England Journal of Medicine · doi:10.1056/nejmra1510059 · Cited by 1,405 · see citing works
Reducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319 · see citing works
Explanatory and Pragmatic Attitudes in Therapeutical Trials
Schwartz, D., & Lellouch, J. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.01.012 · Cited by 1,253 · see citing works
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · see citing works
A pragmatic view on pragmatic trials
Patsopoulos, N. A. (2011) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2011.13.2/npatsopoulos · Cited by 844 · see citing works
Faden, R. R., Kass, N. E., Goodman, S. N., Pronovost, P., Tunis, S., & Beauchamp, T. L. (2013) · Hastings Center Report · doi:10.1002/hast.134 · Cited by 498 · see citing works
Making trials matter: pragmatic and explanatory trials and the problem of applicability
Treweek, S. P., & Zwarenstein, M. (2009) · Trials · doi:10.1186/1745-6215-10-37 · Cited by 482 · see citing works
Self-citationIncreasing value and reducing waste in biomedical research: who's listening?
Moher, D., Glasziou, P., Chalmers, I., Nasser, M., Bossuyt, P. M. M., Korevaar, D. A., Graham, I. D., Ravaud, P., & Boutron, I. (2016) · The Lancet · doi:10.1016/s0140-6736(15)00307-4 · Cited by 462 · see citing works
Self-citationRevised CIOMS International Ethical Guidelines for Health-Related Research Involving Humans
van Delden, J. J. M., & van der Graaf, R. (2017) · JAMA · doi:10.1001/jama.2016.18977 · Cited by 421 · see citing works
The social licence for research: why care.data ran into trouble
Carter, P., Laurie, G. T., & Dixon‐Woods, M. (2015) · Journal of Medical Ethics · doi:10.1136/medethics-2014-102374 · Cited by 348 · see citing works
The Ottawa Statement on the Ethical Design and Conduct of Cluster Randomized Trials
Weijer, C., Grimshaw, J., Eccles, M., McRae, A. D., White, A., Brehaut, J., Taljaard, M., & Ottawa Ethics of Cluster Randomized Trials Consensus Group (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001346 · Cited by 293 · see citing works
Self-citationSeries: Pragmatic trials and real world evidence: Paper 1. Introduction
Zuidgeest, M. G. P., GOETZ, I. A., Groenwold, R. H. H., Irving, E. A., van Thiel, G. J. M. W., & Grobbee, D. E. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.12.023 · Cited by 224 · see citing works
Exploring the ethical and regulatory issues in pragmatic clinical trials
Califf, R. M., & Sugarman, J. (2015) · Clinical Trials · doi:10.1177/1740774515598334 · Cited by 191 · see citing works
The role for pragmatic randomized controlled trials (pRCTs) in comparative effectiveness research
Chalkidou, K., Tunis, S., Whicher, D. M., Fowler, R., & Zwarenstein, M. (2012) · Clinical Trials · doi:10.1177/1740774512450097 · Cited by 164 · see citing works
Self-citationA Framework for Risk-Benefit Evaluations in Biomedical Research
Rid, A., & Wendler, D. S. (2011) · Kennedy Institute of Ethics journal · doi:10.1353/ken.2011.0007 · Cited by 129 · see citing works
Evaluating the Risks of Clinical Research
Rid, A., Emanuel, E., & Wendler, D. S. (2010) · JAMA · doi:10.1001/jama.2010.1414 · Cited by 117 · see citing works
Attitudes Toward Risk and Informed Consent for Research on Medical Practices
Cho, M. K., Magnus, D. C., Constantine, M. L., Lee, S. S., Kelley, M. C., Kraft, S. A., Korngiebel, D. M., James, C., Kuwana, E., Gallagher, T. H., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m15-0166 · Cited by 105 · see citing works
Goldstein, C. E., Weijer, C., Brehaut, J., Fergusson, D. A., Grimshaw, J., Horn, A. R., & Taljaard, M. (2018) · BMC Medical Ethics · doi:10.1186/s12910-018-0253-x · Cited by 96 · see citing works
Self-citationUse of altered informed consent in pragmatic clinical research
McKinney, R. E., Beskow, L. M., Ford, D. E., Lantos, J. D., McCall, J., Patrick‐Lake, B., Pletcher, M. J., Rath, B., Schmidt, H. K., & Weinfurt, K. P. (2015) · Clinical Trials · doi:10.1177/1740774515597688 · Cited by 95 · see citing works
Rengerink, K. O., Kalkman, S., Collier, S., Ciaglia, A., Worsley, S. D., Lightbourne, A., Eckert, L., Groenwold, R. H. H., Grobbee, D. E., & Irving, E. A. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.12.021 · Cited by 88 · see citing works
The ethics and regulatory landscape of including vulnerable populations in pragmatic clinical trials
Welch, M. J., Lally, R. C., Miller, J. E., Pittman, S., Brodsky, L., Caplan, A. L., Uhlenbrauck, G., Louzao, D. M., Fischer, J. H., & Wilfond, B. S. (2015) · Clinical Trials · doi:10.1177/1740774515597701 · Cited by 73 · see citing works
Johnson, K. E., Neta, G. I., Dember, L. M., Coronado, G. D., Suls, J. M., Chambers, D., Rundell, S. D., Smith, D. H., Liu, B., Taplin, S. H., et al. (2016) · Trials · doi:10.1186/s13063-016-1158-y · Cited by 72 · see citing works
Oversight on the borderline: Quality improvement and pragmatic research
Finkelstein, J. A., Brickman, A. L., Capron, A. M., Ford, D. E., Gombosev, A., Greene, S. M., Iafrate, R. P., Kolaczkowski, L., Pallin, S. C., Pletcher, M. J., et al. (2015) · Clinical Trials · doi:10.1177/1740774515597682 · Cited by 70 · see citing works
The PRECIS-2 tool has good interrater reliability and modest discriminant validity
Loudon, K., Zwarenstein, M., Sullivan, F., Donnan, P. T., Gágyor, I., Hobbelen, H. J. S. M., Althabe, F., Krishnan, J. A., & Treweek, S. P. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.06.001 · Cited by 67 · see citing works
Self-citationWhat kind of randomized trials do we need?
Zwarenstein, M., & Treweek, S. P. (2009) · Canadian Medical Association Journal · doi:10.1503/cmaj.082007 · Cited by 59 · see citing works
Self-citationThe OHRP and SUPPORT — Another View
Macklin, R., Shepherd, L. L., Dreger, A., Asch, A., Baylis, F. E., Brody, H. A., Churchill, L. R., Coleman, C. H., Cowan, E. A., Dolgin, J. L., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmc1308015 · Cited by 56 · see citing works
Ethical and regulatory issues of pragmatic cluster randomized trials in contemporary health systems
Anderson, M. L., Califf, R. M., & Sugarman, J. (2015) · Clinical Trials · doi:10.1177/1740774515571140 · Cited by 51 · see citing works
Gatekeepers for pragmatic clinical trials
Whicher, D. M., Miller, J. E., Dunham, K. M., & Joffe, S. (2015) · Clinical Trials · doi:10.1177/1740774515597699 · Cited by 45 · see citing works
Zwarenstein, M., Treweek, S. P., & Loudon, K. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.10.010 · Cited by 44 · see citing works
Self-citationKASS, N. E., Faden, R., FABI, R. E., Morain, S. R., Hallez, K., Whicher, D. M., Tunis, S., Moloney, R., Messner, D. A., & Pitcavage, J. M. (2016) · AJOB Empirical Bioethics · doi:10.1080/23294515.2016.1156188 · Cited by 38 · see citing works
Differential payment to research participants in the same study: an ethical analysis
Persad, G., Lynch, H. F., & Largent, E. A. (2019) · Journal of Medical Ethics · doi:10.1136/medethics-2018-105140 · Cited by 35 · see citing works
Lantos, J. D., & Feudtner, C. (2014) · The Hastings Center Report · doi:10.1002/hast.407 · Cited by 31 · see citing works
Chen, S. C., & Kim, S. Y. H. (2016) · Clinical Trials · doi:10.1177/1740774516656945 · Cited by 31 · see citing works
Harms, benefits, and the nature of interventions in pragmatic clinical trials
Ali, J., Andrews, J. E., Somkin, C. P., & Rabinovich, C. E. (2015) · Clinical Trials · doi:10.1177/1740774515597686 · Cited by 30 · see citing works
Weir, C. R., Butler, J. M., Thraen, I., Woods, P. A., Hermos, J. A., Ferguson, R. E., Gleason, T., Barrus, R., & Fiore, L. D. (2014) · Clinical Trials · doi:10.1177/1740774514523848 · Cited by 29 · see citing works
Whicher, D. M., KASS, N. E., Saghai, Y., Faden, R., Tunis, S., & Pronovost, P. J. (2015) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/1556264615571558 · Cited by 28 · see citing works
Opportunities and barriers for pragmatic embedded trials: Triumphs and tribulations
Ramsberg, J., & Platt, R. G. (2017) · Learning Health Systems · doi:10.1002/lrh2.10044 · Cited by 28 · see citing works
PRECIS-2 in perspective: what is next for pragmatic trials?
Zuidgeest, M. G. P., GOETZ, I. A., & Grobbee, D. E. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.02.027 · Cited by 25 · see citing works
Whicher, D. M., KASS, N. E., & Faden, R. (2015) · PubMed · doi:10.1111/jlme.12256 · Cited by 24 · see citing works
Taljaard, M., Weijer, C., Grimshaw, J., Ali, A., Brehaut, J., Campbell, M., Carroll, K. A., Edwards, S., Eldridge, S. M., Forrest, C. B., et al. (2018) · Trials · doi:10.1186/s13063-018-2895-x · Cited by 24 · see citing works
Self-citationWhat gives them the right? Legal privilege and waivers of consent for research
Baker, F. X., & Merz, J. F. (2018) · Clinical Trials · doi:10.1177/1740774518803122 · Cited by 22 · see citing works
Why we must cluster and cross over
Bellomo, R., Forbes, A. B., Akram, M., Bailey, M., Pilcher, D. V., & Cooper, D. (2013) · Critical Care and Resuscitation · doi:10.1016/s1441-2772(23)01789-1 · Cited by 21 · see citing works
Quality Improvement Ethics: Lessons From the SUPPORT Study
Wilfond, B. S. (2013) · The American Journal of Bioethics · doi:10.1080/15265161.2013.851582 · Cited by 19 · see citing works
Stakeholders’ views on the ethical challenges of pragmatic trials investigating pharmaceutical drugs
Kalkman, S., van Thiel, G. J. M. W., Grobbee, D. E., Meinecke, A., Zuidgeest, M. G. P., & van Delden, J. J. M. (2016) · Trials · doi:10.1186/s13063-016-1546-3 · Cited by 18 · see citing works
How the CIOMS guidelines contribute to fair inclusion of pregnant women in research
van der Graaf, R., van der Zande, I. S. E., & van Delden, J. J. M. (2018) · Bioethics · doi:10.1111/bioe.12520 · Cited by 18 · see citing works
Pragmatic randomized trials in drug development pose new ethical questions: a systematic review
Kalkman, S., van Thiel, G. J. M. W., Grobbee, D. E., & van Delden, J. J. M. (2015) · Drug Discovery Today · doi:10.1016/j.drudis.2015.03.005 · Cited by 17 · see citing works
Physicians’ perspectives regarding pragmatic clinical trials
Topazian, R. J., Bollinger, J. M., Weinfurt, K. P., Dvoskin, R. L., Mathews, D., Brelsford, K. M., DeCamp, M. W., & Sugarman, J. (2016) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2016-0024 · Cited by 16 · see citing works
Patients’ beliefs regarding informed consent for low-risk pragmatic trials
Dal‐Ré, R., Carcas, A. J., Carné, X., & Wendler, D. S. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0424-3 · Cited by 16 · see citing works
Horn, A. R., Weijer, C., Grimshaw, J., Brehaut, J., Fergusson, D. A., Goldstein, C. E., & Taljaard, M. (2018) · Kennedy Institute of Ethics journal · doi:10.1353/ken.2018.0003 · Cited by 13 · see citing works
Self-citationPublic preferences on written informed consent for low‐risk pragmatic clinical trials in Spain
Dal‐Ré, R., Carcas, A. J., Carné, X., & Wendler, D. S. (2017) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.13305 · Cited by 12 · see citing works
Bell, K., McCullough, A. R., Mar, C. D., & Glasziou, P. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0443-0 · Cited by 10 · see citing works
Kim, S. Y. H. (2018) · Learning Health Systems · doi:10.1002/lrh2.10045 · Cited by 10 · see citing works
Nicholls, S. G., Carroll, K. A., Brehaut, J., Weijer, C., Hey, S. P., Goldstein, C. E., Zwarenstein, M., Graham, I. D., McKenzie, J. E., McIntyre, L., et al. (2018) · BMC Medical Ethics · doi:10.1186/s12910-018-0332-z · Cited by 9 · see citing works
Self-citationPRECIS-2: a tool to improve the applicability of randomised controlled trials
Loudon, K., Zwarenstein, M., Sullivan, F., Donnan, P. T., & Treweek, S. P. (2013) · Trials · doi:10.1186/1745-6215-14-s1-o28 · Cited by 7 · see citing works
Self-citationBandewar, S. V. S. (2017) · Indian Journal of Medical Ethics · doi:10.20529/ijme.2017.067 · Cited by 5 · see citing works
Clinical Concerns and the Validity of Clinical Trials
Lidz, C. W., Benedicto, C. M., Albert, K., Appelbaum, P. S., & Dunn, L. B. (2013) · AJOB Primary Research · doi:10.1080/21507716.2013.770105 · Cited by 3 · see citing works
Can the Regulatory Response to SUPPORT be Supported?
Hunter, D. L. (2013) · The American Journal of Bioethics · doi:10.1080/15265161.2013.849305 · Cited by 3 · see citing works
Flagged first, then by citations
1 of the 65 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- [27]Boyatzis RE Transforming qualitative information 1998 Thousand Oaks Sage Publications
Cited by
Sorted by citations
French, C., Pinnock, H., Forbes, G., Skene, I., & Taylor, S. J. (2020) · Trials · doi:10.1186/s13063-020-04762-9 · Cited by 91 · see citing works
Norton, W. E., Loudon, K., Chambers, D., & Zwarenstein, M. (2021) · Implementation Science · doi:10.1186/s13012-020-01075-y · Cited by 58 · see citing works
Self-citationDefining ethical challenge(s) in healthcare research: a rapid review
Schofield, G., Dittborn, M., Selman, L. E., & Huxtable, R. (2021) · BMC Medical Ethics · doi:10.1186/s12910-021-00700-9 · Cited by 52 · see citing works
Chan, C. L., Taljaard, M., Lancaster, G., Brehaut, J., & Eldridge, S. M. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.06.029 · Cited by 39 · see citing works
Self-citationA search filter to identify pragmatic trials in MEDLINE was highly specific but lacked sensitivity
Taljaard, M., McDonald, S. J., Nicholls, S. G., Carroll, K. A., Hey, S. P., Grimshaw, J., Fergusson, D. A., Zwarenstein, M., & McKenzie, J. E. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.05.003 · Cited by 33 · see citing works
Self-citationNicholls, S. G., Carroll, K. A., Hey, S. P., Zwarenstein, M., Zhang, J. Z., Nix, H. P., Brehaut, J., McKenzie, J. E., McDonald, S. J., Weijer, C., et al. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.03.021 · Cited by 32 · see citing works
Self-citationInformed consent in pragmatic trials: results from a survey of trials published 2014–2019
Zhang, J. Z., Nicholls, S. G., Carroll, K. A., Nix, H. P., Goldstein, C. E., Hey, S. P., Brehaut, J., McLean, P. C., Weijer, C., Fergusson, D. A., et al. (2021) · Journal of Medical Ethics · doi:10.1136/medethics-2021-107765 · Cited by 25 · see citing works
Self-citationVanderhout, S. M., Nevins, P., Nicholls, S. G., Macarthur, C., Brehaut, J. C., Potter, B. K., Gillies, K., Goulão, B., Smith, M. P., Hilderley, A. J., et al. (2023) · CMAJ Open · doi:10.9778/cmajo.20220198 · Cited by 24 · see citing works
Self-citationBillingy, N. E., Tromp, V. N. M. F., Veldhuijzen, E., Belderbos, J. S. A., Aaronson, N. K., Feldman, E., Hoek, R. J. A., Bogaard, H. J., Onwuteaka-Philipsen, B. D., van de Poll-Franse, L. V., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-052494 · Cited by 21 · see citing works
Mathioudakis, A. G., Khaleva, E., Fally, M., Williamson, P. R., Jensen, J. S., Felton, T., Brightling, C. E., Bush, A., Winders, T. A., Linnell, J., et al. (2023) · European Respiratory Journal · doi:10.1183/13993003.02107-2022 · Cited by 20 · see citing works
Methods for pragmatic randomized clinical trials of pain therapies: IMMPACT statement
Hohenschurz‐Schmidt, D., Cherkin, D. C., Rice, A. S. C., Dworkin, R. H., Turk, D. C., McDermott, M. P., Bair, M. J., DeBar, L., Edwards, R. R., Evans, S. R., et al. (2024) · Pain · doi:10.1097/j.pain.0000000000003249 · Cited by 18 · see citing works
Core outcome set for stable angina pectoris in traditional Chinese medicine (COS-SAP-TCM)
Zhang, M., Zhang, J., Chua, H. Z., Feng, R., Lu, M., & Tian, Y. (2021) · Acupuncture and Herbal Medicine · doi:10.1097/hm9.0000000000000007 · Cited by 18 · see citing works
Farrand, P. A., Woodford, J., Coumoundouros, C., & Svedin, F. (2020) · The Cognitive Behaviour Therapist · doi:10.1017/s1754470x20000239 · Cited by 14 · see citing works
Ioannou, M., Szabó, Z., Widmark-Jensen, M., Vyrinis, G., Karlsson, C., & Steingrimsson, S. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.705090 · Cited by 13 · see citing works
Ali, J., Davis, A. F., Burgess, D. J., Rhon, D. I., Vining, R. D., Young‐McCaughan, S., Green, S., & Kerns, R. D. (2021) · Learning Health Systems · doi:10.1002/lrh2.10291 · Cited by 11 · see citing works
Federico, C. A., Heagerty, P. J., Lantos, J., O'Rourke, P., Rahimzadeh, V., Sugarman, J., Weinfurt, K., Wendler, D., Wilfond, B. S., & Magnus, D. (2022) · Contemporary Clinical Trials · doi:10.1016/j.cct.2022.106703 · Cited by 11 · see citing works
Dir, A. L., Watson, D. P., Zhiss, M., Taylor, L., Bray, B. C., & McGuire, A. B. (2021) · Trials · doi:10.1186/s13063-021-05065-3 · Cited by 11 · see citing works
The Importance of Describing as Well as Defining Usual Care
Nicholls, S. G., Zwarenstein, M., & Taljaard, M. (2020) · The American Journal of Bioethics · doi:10.1080/15265161.2019.1687781 · Cited by 11 · see citing works
Self-citationNicholls, S. G., Carroll, K. A., Weijer, C., Goldstein, C. E., Brehaut, J., Sood, M. M., Al‐Jaishi, A. A., Basile, E., Grimshaw, J., Garg, A. X., et al. (2020) · Canadian Journal of Kidney Health and Disease · doi:10.1177/2054358120964119 · Cited by 9 · see citing works
Self-citationShin, I., & Rim, C. H. (2021) · Journal of Medical Internet Research · doi:10.2196/29642 · Cited by 8 · see citing works
Nevins, P., Vanderhout, S. M., Carroll, K. A., Nicholls, S. G., Semchishen, S. N., Brehaut, J., Fergusson, D. A., Giraudeau, B., & Taljaard, M. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.12.006 · Cited by 7 · see citing works
Self-citationNicholls, S. G., Carroll, K. A., Goldstein, C. E., Brehaut, J., Weijer, C., Zwarenstein, M., Dixon, S. N., Grimshaw, J., Garg, A. X., & Taljaard, M. (2021) · Canadian Journal of Kidney Health and Disease · doi:10.1177/20543581211032818 · Cited by 6 · see citing works
Self-citationPapagiannopoulou, E., Laiou, E., Tatsi, C., Dimakopoulos, G., Ntzani, E., Siamopoulos, K. C., & Tatsioni, A. (2022) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13759 · Cited by 6 · see citing works
Morain, S. R., Bollinger, J. M., Weinfurt, K. P., & Sugarman, J. (2023) · Learning Health Systems · doi:10.1002/lrh2.10366 · Cited by 6 · see citing works
McMullen, C. K., Sargeant, J. M., Kelton, D. F., O'Connor, A. M. C., Reedman, C. N., Hu, D., Glanville, J., Wood, H., & Winder, C. B. (2021) · Frontiers in Animal Science · doi:10.3389/fanim.2021.726401 · Cited by 5 · see citing works
Empowering local research ethics review of antibacterial mass administration research
Sewankambo, N. K., & Kutyabami, P. (2022) · Infectious Diseases of Poverty · doi:10.1186/s40249-022-01031-6 · Cited by 3 · see citing works
Manns, A., Mahdjoub, S., Ibañez, G. E., Jarrier, E., Daeipour, A., Melchior, M., & El-Khoury, F. (2023) · BMC Health Services Research · doi:10.1186/s12913-023-09950-2 · Cited by 3 · see citing works
Madadi‐Sanjani, O., & Ure, B. M. (2023) · European Journal of Pediatric Surgery · doi:10.1055/a-2196-1755 · Cited by 3 · see citing works
Nicholls, S. G., Nevins, P., Fox, G., Vanderhout, S. M., Brehaut, J., Carroll, K. A., Fergusson, D. A., Hilderley, A. J., Macarthur, C., Potter, B. K., et al. (2025) · Research Involvement and Engagement · doi:10.1186/s40900-025-00796-y · Cited by 2 · see citing works
Self-citationEsatoğlu, S. N., Özdede, A., Özgüler, Y., Taşçılar, K., & Yazıcı, H. (2025) · Trials · doi:10.1186/s13063-025-08732-x · Cited by 2 · see citing works
de Klerk, N. D., Berben, P. B. Q., van der Ven, M., Fransen, A. F., der Jagt, M. B. V. D. H., Oei, S. G., van Laar, J. O. E. H., & van den Heuvel, E. R. (2025) · Journal of Comparative Effectiveness Research · doi:10.57264/cer-2024-0168 · Cited by 2 · see citing works
Jedličková, A. (2021) · Ethics & bioethics · doi:10.2478/ebce-2021-0018 · Cited by 2 · see citing works
Ethical reflexivity: A critical examination of ethics in public health intervention research
Broholm-Jørgensen, M., & Tjørnhøj‐Thomsen, T. (2025) · Evaluation · doi:10.1177/13563890251367001 · Cited by 1 · see citing works
Empirical research related to the ethics of pragmatic clinical trials: A scoping review
Mehl, K. R., Morain, S. R., & Sugarman, J. (2025) · Learning Health Systems · doi:10.1002/lrh2.70041 · Cited by 1 · see citing works
Proactive Primary Care for Older Adults at High Risk of Hospital Admission
Nord, M. (2022) · Linköping University medical dissertations · doi:10.3384/9789179293895 · Cited by 1 · see citing works
Berger, M. B., Chisholm, M., Miller, H., Askew, S., Kay, M. C., & Bennett, G. G. (2023) · BMC Public Health · doi:10.1186/s12889-023-15574-2 · Cited by 1 · see citing works
Karanatsios, B., Prang, K.-H., Yeung, J. M. C., & Gibbs, P. (2024) · Trials · doi:10.1186/s13063-024-08668-8 · Cited by 1 · see citing works
Barnhill, J. L., Morone, N. E., Lathren, C., Harr, E. D., Baez, J. E., Rodríguez, R., Gardiner, P. M., Greco, C. M., Thomas, H. N., Gaylord, S. A., et al. (2025) · International Journal of Qualitative Methods · doi:10.1177/16094069251322321 · Cited by 1 · see citing works
Albrecht, L. (2020) · ERA: Education and Research Archive (University of Alberta) · doi:10.7939/r3-xeyn-2f38
(2020) · Elsevier eBooks · doi:10.1016/b978-0-12-386935-7.09998-9
What you need to know about the regulation of clinical research
DeRenzo, E. G., Singer, E. A., & Moss, J. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-386935-7.00003-7
Estimating Policy Effects in a Social Network with Independent Set SamplingPreprint
Ang, E. T. Y., Bhattacharya, P., & Lim, A. E. B. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4490708
Peepliwal, A. K. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-13627-6.00012-3
Considerations for choosing a research design
McInerney, P. A., Ajith, A., Pretorius, D., & Mabizela, S. E. (2024) · Wits Journal of Clinical Medicine · doi:10.18772/26180197.2024.v6n3a11
Design, Implementation, and Interpretation of Clinical Trials of Cancer Immunotherapy
Verma, M., Jaiswal, A., Vishwakarma, N., & Gupta, V. (2024) · Springer eBooks · doi:10.1007/978-981-97-7022-9_15
Krutsinger, D. C., & Courtright, K. R. (2025) · Annals of the American Thoracic Society · doi:10.1513/annalsats.202502-218ed
Electronic health records-based research in Cardiology: The time has come for pragmatic trials
Seabra, D., Oliveira, A., & Gavina, C. (2025) · Revista Portuguesa de Cardiologia · doi:10.1016/j.repc.2024.12.007
French, C. M., Pinnock, H., Forbes, G., Skene, I., & Taylor, S. J. (2020) · Figshare · doi:10.6084/m9.figshare.13212334
French, C. M., Pinnock, H., Forbes, G., Skene, I., & Taylor, S. J. (2020) · Figshare · doi:10.6084/m9.figshare.13212349
French, C. M., Pinnock, H., Forbes, G., Skene, I., & Taylor, S. J. (2020) · Figshare · doi:10.6084/m9.figshare.13212346
French, C. M., Pinnock, H., Forbes, G., Skene, I., & Taylor, S. J. (2020) · Figshare · doi:10.6084/m9.figshare.13212337
Manns, A., Mahdjoub, S., Ibañez, G. E., Jarrier, E., Daeipour, A., Melchior, M., & El-Khoury, F. (2023) · Figshare · doi:10.6084/m9.figshare.24144148
French, C. M., Pinnock, H., Forbes, G., Skene, I., & Taylor, S. J. (2020) · Figshare · doi:10.6084/m9.figshare.13212343
French, C. M., Pinnock, H., Forbes, G., Skene, I., & Taylor, S. J. (2020) · Figshare · doi:10.6084/m9.figshare.13212340
A critical look at the evolution of randomized controlled trials: new and old ethical issues
Yazici, H., Özgüler, Y., Esatoğlu, S. N., Özdede, A., & Karakoç, A. (2026) · Current Opinion in Immunology · doi:10.1016/j.coi.2026.102758
Controlling respiratory infections in long-term care facilities: A systematic review
Cho, E., Lee, S., Yang, M., Cho, J., Hwang, S., & Kim, E. (2026) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2026.105684
- Authors
- on behalf of the Ethics of Pragmatic Trials project, Nicholls, S. G., Carroll, K., Zwarenstein, M., Brehaut, J. C., Weijer, C., Hey, S. P., Goldstein, C. E., Graham, I. D., Grimshaw, J. M., McKenzie, J. E., Fergusson, D. A., & Taljaard, M.
- Affiliations
- Ottawa Hospital Research Institute (CA)
- Western University (CA)
- University of Ottawa (CA)
- Corresponding author
- Nicholls, Stuart G.
- ORCID
- Venue
- Trials
- Published
- 2019-12
- Volume
- 20
- Issue
- 1
- Pages
- 765-765
- ISSN
- 1745-6215 (ISSN-L)
- PMC
- PMC6929346
- OpenAlex
- W2996965444
- Cited by
- 56
- References
- 65
- Citations by year
- 2026: 2 · 2025: 8 · 2024: 5 · 2023: 8 · 2022: 4 · 2021: 15 · 2020: 14
- FWCI
- 7.60
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Trials (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- Monash University Research Portal (Monash University) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- uO Research (University of Ottawa) (submittedVersion, public-domain)
- Funders
- Canadian Institutes of Health Research (PJT-153045)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics in Clinical Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics and bioethics in healthcare
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- pragmatic randomized controlled trial, research ethics, informed consent, minimal risk, usual care, stakeholder roles and responsibilities, trial oversight, trial reporting, generalizability of trial results
- MeSH terms
- Stakeholder Participation, Female, Humans, Informed Consent, Male, Research Design, Research Personnel, Randomized Controlled Trials as Topic, Ethicists, Ethics, Research, Research Subjects, Qualitative Research, Pragmatic Clinical Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review