The selection of comparators for randomized controlled trials of health-related behavioral interventions: recommendations of an NIH expert panel
Open accessAbstract
Objectives To provide recommendations for the selection of comparators for randomized controlled trials of health-related behavioral interventions.Study design and setting The National Institutes of Health Office of Behavioral and Social Science Research convened an expert panel to critically review the literature on control or comparison groups for behavioral trials and to develop strategies for improving comparator choices and for resolving controversies and disagreements about comparators.Results The panel developed a Pragmatic Model for Comparator Selection in Health-Related Behavioral Trials. The model indicates that the optimal comparator is the one that best serves the primary purpose of the trial but that the optimal comparator's limitations and barriers to its use must also be taken into account.Conclusion We developed best practice recommendations for the selection of comparators for health-related behavioral trials. Use of the Pragmatic Model for Comparator Selection in Health-Related Behavioral Trials can improve the comparator selection process and help resolve disagreements about comparator choices.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Attention control conditions can have unintended detrimental effects.
“We considered an alternative comparison condition to control for attention, but it would not reflect current clinical realities and attention control conditions can have unintended detrimental effects [26 -28].”
From Pilot randomized trial of an acceptance-based telehealth intervention for women with ovarian cancer and PARP inhibitor-related fatigue (2023) · cites this paper as [26]
The Research ethics section says comparator conditions can pose risks and harms to participants, including risks from exposure to the comparator itself. The paper identifies attention-control conditions as comparators in Choosing the optimal comparator, but our copy does not specifically say that attention controls can have unintended detrimental effects. No page numbers are available in our copy. (LLM, conf=0.78)
Experimental — accuracy not yet measuredThe EUC condition consisted of fatigue-specific educational materials which exceeds typical clinical offerings.
“We compared REVITALIZE to an EUC condition consisting of fatigue-specific educational materials which exceeds typical clinical offerings [26,27]”
From Pilot randomized trial of an acceptance-based telehealth intervention for women with ovarian cancer and PARP inhibitor-related fatigue (2023) · cites this paper as [26]
The 'Choosing the optimal comparator' section discusses usual care and other comparator types in general, but does not describe the REVITALIZE trial or its EUC condition. Searches for REVITALIZE, fatigue-specific educational materials, and enhanced usual care found no passage establishing what the condition contained or whether it exceeded typical clinical offerings. (LLM, conf=0.76)
Experimental — accuracy not yet measuredStudies with non-therapeutic control conditions can establish the impact of non-specific factors but cannot provide the highest comparison strength.
“Studies with non-therapeutic control conditions are still scientifically valuable as they can establish the impact of non-specific factors12, but they cannot provide the highest comparison strength.”
From Selecting and describing control conditions in mobile health randomized controlled trials: a proposed typology (2023) · cites this paper as [12]
There is no single control condition that is appropriate for every study at every stage of the research process.
“There is no single control condition that is appropriate for every study at every stage of the research process11,12,39.”
From Selecting and describing control conditions in mobile health randomized controlled trials: a proposed typology (2023) · cites this paper as [12]
Clarifying the universe of mHealth control condition types can help highlight the scientific questions each type can reasonably address and comparison strength each type provides.
“Clarifying the universe of mHealth control condition types can help highlight the scientific questions each type can reasonably address and comparison strength each type provides12.”
From Selecting and describing control conditions in mobile health randomized controlled trials: a proposed typology (2023) · cites this paper as [12]
The choice of control condition heavily impacts the comparison strength within a study.
“The choice of control condition heavily impacts the comparison strength within a study12.”
From Selecting and describing control conditions in mobile health randomized controlled trials: a proposed typology (2023) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817 · see citing works
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,577 · see citing works
(2002) · Cited by 13,211 · see citing works
Self-citationFundamentals of Clinical Trials
Friedman, L. M., Furberg, C. D., DeMets, D. L., Reboussin, D. M., & Granger, C. B. (2015) · doi:10.1007/978-3-319-18539-2 · Cited by 2,237 · see citing works
Research design in clinical psychology
Kazdin, A. E. (1952) · Journal of Clinical Psychology · doi:10.1002/1097-4679(195201)8:1 · Cited by 2,153 · see citing works
The PRECIS-2 tool: designing trials that are fit for purpose
Loudon, K., Treweek, S., Sullivan, F., Donnan, P., Thorpe, K. E., & Zwarenstein, M. (2015) · BMJ · doi:10.1136/bmj.h2147 · Cited by 1,846 · see citing works
Self-citationFrom ideas to efficacy: The ORBIT model for developing behavioral treatments for chronic diseases
Czajkowski, S. M., Powell, L. H., Adler, N., Naar-King, S., Reynolds, K. D., Hunter, C. M., Laraia, B., Olster, D. H., Perna, F. M., Peterson, J. C., et al. (2015) · Health Psychology · doi:10.1037/hea0000161 · Cited by 1,161 · cited 2× · see citing works
“Similarly, in the Design phase (Phase I) of t he Obesity-Related Behavioral Intervention Trials (ORBIT) framework for developing behavioral interventions [30], small-N or single-case designs examine the intervention’s components, dosa ge parameters, targets, and modes of delivery without between-group comparators.”
BackgroundMethodSelf-citationIndirect comparisons of competing interventions
Glenny, A., Altman, D. G., Song, F., Sakarovitch, C., Deeks, J. J., D’Amico, R., Bradburn, M. J., & Eastwood, A. J. (2005) · Health Technology Assessment · doi:10.3310/hta9260 · Cited by 681 · see citing works
Mayo-Wilson, E., Dias, S., Mavranezouli, I., Kew, K., Clark, D. M., Ades, A. E., & Pilling, S. (2014) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)70329-3 · Cited by 680 · see citing works
Self-citationMohr, D. C., Spring, B., Freedland, K. E., Beckner, V., Arean, P., Hollon, S. D., Ockene, J., & Kaplan, R. (2009) · Psychotherapy and Psychosomatics · doi:10.1159/000228248 · Cited by 565 · see citing works
Self-citationFurukawa, T. A., Noma, H., Caldwell, D. M., Honyashiki, M., Shinohara, K., Imai, H., Chen, P., Hunot, V., & Churchill, R. (2014) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12275 · Cited by 521 · see citing works
De Las Nueces, D., Hacker, K., DiGirolamo, A., & Hicks, L. S. (2012) · Health Services Research · doi:10.1111/j.1475-6773.2012.01386.x · Cited by 400 · see citing works
Freedland, K. E., Mohr, D. C., Davidson, K. W., & Schwartz, J. E. (2011) · Psychosomatic Medicine · doi:10.1097/psy.0b013e318218e1fb · Cited by 369 · see citing works
Self-citationThe Multiphase Optimization Strategy for Engineering Effective Tobacco Use Interventions
Collins, L. M., Baker, T. B., Mermelstein, R. J., Piper, M. E., Jorenby, D. E., Smith, S. S., Christiansen, B. A., Schlam, T. R., Cook, J. W., & Fiore, M. C. (2011) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9253-x · Cited by 300 · see citing works
Self-citationHow Consumers and Policymakers Can Use Systematic Reviews for Decision Making
Bero, L. A., & Jadad, A. R. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-1-199707010-00007 · Cited by 198 · see citing works
Posing the research question: not so simple
Thabane, L., Thomas, T., Ye, C., & Paul, J. (2008) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-008-9007-4 · Cited by 178 · see citing works
Self-citationBehavioral Intervention Research: Designing, Evaluating, and Implementing
Gitlin, L. N., & Czaja, S. J. (2015) · Springer Publishing Company eBooks · doi:10.1891/9780826126597 · Cited by 149 · see citing works
Bishop, F. L., Fenge-Davies, A. L., Kirby, S., & Geraghty, A. W. A. (2015) · Psychology & Health · doi:10.1080/08870446.2014.953529 · Cited by 121 · see citing works
Methodological issues & strategies in clinical research.
Imber, S. D., Glanz, L. M., Elkin, I., Sotsky, S. M., Boyer, J. L., & Leber, W. R. (1992) · American Psychological Association eBooks · doi:10.1037/10109-000 · Cited by 114 · see citing works
Charney, D. S. (2002) · Archives of General Psychiatry · doi:10.1001/archpsyc.59.3.262 · Cited by 113 · see citing works
Brim, R. L., & Miller, F. G. (2012) · Journal of Medical Ethics · doi:10.1136/medethics-2012-101045 · Cited by 91 · see citing works
Fundamentals of Clinical Trials
(2011) · Wiley series in probability and statistics · doi:10.1002/9781118183335.ch2 · Cited by 81 · see citing works
Control Groups in Psychosocial Intervention Research: Ethical and Methodological Issues
Street, L. L., & Luoma, J. B. (2002) · Ethics & Behavior · doi:10.1207/s15327019eb1201_1 · Cited by 55 · see citing works
Varieties of Standard-of-Care Treatment Randomized Trials
Kim, S. Y. H., & Miller, F. G. (2015) · JAMA · doi:10.1001/jama.2014.18528 · Cited by 26 · see citing works
High-quality psychotherapy research from conception to piloting to national trials
Areán, P. A., & KRAEMER, H. C. (2013) · Cited by 17 · see citing works
High‐quality psychotherapy research: from conception to piloting to national trials
Hayes, J. (2013) · Counselling and Psychotherapy Research · doi:10.1080/14733145.2013.855538 · Cited by 10 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [9]Freedland KE. Design and conduct of randomized behavioral clinical trials: Purpose-guided trial design. International Journal of Behavioral Medicine. 2014; 21: S1.
Cited by
Sorted by citations
Defining and Measuring Meditation-Related Adverse Effects in Mindfulness-Based Programs
Britton, W. B., Lindahl, J. R., Cooper, D. J., Canby, N. K., & Palitsky, R. (2021) · Clinical Psychological Science · doi:10.1177/2167702621996340 · Cited by 278 · see citing works
Bricca, A., Harris, L. K., Jäger, M., Smith, S. M., Juhl, C. B., & Skou, S. T. (2020) · Ageing Research Reviews · doi:10.1016/j.arr.2020.101166 · Cited by 173 · see citing works
Precision Health: The Role of the Social and Behavioral Sciences in Advancing the Vision
Hekler, E. B., Tiro, J. A., Hunter, C. M., & Nebeker, C. (2020) · Annals of Behavioral Medicine · doi:10.1093/abm/kaaa018 · Cited by 147 · see citing works
Positive affect and reward processing in the treatment of depression, anxiety and trauma
Craske, M. G., Dunn, B. D., Meuret, A. E., Rizvi, S. J., & Taylor, C. T. (2024) · Nature Reviews Psychology · doi:10.1038/s44159-024-00355-4 · Cited by 105 · see citing works
Pereira, M. A., Mullane, S. L., Toledo, M. J. L., Larouche, M. L., Rydell, S. A., Vuong, B., Feltes, L. H., Mitchell, N. R., de Brito, J. N., Hasanaj, K., et al. (2019) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-020-01033-3 · Cited by 87 · see citing works
Measuring Positive Emotion Outcomes in Positive Psychology Interventions: A Literature Review
Moskowitz, J., Cheung, E., Freedman, M., Fernando, C., Zhang, M. W., Huffman, J., & Addington, E. (2020) · Emotion Review · doi:10.1177/1754073920950811 · Cited by 75 · see citing works
NIH Music-Based Intervention Toolkit
Edwards, E., Hillaire‐Clarke, C. S., Frankowski, D. W., Finkelstein, R., Cheever, T. R., Chen, W., Onken, L. S., Poremba, A., Riddle, R., Schloesser, D., et al. (2023) · Neurology · doi:10.1212/wnl.0000000000206797 · Cited by 81 · see citing works
Goldberg, S. B., Sun, S., Carlbring, P., & Torous, J. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00923-7 · Cited by 75 · see citing works
Meffert, S. M., Neylan, T. C., McCulloch, C. E., Blum, K., Cohen, C. R., Bukusi, E. A., Verdeli, H., Markowitz, J. C., Kahn, J. G., Bukusi, D., et al. (2021) · PLOS Medicine · doi:10.1371/journal.pmed.1003468 · Cited by 67 · see citing works
Holtdirk, F., Mehnert, A., Weiss, M., Mayer, J., Meyer, B., Bröde, P., Claus, M., & Watzl, C. (2021) · PLOS ONE · doi:10.1371/journal.pone.0251276 · Cited by 62 · see citing works
Dhir, S., Teo, W., Chamberlain, S. R., Tyler, K., Yücel, M., & Segrave, R. A. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.07.008 · Cited by 60 · see citing works
Bini, P., Hohenschurz‐Schmidt, D., Masullo, V., Pitt, D., & Draper‐Rodi, J. (2022) · Chiropractic & Manual Therapies · doi:10.1186/s12998-022-00459-9 · Cited by 55 · see citing works
Methods-Motivational Interviewing Approach for Enhanced Retention and Attendance
Jake‐Schoffman, D. E., Brown, S. D., Baiocchi, M., Bibeau, J., Daubenmier, J. J., Ferrara, A. M., Galarce, M., Hartogensis, W., Hecht, F. M., Hedderson, M. M., et al. (2021) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2021.04.005 · Cited by 55 · see citing works
Baron, K. G., Duffecy, J. L., Richardson, D., Avery, E., Rothschild, S. K., & Lane, J. (2019) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.8018 · Cited by 54 · see citing works
Beyond “Use It or Lose It”: The Impact of Engagement on Cognitive Aging
Stine‐Morrow, E. A. L., & Manavbasi, I. E. (2022) · Annual Review of Developmental Psychology · doi:10.1146/annurev-devpsych-121020-030017 · Cited by 46 · see citing works
Black, N., Eisma, M. C., Viechtbauer, W., Johnston, M., West, R., Hartmann‐Boyce, J., Michie, S., & de Bruin, M. (2020) · Addiction · doi:10.1111/add.14969 · Cited by 46 · see citing works
Sheeran, P., Listrom, O., & Gollwitzer, P. M. (2025) · European Review of Social Psychology · doi:10.1080/10463283.2024.2334563 · Cited by 48 · see citing works
Anstey, K. J., Peters, R., Zheng, L., Barnes, D. E., Brayne, C., Brodaty, H., Chalmers, J., Clare, L., Dixon, R. A., Dodge, H., et al. (2020) · Journal of Alzheimer's Disease · doi:10.3233/jad-200674 · Cited by 40 · see citing works
Kim, M., Patrick, K., Nebeker, C., Godino, J., Stein, S., Klasnja, P., Perski, O., Viglione, C., Coleman, A., & Hekler, E. B. (2024) · Journal of Medical Internet Research · doi:10.2196/49208 · Cited by 40 · see citing works
Bendtsen, M., Åsberg, K., & McCambridge, J. (2022) · BMC Medicine · doi:10.1186/s12916-022-02374-5 · Cited by 39 · see citing works
Purpose-guided trial design in health-related behavioral intervention research.
Freedland, K. E. (2020) · Health Psychology · doi:10.1037/hea0000867 · Cited by 32 · see citing works
Self-citationvon Lützow, U., Neuendorf, N. L., & Scherr, S. (2025) · BMJ Mental Health · doi:10.1136/bmjment-2025-301641 · Cited by 29 · see citing works
Reininghaus, U., Daemen, M., Postma, M. R., Schick, A., Hoes-van der Meulen, I., Volbragt, N., Nieman, D., Delespaul, P., de Haan, L., van der Pluijm, M., et al. (2024) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2023.4590 · Cited by 28 · see citing works
Hohenschurz‐Schmidt, D., Cherkin, D. C., Rice, A. S. C., Dworkin, R. H., Turk, D. C., McDermott, M. P., Bair, M. J., DeBar, L., Edwards, R. R., Farrar, J. T., et al. (2023) · Pain · doi:10.1097/j.pain.0000000000002888 · Cited by 27 · see citing works
Garnett, C. V., Oldham, M., Angus, C., Beard, E., Burton, R., Field, M., Greaves, F., Hickman, M., Kaner, E., Loebenberg, G., et al. (2020) · Addiction · doi:10.1111/add.15287 · Cited by 25 · see citing works
Telehealth and Online Cognitive Behavioral Therapy–Based Treatments for High-Impact Chronic Pain
DeBar, L., Mayhew, M., Wellman, R., Balderson, B. H. K., Dickerson, J. F., Elder, C. R., Justice, M., Keefe, F. J., McMullen, C. K., Owen‐Smith, A. A., et al. (2025) · JAMA · doi:10.1001/jama.2025.11178 · Cited by 30 · see citing works
Mobile health interventions in multiple sclerosis: A systematic review
Heesen, C., Berger, T., Riemann-Lorenz, K., Krause, N., Friede, T., Pöttgen, J., Meyer, B., & Lühmann, D. (2023) · Multiple Sclerosis Journal · doi:10.1177/13524585231201089 · Cited by 25 · see citing works
Promoting Resilience in Stress Management for Adolescents With Type 1 Diabetes
Yi‐Frazier, J. P., Hilliard, M. E., O’Donnell, M. B., Zhou, C., ELLISOR, B. M., Perez, S. G., Duran, B., Rojas, Y., Malik, F. S., DeSalvo, D. J., et al. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.28287 · Cited by 24 · see citing works
Hooker, S. A., Crain, A. L., LaFrance, A. B., Kane, S. M., Fokuo, J. K., Bart, G. B., & Rossom, R. C. (2023) · Addiction Science & Clinical Practice · doi:10.1186/s13722-023-00366-1 · Cited by 24 · see citing works
Dean, B. J. F., Collins, J. C., Thurley, N., Rombach, I., & Bennell, K. L. (2021) · Osteoarthritis and Cartilage Open · doi:10.1016/j.ocarto.2021.100195 · Cited by 23 · see citing works
Voils, C. I., Adler, R., Strawbridge, E. M., Grubber, J. M., Allen, K. D., Olsen, M. K., McVay, M. A., Raghavan, S., Raffa, S. D., & Funk, L. M. (2020) · Health Psychology · doi:10.1037/hea0000835 · Cited by 23 · see citing works
Dworkin, R. H., Anderson, B. T., Andrews, N., Edwards, R. R., Grob, C. S., Ross, S., Satterthwaite, T. D., & Strain, E. C. (2022) · Journal of Pain · doi:10.1016/j.jpain.2022.05.003 · Cited by 22 · see citing works
Garbett, K. M., Haywood, S., Craddock, N., Gentili, C., Nasution, K., Saraswati, L. A., Medise, B. E., White, P., Diedrichs, P. C., & Williamson, H. (2023) · Journal of Medical Internet Research · doi:10.2196/42499 · Cited by 22 · see citing works
Crane, M. F., Kho, M. C., Kangas, M., Griffin, B., Karin, E., Earl, J. K., & Harris, C. B. (2020) · Anxiety Stress & Coping · doi:10.1080/10615806.2020.1768375 · Cited by 22 · see citing works
Acupuncture for Chronic Low Back Pain in Older Adults
DeBar, L., Wellman, R., Justice, M., Avins, A. L., Beyrouty, M., Eng, C. M., Herman, P. M., Nielsen, A., Pressman, A. R., Stone, K. L., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.31348 · Cited by 36 · see citing works
Arch, J. J., & Stanton, A. L. (2019) · Supportive Care in Cancer · doi:10.1007/s00520-019-04677-5 · Cited by 21 · see citing works
Murdoch, E. M., Lines, R. L. J., Crane, M. F., Ntoumanis, N., Brade, C. J., Quested, E., Ayers, J., & Gucciardi, D. F. (2021) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2021.1977974 · Cited by 20 · see citing works
Lepage, M., Bowie, C. R., Montreuil, T. C., Baer, L., du Sert, O. P., Lecomte, T., Joober, R., Abdel‐Baki, A., Jarvis, G. E., Margolese, H. C., et al. (2022) · Psychological Medicine · doi:10.1017/s0033291721005328 · Cited by 18 · see citing works
The Effects of Sustained Literacy Engagement on Cognition and Sentence Processing Among Older Adults
Stine‐Morrow, E. A. L., McCall, G. S., Manavbasi, I. E., Ng, S., Llano, D. A., & Barbey, A. K. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.923795 · Cited by 19 · see citing works
Harrison, E. C., Haussler, A. M., Tueth, L. E., Baudendistel, S. T., & Earhart, G. M. (2024) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2024.1289368 · Cited by 18 · see citing works
Graboyes, E. M., Kistner‐Griffin, E., Hill, E. G., Maurer, S. N., Balliet, W. E., Williams, A. M., Padgett, L. S., Yan, F., Rush, A., Johnson, B., et al. (2023) · Journal of Cancer Survivorship · doi:10.1007/s11764-023-01454-6 · Cited by 17 · see citing works
Medical Extended Reality Trials: Building Robust Comparators, Controls, and Sham
Persky, S., & Colloca, L. (2023) · Journal of Medical Internet Research · doi:10.2196/45821 · Cited by 17 · see citing works
Clinician's Guide to Evaluating and Developing eHealth Interventions for Mental Health
Ondersma, S. J., & Walters, S. T. (2020) · Psychiatric Research and Clinical Practice · doi:10.1176/appi.prcp.2020.20190036 · Cited by 16 · see citing works
Reactions to being allocated to a waiting list control group in a digital alcohol intervention trial
Gunnarsson, K. U., McCambridge, J., & Bendtsen, M. (2022) · Patient Education and Counseling · doi:10.1016/j.pec.2022.11.014 · Cited by 17 · see citing works
Comparator Groups in ICU-Based Studies of Physical Rehabilitation: A Scoping Review of 125 Studies
O’Grady, H. K., Reid, J. C., Farley, C., Hanna, Q. E. B., Unger, J., Zorko, D. J., Bosch, J., Turkstra, L. S., & Kho, M. E. (2023) · Critical Care Explorations · doi:10.1097/cce.0000000000000917 · Cited by 17 · see citing works
von Klinggraeff, L., Dugger, R., Okely, A. D., Lubans, D. R., Jago, R., Burkart, S. A., Weaver, R. G., Armstrong, B., Pfledderer, C. D., & Beets, M. W. (2022) · Pilot and Feasibility Studies · doi:10.1186/s40814-022-00991-8 · Cited by 17 · see citing works
Pedersen, J. R., Dilara Merve, S. A. R. I., Juhl, C. B., Thorlund, J. B., Skou, S. T., Roos, E. M., & Bricca, A. (2022) · Annals of Physical and Rehabilitation Medicine · doi:10.1016/j.rehab.2022.101708 · Cited by 16 · see citing works
Lorenzo‐Luaces, L., & Howard, J. (2023) · Journal of Medical Internet Research · doi:10.2196/45411 · Cited by 16 · see citing works
Simpson, A., Stein, M., Rosenberg, M., Ward, B., Derbyshire, A., Thornton, A., & Jackson, B. (2023) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2023.102464 · Cited by 16 · see citing works
Graboyes, E. M., Maurer, S. N., Balliet, W. E., Li, H., Williams, A. M., Osazuwa‐Peters, N., Yan, F., Padgett, L. S., Rush, A., Ruggiero, K. J., et al. (2022) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2022.3700 · Cited by 16 · see citing works
Rawson, K. S., Cavanaugh, J. T., Colón-Semenza, C., DeAngelis, T., Duncan, R. P., Fulford, D., LaValley, M. P., Mazzoni, P., Nordahl, T. J., Quintiliani, L. M., et al. (2020) · BMC Neurology · doi:10.1186/s12883-020-01718-z · Cited by 16 · see citing works
Kiernan, M., & Baiocchi, M. (2022) · American Journal of Epidemiology · doi:10.1093/aje/kwac019 · Cited by 17 · see citing works
Maccora, J., Garland, S. N., Ftanou, M., Day, D., White, M. A., Lopez, V. A., Mortimer, D., Diggens, J., Phillips, A. J. K., Wallace, R., et al. (2022) · Contemporary Clinical Trials · doi:10.1016/j.cct.2022.106877 · Cited by 17 · see citing works
MacLean, J. A., Stegenga, K. A., Henley, A. K., & Robb, S. L. (2022) · Integrative Cancer Therapies · doi:10.1177/15347354221140491 · Cited by 14 · see citing works
McGrady, M. E., Keenan-Pfeiffer, M. E., Lang, A. C., Noser, A. E., Tyagi, A. P., Herriott, J. K., & Ramsey, R. R. (2024) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsae036 · Cited by 15 · see citing works
Huberty, J., Eckert, R., Puzia, M., Laird, B., Larkey, L., & Mesa, R. A. (2020) · JMIR Formative Research · doi:10.2196/19364 · Cited by 13 · see citing works
Murray, H. B., Guadagnoli, L. A., Kamp, K., Trindade, I. A., Powell, L. H., Simrén, M., Ljótsson, B., & Keefer, L. (2025) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.18482 · Cited by 13 · see citing works
Verma, S., Rajaratnam, S. M. W., Davey, M. J., Wiley, J. F., & Bei, B. (2021) · Frontiers in Global Women s Health · doi:10.3389/fgwh.2020.591677 · Cited by 13 · see citing works
Rebok, G. W., Tzuang, M., & Parisi, J. M. (2019) · The Journals of Gerontology Series B · doi:10.1093/geronb/gbz107 · Cited by 13 · see citing works
Self-citationO'Hayer, C. V., Smith, P. J., Drescher, C. F., Bruschwein, H., Nurse, C. N., Kushner, H. M., Ingle, K., Stephen, M. J., & Hoag, J. B. (2024) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2024.11.011 · Cited by 12 · see citing works
Tueller, S., Ramirez, D., Cance, J. D., Ye, A., Wheeler, A., Fan, Z., Hornik, C. P. V., & Ridenour, T. A. (2022) · Behavior Research Methods · doi:10.3758/s13428-022-02012-1 · Cited by 12 · see citing works
Harris‐Hayes, M., Zorn, P., Steger-May, K., Burgess, M. M., DeMargel, R. D., Kuebler, S., Clohisy, J. C. F., & Haroutounian, S. (2023) · Physical Therapy · doi:10.1093/ptj/pzad111 · Cited by 12 · see citing works
Garbett, K. M., Craddock, N., Haywood, S., Nasution, K., White, P., Saraswati, L. A., Medise, B. E., Effect, G., Galactic, P., Diedrichs, P. C., et al. (2021) · JMIR Research Protocols · doi:10.2196/33596 · Cited by 12 · see citing works
Graboyes, E. M., Kistner‐Griffin, E., Hill, E. G., Maurer, S. N., Balliet, W. E., Williams, A. M., Padgett, L. S., Yan, F., Rush, A., Johnson, B., et al. (2023) · Supportive Care in Cancer · doi:10.1007/s00520-023-08248-7 · Cited by 12 · see citing works
Wright, A. A., Poort, H., Tavormina, A., Schmiege, S. J., Matulonis, U. A., Campos, S. M., Liu, J. F., Slivjak, E. T., Gilmour, A. L., Salinger, J. M., et al. (2023) · Gynecologic Oncology · doi:10.1016/j.ygyno.2023.08.020 · Cited by 11 · see citing works
Bechthold, A. C., Azuero, A., Pisu, M., Pierce, J. Y., Williams, G. R., Taylor, R. A., Wells, R., Curry, K., Reed, R. D., Harrell, E. R., et al. (2022) · Trials · doi:10.1186/s13063-022-06305-w · Cited by 12 · see citing works
Matson, T. E., Hermes, E. D. A., Lyon, A. R., Quanbeck, A., Schueller, S. M., Wilson, S. M., & Glass, J. E. (2025) · Annals of Epidemiology · doi:10.1016/j.annepidem.2025.02.007 · Cited by 11 · see citing works
Craddock, N., Garbett, K. M., Haywood, S., Nasution, K., White, P., Saraswati, L. A., Rizkiah, C., Medise, B. E., & Diedrichs, P. C. (2021) · BMC Public Health · doi:10.1186/s12889-021-11770-0 · Cited by 11 · see citing works
Gaudiano, B. A., Davis, C. H., Miller, I. W., & Uebelacker, L. A. (2020) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2436 · Cited by 12 · see citing works
Learning from community-led and co-designed m-health interventions
Duncan, M. J., & Kolt, G. S. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30125-6 · Cited by 9 · see citing works
Marriott, K. A., Hall, M., Maciukiewicz, J. M., Almaw, R. D., Wiebenga, E. G., Ivanochko, N. K., Rinaldi, D., Tung, E. V., Bennell, K. L., & Maly, M. R. (2024) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2024.152538 · Cited by 10 · see citing works
Willis, A., Shiely, F., Treweek, S. P., Taljaard, M., Loudon, K., Howie, A. H., & Zwarenstein, M. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111534 · Cited by 10 · see citing works
Self-citationCastañeda, S. F., Gallo, L. C., Garcia, M. L., Mendoza, P., Gutierrez, A. P., Lopez-Gurrola, M., Roesch, S. C., Pichardo, M. S., Munoz, F. A., & Talavera, G. A. (2022) · Translational Behavioral Medicine · doi:10.1093/tbm/ibac042 · Cited by 10 · see citing works
Agley, J. D., Jayawardene, W. P., Jun, M. C., Agley, D., Gassman, R. A., Sussman, S. Y., Xiao, Y., & Dickinson, S. (2020) · JMIR Research Protocols · doi:10.2196/17900 · Cited by 10 · see citing works
The Support, Educate, Empower personalized glaucoma coaching trial design
Newman-Casey, P. A., Resnicow, K., Winter, S. M., Niziol, L. M., Darnley-Fisch, D. A., Imami, N. R., McHaney-Conner, P., Musch, D. C., Mitchell, J. A., & Heisler, M. (2023) · Clinical Trials · doi:10.1177/17407745221136571 · Cited by 10 · see citing works
von Klinggraeff, L., Ramey, K. T., Pfledderer, C. D., Burkart, S. A., Armstrong, B., Weaver, R. G., & Beets, M. W. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01345-8 · Cited by 9 · see citing works
Meyer, B., Betz, L. T., Brückner, K., & Holtkamp, M. (2024) · Epilepsia Open · doi:10.1002/epi4.13014 · Cited by 9 · see citing works
Has the time come to stop using control groups in trials of psychosocial interventions?
Cuijpers, P. J. (2025) · World Psychiatry · doi:10.1002/wps.21359 · Cited by 9 · see citing works
Lavoie, P., Lapierre, A., Maheu‐Cadotte, M., Rodriguez, D., Lavallée, A., & Mailhot, T. (2022) · Nurse Education Today · doi:10.1016/j.nedt.2022.105361 · Cited by 10 · see citing works
Pratscher, S. D., Sibille, K. T., & Fillingim, R. B. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01247-9 · Cited by 8 · see citing works
Johnston, M. (2021) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2021.1939701 · Cited by 8 · see citing works
A Randomized Clinical Trial of Online Social Intelligence Training With Custodial Grandmothers
Smith, G. C., Infurna, F. J., Dolbin‐MacNab, M. L., Webster, B. A., Castro, S. A., Crowley, D. M., Musil, C. M., Hu, L., & Hancock, G. R. (2023) · The Gerontologist · doi:10.1093/geront/gnad079 · Cited by 8 · see citing works
Ymer, L., McKay, A., Wong, D. K., & Ponsford, J. L. (2022) · Pilot and Feasibility Studies · doi:10.1186/s40814-022-01070-8 · Cited by 7 · see citing works
Blonigen, D. M., Hyde, J. K., McInnes, D. K., Yoon, J., Byrne, T. H., Ngo, T., & Smelson, D. A. (2022) · Contemporary Clinical Trials · doi:10.1016/j.cct.2022.107065 · Cited by 7 · see citing works
Waki, K., Tsurutani, Y., Waki, H., Enomoto, S., Kashiwabara, K., Fujiwara, A., Orime, K., Kinguchi, S., Yamauchi, T., Hirawa, N., et al. (2024) · JMIR Research Protocols · doi:10.2196/53514 · Cited by 7 · see citing works
Bendtsen, M., Gunnarsson, K. U., & McCambridge, J. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-049810 · Cited by 7 · see citing works
Caldwell, D. M., Palmer, J. C., Webster, K. E., Davies, S. R., Hughes, H., Rona, J., Churchill, R. C., Hetrick, S. E., & Welton, N. J. (2025) · Prevention Science · doi:10.1007/s11121-025-01786-y · Cited by 4 · see citing works
D’Amelio, R., Betz, L. T., Jow, S. M., Retz, W., Philipsen, A., Klein, J. P., Faßbinder, E., Jacob, G. A., & Retz‐Junginger, P. (2026) · Psychological Medicine · doi:10.1017/s0033291726103390 · Cited by 7 · see citing works
Jeftic, I., Furzer, B. J., Dimmock, J. A., Wright, K. E., Budden, T., Boyd, C., Simpson, A., Rosenberg, M., Sabiston, C. M., deJonge, M. L., et al. (2023) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2023.102507 · Cited by 7 · see citing works
Barr, P. J., Masel, M. C., Bratches, R. W., Carpenter-Song, E. A., O’Malley, A. J., BRUCE, M. L., Goodwin, J. S., Kripalani, S. B., Tarczewski, S., Williams, S., et al. (2024) · Patient Education and Counseling · doi:10.1016/j.pec.2024.108574 · Cited by 5 · see citing works
Pfammatter, A. F., Battalio, S. L., Olvera, C., Dezelar, M., Moore, D., Scanlan, L., Siddique, J., Spring, B. J., & Chang, S. (2022) · Contemporary Clinical Trials · doi:10.1016/j.cct.2022.106750 · Cited by 6 · see citing works
Griffith, D. M., Pennings, J. S., & Jaeger, E. (2023) · American Journal of Men's Health · doi:10.1177/15579883231193235 · Cited by 4 · see citing works
The FINDING-Food Intervention: A Mixed-Methods Feasibility Study Addressing Food Insecurity
Royer, M. F., & Wharton, C. M. (2023) · Challenges · doi:10.3390/challe14040043 · Cited by 6 · see citing works
Courtney, D., Barwick, M. A., Amani, B., Greenblatt, A., Aitken, M., Krause, K. R., Andrade, B. F., BENNETT, K. J., Cleverley, K., Uliaszek, A. A., et al. (2024) · BMC Psychiatry · doi:10.1186/s12888-023-05297-4 · Cited by 6 · see citing works
Evaluating a targeted support program for mental health carers: a randomised controlled trial
Fitzgeraldson, E., Fitzpatrick, S., Dizon, J., & KAY‐LAMBKIN, F. J. (2024) · Advances in Mental Health · doi:10.1080/18387357.2024.2324103 · Cited by 6 · see citing works
Paraskeva, N., Haywood, S., Anquandah, J. S., White, P., Budhraja, M., Diedrichs, P. C., & Williamson, H. (2025) · Journal of Medical Internet Research · doi:10.2196/66625 · Cited by 5 · see citing works
Kim, M., Mansour-Assi, S., Mistiri, M. E., Park, J.-H., Banerjee, S., Khan, O., Torre, S. A. D. L., Higgins, M., Godino, J., Patrick, K., et al. (2025) · JMIR Research Protocols · doi:10.2196/70599 · Cited by 6 · see citing works
Scandiffio, J., Langer, L. K., Senthilnathan, V., Feng, G., Sureshkumar, A., Bromberg, M., Babineau, J., Donkers, S. J., Knox, K. B., Bruno, T. R., et al. (2025) · Journal of Neurology · doi:10.1007/s00415-025-13315-6 · Cited by 8 · see citing works
Baba, A., Smith, M., Potter, B. K., Chan, A.-W., Moher, D., Toulany, A., Doherty-Kirby, A., Escalera, B. N., Stratton, C., Gale, C., et al. (2026) · British medical journal · doi:10.1136/bmj-2025-085064 · Cited by 7 · see citing works
Earnshaw, V. A., Sepucha, K., Laurenceau, J., Subramanian, S. V., Hill, E. C., Wallace, J., Brousseau, N. M., Henderson, C., Brohan, E., Morrison, L. M., et al. (2023) · Journal of Substance Use and Addiction Treatment · doi:10.1016/j.josat.2024.209291 · Cited by 5 · see citing works
- Authors
- Freedland, K. E., King, A. C., Ambrosius, W. T., Mayo-Wilson, E., Mohr, D. C., Czajkowski, S. M., Thabane, L., Collins, L. M., Rebok, G. W., Treweek, S. P., Cook, T. D., Edinger, J. D., Stoney, C. M., Campo, R. A., Young-Hyman, D., & Riley, W. T.
- Affiliations
- Washington University in St. Louis (US)
- Stanford Medicine (US)
- Wake Forest University Health Sciences (US)
- Northwestern University (US)
- National Institutes of Health (US)
- McMaster University (CA)
- Pennsylvania State University (US)
- Johns Hopkins University (US)
- University of Aberdeen (GB)
- National Jewish Health (US)
- National Heart, Lung, and Blood Institute (US)
- Corresponding author
- Freedland, Kenneth E.
- ORCID
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2019-06
- Volume
- 110
- Pages
- 74-81
- ISSN
- 0895-4356 (ISSN-L)
- PMC
- PMC6543841
- OpenAlex
- W2918272982
- Cited by
- 218
- References
- 27
- Citations by year
- 2026: 32 · 2025: 35 · 2024: 37 · 2023: 34 · 2022: 36 · 2021: 21 · 2020: 17 · 2019: 6
- FWCI
- 15.57
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Clinical Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Carolina Digital Repository (University of North Carolina at Chapel Hill) (submittedVersion)
- Aberdeen University Research Archive (Aberdeen University) (submittedVersion)
- IUScholarWorks Open (Indiana University) (submittedVersion)
- UNC Libraries
- Funders
- National Institutes of Health (Z99 HL999999)
- National Heart, Lung, and Blood Institute (R01HL147862, R01HL119286)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- comparator selection, control groups, randomized controlled trials, best practice recommendations, trial design
- MeSH terms
- Mental Disorders, Female, Humans, Male, National Institutes of Health (U.S.), Psychotherapy, Research Design, United States, Randomized Controlled Trials as Topic, Practice Guidelines as Topic, Patient Selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review