Sample size calculations for micro‐randomized trials in mHealth
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
The use and development of mobile interventions are experiencing rapid growth. In “just‐in‐time” mobile interventions, treatments are provided via a mobile device, and they are intended to help an individual make healthy decisions ‘in the moment,’ and thus have a proximal, near future impact. Currently, the development of mobile interventions is proceeding at a much faster pace than that of associated data science methods. A first step toward developing data‐based methods is to provide an experimental design for testing the proximal effects of these just‐in‐time treatments. In this paper, we propose a ‘micro‐randomized’ trial design for this purpose. In a micro‐randomized trial, treatments are sequentially randomized throughout the conduct of the study, with the result that each participant may be randomized at the 100s or 1000s of occasions at which a treatment might be provided. Further, we develop a test statistic for assessing the proximal effect of a treatment as well as an associated sample size calculator. We conduct simulation evaluations of the sample size calculator in various settings. Rules of thumb that might be used in designing a micro‐randomized trial are discussed. This work is motivated by our collaboration on the HeartSteps mobile application designed to increase physical activity. Copyright © 2015 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Robins, J. (1986) · Mathematical Modelling · doi:10.1016/0270-0255(86)90088-6 · Cited by 2,451 · cited 2×
“tated power to detect the proximal effect of a treatment. In particular we aim to test if the proximal main effect is zero. To define the proximal main effect of a treatment, we use potential outcomes [22, 23, 25]. Our use of potential outcome notation is slightly more complicated than usual because treatment can only…”
BackgroundFree, C., Phillips, G., Galli, L., Watson, L., Felix, L., Edwards, P., Patel, V., & Haines, A. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001362 · Cited by 1,766 · cited 2×
“rogenic applications will be implemented.”Indeed reviews, while reporting preliminary evidence of effectiveness, call for more programmatic, data-based approaches to constructing mobile interventions [8, 19]. In particular these reviews call for research that focuses on data-informed development of these complex multi…”
BackgroundA Smartphone Application to Support Recovery From Alcoholism: A Randomized Clinical Trial
Gustafson, D. H., McTavish, F. M., Chih, M.-Y., Atwood, A. K., Johnson, R. A., Boyle, M. G., Levy, M. S., Driscoll, H., Chisholm, S. M., Dillenburg, L., et al. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.4642 · Cited by 692 · cited 1×
“…used across the health fields and include treatments to improve HIV medication adherence [1, 2], to increase activity [3], supplement counseling/pharmacotherapy in treatment for substance use [4, 5], reinforce abstinence in addictions [6, 7] and to support recovery from alcohol dependence [8, 9].”
BackgroundAdvancing the science of mHealth
Nilsen, W., Kumar, S., Shar, A., Varoquiers, C., Wiley, T., Riley, W. T., Pavel, M., & Atienza, A. A. (2012) · Journal of Health Communication · doi:10.1080/10810730.2012.677394 · Cited by 226
Kaplan, R. M., & Stone, A. A. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143736 · Cited by 144 · cited 1×
“Mobile interventions are used across the health fields and include treatments to improve HIV medication adherence [1, 2], to increase activity [3], supplement counseling/pharmacotherapy in treatment for substance use [4, 5], reinforce abstinence in addictions [6, 7] and to support recovery from…”
BackgroundWang, L., Rotnitzky, A., Lin, X., Millikan, R. E., & Thall, P. F. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2011.641416 · Cited by 108 · cited 1×
“The former conditional aspect of the definition is related to the concept of viable or feasible dynamic treatment regimes [20,21] in which one assesses only the causal effect of treatments that can actually be provided.”
BackgroundDeveloping multicomponent interventions using fractional factorial designs
Chakraborty, B., Collins, L. M., Strecher, V. J., & Murphy, S. A. (2009) · Statistics in Medicine · doi:10.1002/sim.3643 · Cited by 107 · cited 1×
“In these factorial designs [15, 16], a first analysis often involves testing if the main effect of each treatment is equal to 0.”
MethodSelf-citation
Cited by
Nahum-Shani, I., Smith, S. N., Spring, B. J., Collins, L. M., Witkiewitz, K., Tewari, A., & Murphy, S. A. (2018) · Annals of Behavioral Medicine · doi:10.1007/s12160-016-9830-8 · Cited by 2,171
Self-citationMicrorandomized trials: An experimental design for developing just-in-time adaptive interventions.
Klasnja, P., Hekler, E. B., Shiffman, S., Boruvka, A., Almirall, D., Tewari, A., & Murphy, S. A. (2015) · Health Psychology · doi:10.1037/hea0000305 · Cited by 671
Self-citationNahum-Shani, I., Hekler, E. B., & Spruijt-Metz, D. (2015) · Health Psychology · doi:10.1037/hea0000306 · Cited by 568
Inan, O. T., Tenaerts, P., Prindiville, S. A., Reynolds, H. R., Dizon, D. S., Cooper-Arnold, K., Turakhia, M., Pletcher, M. J., Preston, K. L., Krumholz, H. M., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0302-y · Cited by 329
“Micro-randomized trials 56,57 , a method that repeatedly randomizes provision of an intervention to each person each time that intervention may be provided, can identify factors such as timing and dose for optimally delivering digital trial tools such as reminders and engagement strategies for…”
MethodSelf-citationKlasnja, P., Smith, S., Seewald, N. J., Lee, A., Hall, K., Luers, B., Hekler, E. B., & Murphy, S. A. (2019) · Annals of Behavioral Medicine · doi:10.1093/abm/kay067 · Cited by 241
Self-citationAssessing time-varying causal effect moderation in mobile health
Boruvka, A., Almirall, D., Witkiewitz, K., & Murphy, S. A. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1305274 · Cited by 152
Self-citationEvaluating the Impact of Physical Activity Apps and Wearables: Interdisciplinary Review
McCallum, C., Rooksby, J., & Gray, C. M. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.9054 · Cited by 126
“To test the impact of individual components, quick factorial approaches have been developed, including the multiphase optimization strategy (MOST), which rapidly tests many experimental conditions [28,29], and Sequential Multiple Assignment Randomized Trials [30] and micro-randomized trials [31], which both evaluate c…”
MethodDesigning m-Health interventions for precision mental health support
Bidargaddi, N., Schrader, G., Klasnja, P., Licinio, J., & Murphy, S. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-00895-2 · Cited by 92
Self-citationRiley, W. T., Serrano, K. J., Nilsen, W., & Atienza, A. A. (2015) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2015.03.024 · Cited by 76
Optimizing Digital Integrated Care via Micro‐Randomized Trials
Walton, A., Nahum‐Shani, I., Crosby, L., Klasnja, P., & Murphy, S. (2018) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.1079 · Cited by 66
Self-citationToward Usable Evidence: Optimizing Knowledge Accumulation in HCI Research on Health Behavior Change
Klasnja, P., Hekler, E. B., Korinek, E. V., Harlow, J., & Mishra, S. R. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3026013 · Cited by 44
Self-citationNahum-Shani, I., Rabbi, M., Yap, J., Philyaw-Kotov, M. L., Klasnja, P., Bonar, E. E., Cunningham, R. M., Murphy, S. A., & Walton, M. A. (2021) · Health Psychology · doi:10.1037/hea0001101 · Cited by 41
Self-citationGoldstein, S. P., Zhang, F., Klasnja, P., Hoover, A., Wing, R. R., & Thomas, J. G. (2021) · JMIR Research Protocols · doi:10.2196/33568 · Cited by 26
“Statistical power and sample size were calculated according to the established procedures for powering MRTs, as described by Liao et al [17], which enable robust treatment effect estimation using the centered and weighted least squares method [80].”
InfluentialSelf-citationThe mobile assistance for regulating smoking (MARS) micro-randomized trial design protocol
Nahum-Shani, I., Potter, L. N., Lam, C. Y., Yap, J., Moreno, A., Stoffel, R., Wu, Z., Wan, N., Dempsey, W., Kumar, S., et al. (2021) · Contemporary Clinical Trials · doi:10.1016/j.cct.2021.106513 · Cited by 23
Self-citationKroska, E. B., Hoel, S., Victory, A., Murphy, S. A., McInnis, M. G., Stowe, Z. N., & Cochran, A. (2020) · JMIR Research Protocols · doi:10.2196/17086 · Cited by 12
“For the college student cohort, power was calculated using the supported calculator for adaptive interventions [26], available online [45].”
Self-citationLaure, T., Engels, R. C. M. E., Remmerswaal, D., Spruijt-Metz, D., Konigorski, S., & Boffo, M. (2023) · JMIR Research Protocols · doi:10.2196/46603 · Cited by 4
“A web-based sample size calculator for MRT studies [57,58] was used to calculate the sample size based on the duration of the intervention period (21 days), expected availability intervention randomization probability (60%), and proximal treatment effect.”
MethodValle, C. G., Nezami, B. T., O’Shea, N. G., Hatley, K. E., & Tate, D. F. (2025) · DIGITAL HEALTH · doi:10.1177/20552076251353267 · Cited by 4
Metadata
- Authors
- Liao, P., Klasnja, P., Tewari, A., & Murphy, S. A.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2015-12-28
- Volume
- 35
- Issue
- 12
- Pages
- 1944-1971
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2218502003
- Cited by
- 136
- References
- 7
- FWCI
- 9.64
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.