Investigating intervention components and exploring states of receptivity for a smartphone app to promote physical activity: Protocol of a microrandomized trial
Open accessPublished version of a preprint
Abstract
BACKGROUND: Smartphones enable the implementation of just-in-time adaptive interventions (JITAIs) that tailor the delivery of health interventions over time to user- and time-varying context characteristics. Ideally, JITAIs include effective intervention components, and delivery tailoring is based on effective moderators of intervention effects. Using machine learning techniques to infer each user's context from smartphone sensor data is a promising approach to further enhance tailoring. OBJECTIVE: The primary objective of this study is to quantify main effects, interactions, and moderators of 3 intervention components of a smartphone-based intervention for physical activity. The secondary objective is the exploration of participants' states of receptivity, that is, situations in which participants are more likely to react to intervention notifications through collection of smartphone sensor data. METHODS: In 2017, we developed the Assistant to Lift your Level of activitY (Ally), a chatbot-based mobile health intervention for increasing physical activity that utilizes incentives, planning, and self-monitoring prompts to help participants meet personalized step goals. We used a microrandomized trial design to meet the study objectives. Insurees of a large Swiss insurance company were invited to use the Ally app over a 12-day baseline and a 6-week intervention period. Upon enrollment, participants were randomly allocated to either a financial incentive, a charity incentive, or a no incentive condition. Over the course of the intervention period, participants were repeatedly randomized on a daily basis to either receive prompts that support self-monitoring or not and on a weekly basis to receive 1 of 2 planning interventions or no planning. Participants completed a Web-based questionnaire at baseline and postintervention follow-up. RESULTS: Data collection was completed in January 2018. In total, 274 insurees (mean age 41.73 years; 57.7% [158/274] female) enrolled in the study and installed the Ally app on their smartphones. Main reasons for declining participation were having an incompatible smartphone (37/191, 19.4%) and collection of sensor data (35/191, 18.3%). Step data are available for 227 (82.8%, 227/274) participants, and smartphone sensor data are available for 247 (90.1%, 247/274) participants. CONCLUSIONS: This study describes the evidence-based development of a JITAI for increasing physical activity. If components prove to be efficacious, they will be included in a revised version of the app that offers scalable promotion of physical activity at low cost. TRIAL REGISTRATION: ClinicalTrials.gov NCT03384550; https://clinicaltrials.gov/ct2/show/NCT03384550 (Archived by WebCite at http://www.webcitation.org/74IgCiK3d). INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/11540.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
All analyses were prespecified.
“All analyses were prespecified (21).”
From Which Components of a Smartphone Walking App Help Users to Reach Personalized Step Goals? Results From an Optimization Trial (2020) · cites this paper as [21]
Previous studies in other health domains have demonstrated promising results in using conversational agents to improve outcomes, such as promoting physical activity for childhood obesity.
“Previous studies in other health domains have demonstrated promising results in using conversational agents to improve outcomes, such as promoting physical activity for childhood obesity [104,114].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
User Acceptance of Information Technology: Toward A Unified View1
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003) · MIS Quarterly · doi:10.2307/30036540 · Cited by 45,035 · see citing works
Intrinsic Motivation and Self-Determination in Human Behavior
Deci, E. L., & Ryan, R. M. (1985) · doi:10.1007/978-1-4899-2271-7 · Cited by 26,772 · see citing works
International physical activity questionnaire: 12-country reliability and validity
CRAIG, C. L., MARSHALL, A. L., SJ??STR??M, M., BAUMAN, A. E., BOOTH, M. L., AINSWORTH, B. E., PRATT, M., EKELUND, U., YNGVE, A., SALLIS, J. F., et al. (2003) · Medicine & Science in Sports & Exercise · doi:10.1249/01.mss.0000078924.61453.fb · Cited by 21,619 · see citing works
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526 · see citing works
WARE, J. E., KOSINSKI, M., & KELLER, S. D. (1996) · Medical Care · doi:10.1097/00005650-199603000-00003 · Cited by 17,392 · cited 1× · see citing works
“An overview of all measured variables is available in Multimedia Appendix 1 ([49-57]).”
BackgroundVenkatesh, V., Thong, J. Y. L., & Xu, X. (2012) · MIS Quarterly · doi:10.2307/41410412 · Cited by 15,756 · see citing works
Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., Eccles, M. P., Cane, J., & Wood, C. E. (2013) · Annals of Behavioral Medicine · doi:10.1007/s12160-013-9486-6 · Cited by 7,629 · see citing works
Deci, E. L., Koestner, R., & Ryan, R. M. (1999) · Psychological Bulletin · doi:10.1037/0033-2909.125.6.627 · Cited by 7,176 · cited 1× · see citing works
“However, financial incentives may reduce intrinsic motivation [40,41]; thus, charity incentives have been proposed as an alternative incentive strategy.”
BackgroundImplementation intentions: Strong effects of simple plans.
Gollwitzer, P. M. (1999) · American Psychologist · doi:10.1037/0003-066x.54.7.493 · Cited by 5,478 · see citing works
Rammstedt, B., & John, O. P. (2007) · Journal of Research in Personality · doi:10.1016/j.jrp.2006.02.001 · Cited by 4,244 · cited 1× · see citing works
“An overview of all measured variables is available in Multimedia Appendix 1 ([49-57]).”
BackgroundIntention—Behavior Relations: A Conceptual and Empirical Review
Sheeran, P. (2002) · European Review of Social Psychology · doi:10.1080/14792772143000003 · Cited by 3,688 · see citing works
Implementation intentions and goal achievement: a meta-analysis of effects and processes
Gollwitzer, P. M., & Sheeran, P. (2006) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(06)38002-1 · Cited by 3,236 · cited 1× · see citing works
“Forming specific plans about when and how to act increases the likelihood of performing the intended behavior [27,28] and helps to bridge the so-called intention behavior gap.”
BackgroundCarver, C. S., & Scheier, M. F. (1982) · Psychological Bulletin · doi:10.1037//0033-2909.92.1.111 · Cited by 2,650 · see citing works
Effective techniques in healthy eating and physical activity interventions: A meta-regression.
Michie, S., Abraham, C., Whittington, C., McAteer, J., & Gupta, S. (2009) · Health Psychology · doi:10.1037/a0016136 · Cited by 2,229 · see citing works
Nahum-Shani, I., Smith, S. N., Spring, B. J., Collins, L. M., Witkiewitz, K., Tewari, A., & Murphy, S. A. (2018) · Annals of Behavioral Medicine · doi:10.1007/s12160-016-9830-8 · Cited by 2,171 · see citing works
Self-citationHow Many Steps/Day Are Enough?: Preliminary Pedometer Indices for Public Health
Tudor-Locke, C., & Bassett, D. R. (2004) · Sports Medicine · doi:10.2165/00007256-200434010-00001 · Cited by 2,054 · see citing works
Intrinsic motivation and extrinsic incentives jointly predict performance: A 40-year meta-analysis.
Cerasoli, C. P., Nicklin, J. M., & Ford, M. T. (2014) · Psychological Bulletin · doi:10.1037/a0035661 · Cited by 1,981 · cited 1× · see citing works
“However, financial incentives may reduce intrinsic motivation [40,41]; thus, charity incentives have been proposed as an alternative incentive strategy.”
BackgroundGuay, F., Vallerand, R. J., & Blanchard, C. (2000) · Motivation and Emotion · doi:10.1023/a:1005614228250 · Cited by 1,579 · see citing works
Markland, D., & Tobin, V. (2004) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.26.2.191 · Cited by 1,444 · cited 6× · see citing works
“Subscales of both instruments have shown good reliability (Cronbach alpha=.73-.86, BREQ-2 [46] and Cronbach alpha=.86, SIMS external regulation subscale [47]).”
MethodInfluentialThe two‐period cross‐over clinical trial.
Hills, M., & Armitage, P. (1979) · British Journal of Clinical Pharmacology · doi:10.1111/j.1365-2125.1979.tb05903.x · Cited by 1,403 · see citing works
Heath, C., Larrick, R. P., & Wu, G. (1999) · Cognitive Psychology · doi:10.1006/cogp.1998.0708 · Cited by 1,009 · see citing works
Action planning and coping planning for long-term lifestyle change: theory and assessment
Sniehotta, F. F., Schwarzer, R., Scholz, U., & Schüz, B. (2005) · European Journal of Social Psychology · doi:10.1002/ejsp.258 · Cited by 978 · see citing works
Self-citationEvaluating Digital Health Interventions
Murray, E., Hekler, E. B., Andersson, G., Collins, L. M., Doherty, A., Hollis, C., Rivera, D. E., West, R., & Wyatt, J. C. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.008 · Cited by 847 · see citing works
The emerging field of mobile health
Steinhubl, S. R., Muse, E. D., & Topol, E. J. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aaa3487 · Cited by 822 · see citing works
Schwarzer, R., Lippke, S., & Luszczynska, A. (2011) · Rehabilitation Psychology · doi:10.1037/a0024509 · Cited by 743 · see citing works
Accuracy of Smartphone Applications and Wearable Devices for Tracking Physical Activity Data
Case, M. A., Burwick, H. A., Volpp, K. G., & Patel, M. S. (2015) · JAMA · doi:10.1001/jama.2014.17841 · Cited by 694 · see citing works
Microrandomized trials: An experimental design for developing just-in-time adaptive interventions.
Klasnja, P., Hekler, E. B., Shiffman, S., Boruvka, A., Almirall, D., Tewari, A., & Murphy, S. A. (2015) · Health Psychology · doi:10.1037/hea0000305 · Cited by 671 · see citing works
Kelly, P., Kahlmeier, S., Götschi, T., Orsini, N., Richards, J. A., Roberts, N. W., Scarborough, P., & Foster, C. E. (2014) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-014-0132-x · Cited by 518 · see citing works
Revisiting "How Many Steps Are Enough?"
Tudor-Locke, C. E., Hatano, Y., Pangrazi, R. P., & Kang, M. (2008) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31817c7133 · Cited by 511 · see citing works
Rachuri, K. K., Musolesi, M., Cecilia Mascolo, C., Rentfrow, P. J., Longworth, C., & Auçinas, A. (2010) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/1864349.1864393 · Cited by 509 · see citing works
The Role of Perceived Personal Barriers to Engagement in Leisure-Time Physical Activity
Reichert, F. F., Barros, A. J. D., Domingues, M. R., & Hallal, P. C. (2007) · American Journal of Public Health · doi:10.2105/ajph.2005.070144 · Cited by 507 · see citing works
Mann, T. L., de Ridder, D. T. D., & Fujita, K. (2013) · Health Psychology · doi:10.1037/a0028533 · Cited by 455 · see citing works
How to Overcome Health-Compromising Behaviors: The Health Action Process Approach
Schwarzer, R., & Luszczynska, A. (2008) · European Psychologist · doi:10.1027/1016-9040.13.2.141 · Cited by 424 · see citing works
A meta-analytic review of the effect of implementation intentions on physical activity
Bélanger-Gravel, A., Godin, G., & Amireault, S. (2013) · Health Psychology Review · doi:10.1080/17437199.2011.560095 · Cited by 413 · see citing works
Pedometer-Measured Physical Activity and Health Behaviors in U.S. Adults
Bassett, D. R., Wyatt, H. R., Thompson, H., Peters, J. C., & Hill, J. O. (2010) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e3181dc2e54 · Cited by 410 · see citing works
Finkelstein, E. A., Haaland, B. A., Bilger, M., Sahasranaman, A., Sloan, R. A., Nang, E. E. K., & Evenson, K. R. (2016) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(16)30284-4 · Cited by 402 · see citing works
Design, analysis and presentation of factorial randomised controlled trials
Montgomery, A. A., Peters, T. J., & Little, P. S. (2003) · BMC Medical Research Methodology · doi:10.1186/1471-2288-3-26 · Cited by 320 · see citing works
Financial incentives for exercise adherence in adults
Mitchell, M. S., Goodman, J. M., Alter, D. A., John, L. K., Oh, P. I., Pakosh, M. T., & Faulkner, G. E. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.06.017 · Cited by 303 · see citing works
Pejović, V., & Musolesi, M. (2014) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2632048.2632062 · Cited by 283 · see citing works
Glynn, L. G., Hayes, P. S., Casey, M., Glynn, F., Alvarez‐Iglesias, A., Newell, J., OLaighin, G. M., Heaney, D., O'Donnell, M. J., & Murphy, A. W. (2014) · British Journal of General Practice · doi:10.3399/bjgp14x680461 · Cited by 280 · see citing works
Ziegelmann, J. P., Lippke, S., & Schwarzer, R. (2006) · Psychology and Health · doi:10.1080/1476832050018891 · Cited by 271 · see citing works
Framing Financial Incentives to Increase Physical Activity Among Overweight and Obese Adults
Patel, M. S., Asch, D. A., Rosin, R. M., Small, D. S., Bellamy, S. L., Heuer, J., Sproat, S., Hyson, C., Haff, N., Lee, S. M., et al. (2016) · Annals of Internal Medicine · doi:10.7326/m15-1635 · Cited by 257 · see citing works
Sequeira, M. M., Rickenbach, M., Wietlisbach, V., Tullen, B., & Schutz, Y. (1995) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117748 · Cited by 250 · see citing works
When attention is not scarce - detecting boredom from mobile phone usage
Pielot, M., Dingler, T., Pedro, J. S., & Oliver, N. (2015) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2750858.2804252 · Cited by 247 · see citing works
Hootman, J. M. (2001) · American Journal of Epidemiology · doi:10.1093/aje/154.3.251 · Cited by 226 · see citing works
Response to a relational agent by hospital patients with depressive symptoms
Bickmore, T. W., Mitchell, S. E., Jack, B. W., Paasche-Orlow, M. K., Pfeifer, L. M., & O’Donnell, J. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2009.12.001 · Cited by 218 · see citing works
Fischer, J. E., Greenhalgh, C., & Benford, S. (2011) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/2037373.2037402 · Cited by 189 · see citing works
Perceived Barriers to Leisure-Time Physical Activity in Adults: An Ecological Perspective
Cerin, E., Leslie, E. R., Sugiyama, T., & Owen, N. G. (2010) · Journal of Physical Activity and Health · doi:10.1123/jpah.7.4.451 · Cited by 186 · see citing works
Zunft, H.-J. F., Friebe, D., Seppelt, B., Widhalm, K., Winter, A.-M. R., de Almeida, M. D. V., Kearney, J. M., & Gibney, M. J. (1999) · Public Health Nutrition · doi:10.1017/s1368980099000208 · Cited by 182 · see citing works
The role of action control in implementing intentions during the first weeks of behaviour change
Sniehotta, F. F., Nagy, G., Scholz, U., & Schwarzer, R. (2006) · British Journal of Social Psychology · doi:10.1348/014466605x62460 · Cited by 172 · see citing works
Self-citationAn Adaptive Physical Activity Intervention for Overweight Adults: A Randomized Controlled Trial
Adams, M. A., Sallis, J. F., Norman, G. J., Hovell, M. F., Hekler, E. B., & Perata, E. (2013) · PLoS ONE · doi:10.1371/journal.pone.0082901 · Cited by 167 · see citing works
Assessing time-varying causal effect moderation in mobile health
Boruvka, A., Almirall, D., Witkiewitz, K., & Murphy, S. A. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1305274 · Cited by 152 · see citing works
Patel, M. S., Asch, D. A., Rosin, R. M., Small, D. S., Bellamy, S. L., Eberbach, K., Walters, K. J., Haff, N., Lee, S. M., Wesby, L., et al. (2016) · Journal of General Internal Medicine · doi:10.1007/s11606-016-3627-0 · Cited by 146 · see citing works
Spittaels, H., Verloigne, M., Gidlow, C. J., Gloanec, J., Titze, S., Foster, C. E., Oppert, J., Rutter, H., Oja, P., Sjöstróm, M., et al. (2010) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-7-48 · Cited by 133 · see citing works
Lippke, S., Schwarzer, R., Ziegelmann, J. P., Scholz, U., & Schüz, B. (2010) · Health Education & Behavior · doi:10.1177/1090198109359386 · Cited by 128 · see citing works
Self-citationAdams, M. A., Hurley, J. C., Todd, M., Bhuiyan, N., Jarrett, C. L., Tucker, W. J., Hollingshead, K. E., & Angadi, S. S. (2017) · BMC Public Health · doi:10.1186/s12889-017-4197-8 · Cited by 110 · see citing works
Naimark, J. S., Madar, Z., & Shahar, D. R. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3682 · Cited by 108 · see citing works
Barte, J. C. M., & Wendel‐Vos, W. (2015) · Behavioral Medicine · doi:10.1080/08964289.2015.1074880 · Cited by 107 · see citing works
Scholz, U., Keller, R., & Perren, S. (2009) · Health Psychology · doi:10.1037/a0016088 · Cited by 90 · see citing works
Self-citationHaug, S., Castro, R. P., Kowatsch, T., Filler, A., Dey, M., & Schaub, M. P. (2016) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000138 · Cited by 81 · see citing works
Self-citationDuncan, M. J., Wunderlich, K., Zhao, Y., & Faulkner, G. (2018) · Journal of Sports Sciences · doi:10.1080/02640414.2017.1409855 · Cited by 76 · see citing works
Filler, A., Kowatsch, T., Haug, S., Wahle, F., Staake, T., & Fleisch, E. (2015) · 2015 Wireless Telecommunications Symposium (WTS) · doi:10.1109/wts.2015.7117255 · Cited by 63 · see citing works
Self-citationA Trial of Financial and Social Incentives to Increase Older Adults’ Walking
Harkins, K. A., Kullgren, J. T., Bellamy, S. L., Karlawish, J. H., & Glanz, K. (2017) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.11.011 · Cited by 59 · see citing works
Castro, R. P., Haug, S., Filler, A., Kowatsch, T., & Schaub, M. P. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7928 · Cited by 37 · see citing works
Self-citationKünzler, F., Kramer, J.-N., & Kowatsch, T. (2017) · IEEE International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob) · doi:10.1109/wimob.2017.8115839 · Cited by 21 · see citing works
Self-citationAdvanced and Accurate Mobile Health Tracking Devices Record New Cardiac Vital Signs
Modena, B. D., Bellahsen, O., Nikzad, N., Chieh, A. Y., Parikh, N., Dufek, D. M., Ebner, G. S., Topol, E. J., & Steinhubl, S. R. (2018) · Hypertension · doi:10.1161/hypertensionaha.118.11177 · Cited by 20 · see citing works
Künzler, F., Kramer, J.-N., & Kowatsch, T. (2017) · Alexandria (UniSG) (University of St.Gallen) · doi:10.3929/ethz-b-000218431 · Cited by 14 · see citing works
Self-citationKowatsch, T., Kramer, J.-N., Kehr, F., Wahle, F., Elser, N., & Fleisch, E. (2016) · JMIR Research Protocols · doi:10.2196/resprot.6089 · Cited by 6 · see citing works
Self-citationZehnder, A. (2006) · kma - Klinik Management aktuell · doi:10.1055/s-0036-1573965 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Conversational Agents in Health Care: Scoping Review and Conceptual Analysis
Tudor Car, L., Dhinagaran, D. A., Kyaw, B. M., Kowatsch, T., Joty, S., Theng, Y.-L., & Atun, R. (2020) · Journal of Medical Internet Research · doi:10.2196/17158 · Cited by 553 · see citing works
“Finally, we excluded articles with poorly reported data on chatbot assessments; therefore, we may have missed some health care conversational agents (Multimedia Appendix 5 [36,97,104-188]).”
BackgroundSelf-citationPhysicians’ perceptions of chatbots in health Care: cross-sectional web-based survey
Palanica, A., Flaschner, P., Thommandram, A., Li, M., & Fossat, Y. (2019) · Journal of Medical Internet Research · doi:10.2196/12887 · Cited by 384 · see citing works
Zhang, J., Oh, Y. J., Lange, P., Yu, Z., & Fukuoka, Y. (2020) · Journal of Medical Internet Research · doi:10.2196/22845 · Cited by 363 · see citing works
Chatbot usage intention analysis: Veterinary consultation
Huang, D.-H., & Chueh, H.-E. (2020) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2020.09.002 · Cited by 138 · see citing works
Perski, O., Crane, D., Beard, E., & Brown, J. (2019) · DIGITAL HEALTH · doi:10.1177/2055207619880676 · Cited by 135 · see citing works
Kowatsch, T., Schachner, T., Harperink, S., Barata, F., Dittler, U., Xiao, G., Stanger, C., v Wangenheim, F., Fleisch, E., Oswald, H., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/25060 · Cited by 103 · see citing works
Self-citationKramer, J.-N., Künzler, F., Mishra, V., Smith, S. N., Kotz, D., Scholz, U., Fleisch, E., & Kowatsch, T. (2020) · Annals of Behavioral Medicine · doi:10.1093/abm/kaaa002 · Cited by 84 · see citing works
Self-citationDetecting Receptivity for mHealth Interventions in the Natural Environment
Mishra, V., Künzler, F., Kramer, J.-N., Fleisch, E., Kowatsch, T., & Kotz, D. F. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3463492 · Cited by 85 · see citing works
Self-citationExploring the State-of-Receptivity for mHealth Interventions
Künzler, F., Mishra, V., Kramer, J.-N., Kotz, D. F., Fleisch, E., & Kowatsch, T. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3369805 · Cited by 83 · see citing works
Self-citationPromoting Physical Activity Through Conversational Agents: Mixed Methods Systematic Review
Luo, T. C., Aguilera, A., Lyles, C. R., & Figueroa, C. A. (2021) · Journal of Medical Internet Research · doi:10.2196/25486 · Cited by 68 · see citing works
Increasing and Evolving Role of Smart Devices in Modern Medicine
Massoomi, M. R., & Handberg, E. M. (2019) · European Cardiology Review · doi:10.15420/ecr.2019.02 · Cited by 64 · see citing works
Examining Responsiveness to an Incentive-Based Mobile Health App: Longitudinal Observational Study
Brower, J., LaBarge, M., White, L., & Mitchell, M. (2020) · Journal of Medical Internet Research · doi:10.2196/16797 · Cited by 57 · see citing works
Estimating time-varying causal excursion effects in mobile health with binary outcomes
Qian, T., Yoo, H., Klasnja, P., Almirall, D., & Murphy, S. A. (2020) · Biometrika · doi:10.1093/biomet/asaa070 · Cited by 54 · see citing works
Daryabeygi‐Khotbehsara, R., Islam, S. M. S., Dunstan, D. W., McVicar, J., Abdelrazek, M., & Maddison, R. (2021) · Journal of Medical Internet Research · doi:10.2196/26315 · Cited by 50 · see citing works
Fernández, M. D. P., Bron, G. M., Kache, P. A., Larson, S. R., Maus, A., Gustafson, D. H., Tsao, J. I., Bartholomay, L. C., Paskewitz, S. M., & Diuk‐Wasser, M. A. (2019) · JMIR mhealth and uhealth · doi:10.2196/14769 · Cited by 38 · see citing works
Dhinagaran, D. A., Martinengo, L., Ho, M. R., Joty, S., Kowatsch, T., Atun, R. A., & Car, L. T. (2022) · JMIR mhealth and uhealth · doi:10.2196/38740 · Cited by 36 · see citing works
Self-citationOllier, J., Neff, S., Dworschak, C., Sejdiji, A., Santhanam, P., Keller, R., Xiao, G., Asisof, A., Rüegger, D., Bérubé, C., et al. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.625640 · Cited by 28 · see citing works
Self-citationPogorskiy, E., & Beckmann, J. F. (2022) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2022.100111 · Cited by 31 · see citing works
Goldstein, S. P., Zhang, F., Klasnja, P., Hoover, A., Wing, R. R., & Thomas, J. G. (2021) · JMIR Research Protocols · doi:10.2196/33568 · Cited by 26 · see citing works
Thompson, D., & Baranowski, T. (2019) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz065 · Cited by 22 · see citing works
Just-in-Time Adaptive Interventions: Where Are We Now and What Is Next?
Nahum-Shani, I. B., & Murphy, S. A. (2025) · Annual Review of Psychology · doi:10.1146/annurev-psych-121024-044244 · Cited by 30 · see citing works
Kowatsch, T., & Fleisch, E. (2021) · Springer eBooks · doi:10.1007/978-3-030-76897-3_4 · Cited by 22 · see citing works
Self-citationValle, C. G., Pinto, B. M., LaRose, J. G., Diamond, M. A., Horrell, L. N., Nezami, B. T., Hatley, K. E., Coffman, E. M., Polzien, K. M., Hales, D. P., et al. (2021) · Contemporary Clinical Trials · doi:10.1016/j.cct.2021.106293 · Cited by 21 · see citing works
Domin, A., Uslu, A. S., Schulz, A., Ouzzahra, Y., & Vögele, C. (2022) · JMIR Formative Research · doi:10.2196/35118 · Cited by 21 · see citing works
Ollier, J., Suryapalli, P., Fleisch, E., von Wangenheim, F., Mair, J. L., Salamanca-Sanabria, A., & Kowatsch, T. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1185702 · Cited by 19 · see citing works
Self-citationMagalhães, B. M. B. D. S., Fernandes, C. S., Santos, C., & Martínez‐Galiano, J. M. (2020) · Cancer Nursing · doi:10.1097/ncc.0000000000000823 · Cited by 21 · see citing works
Brons, A., Wang, S., Visser, B., Kröse, B., Bakkes, S. C. J., & Veltkamp, R. C. (2024) · Journal of Medical Internet Research · doi:10.2196/47774 · Cited by 18 · see citing works
Sun, X., Teljeur, I., Li, Z., & Bosch, J. A. (2024) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3640794.3665555 · Cited by 20 · see citing works
Foodbot: A Goal-Oriented Just-in-Time Healthy Eating Interventions Chatbot
Prasetyo, P. K., Achananuparp, P., & Lim, E. (2020) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · doi:10.48550/arxiv.2009.05704 · Cited by 16 · see citing works
de Buisonjé, D. R., Reijnders, T., Rodrigues, T. C., Santhanam, P., Kowatsch, T., Lipman, S. A., Bijmolt, T. H. A., Breeman, L. D., Janssen, V. R., Kraaijenhagen, R. A., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/38339 · Cited by 18 · see citing works
Self-citationSingla, S. K. (2020) · Springer eBooks · doi:10.1007/978-3-030-37526-3_1 · Cited by 14 · see citing works
Yao, J., Brunskill, E., Pan, W., Murphy, S. A., & Doshi‐Velez, F. (2020) · PubMed · doi:10.48550/arxiv.2004.06230 · Cited by 13 · see citing works
Kroska, E. B., Hoel, S., Victory, A., Murphy, S. A., McInnis, M. G., Stowe, Z. N., & Cochran, A. (2020) · JMIR Research Protocols · doi:10.2196/17086 · Cited by 12 · see citing works
Robles, M. C., Newman, M., Doshi, A., Bailey, S., Huang, L., Choi, S. J., Kurien, C., Merid, B., Cowdery, J. E., Golbus, J. R., et al. (2021) · JMIR Formative Research · doi:10.2196/33087 · Cited by 12 · see citing works
Context-aware notification management systems for just-in-time adaptive interventions
Künzler, F. (2019) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2019.8730874 · Cited by 12 · see citing works
Self-citationCotie, P. N. R., Willms, A., & Liu, S. (2025) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph22071133 · Cited by 10 · see citing works
The social meaning of steps: user reception of a mobile health intervention on physical activity
Presset, B., Kramer, J.-N., Kowatsch, T., & Ohl, F. (2020) · Critical Public Health · doi:10.1080/09581596.2020.1725445 · Cited by 9 · see citing works
Self-citationMakhmutova, M., Kainkaryam, R., Ferreira, M., Min, J. S., Jaggi, M., & Clay, I. (2021) · doi:10.1145/3469266.3469878 · Cited by 7 · see citing works
Li, S., Psihogios, A. M., McKelvey, E. R., Ahmed, A., Rabbi, M., & Murphy, S. A. (2020) · Current Opinion in Systems Biology · doi:10.1016/j.coisb.2020.07.002 · Cited by 7 · see citing works
From sensing to intervention for mental and behavioral health
Mishra, V. (2019) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3341162.3349304 · Cited by 6 · see citing works
Self-citationAmulet: an open-source wrist-worn platform for mHealth research and education
Kotz, D. F. (2019) · International Conference on Communication Systems & Networks (COMSNETS) · doi:10.1109/comsnets.2019.8711407 · Cited by 6 · see citing works
Self-citationYan, X., Baroudi, L., Bei, R., Boudalia, L., Cain, S. M., Barton, K. L., Shorter, K. A., & Newman, M. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661615 · Cited by 5 · see citing works
An Analysis of Use Intention of Pet Disease Consultation Chatbot
Huang, D.-H., & Chueh, H.-E. (2020) · International Conference on E-Society, E-Education and E-Technology (ICSET) · doi:10.1145/3421682.3421693 · Cited by 5 · see citing works
Exploring the Relationship Between Intrinsic Motivation and Receptivity to mHealth Interventions
Mishra, V., Hong, S., & Kotz, D. F. (2024) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3675094.3678498 · Cited by 4 · see citing works
Self-citationRodrigues, T. C., Reijnders, T., de Buisonjé, D. R., Santhanam, P., Kowatsch, T., Breeman, L. D., Janssen, V. R., Kraaijenhagen, R. A., Atsma, D. E., & Evers, A. W. M. (2021) · doi:10.2196/preprints.30057 · Cited by 4 · see citing works
Self-citationLim, S., Yang, Q., Meng, J., & Rains, S. A. (2025) · Behaviour and Information Technology · doi:10.1080/0144929x.2025.2567989 · Cited by 3 · see citing works
Zhang, Y., Iahad, N. A., & Yusof, A. F. (2025) · Studies in computational intelligence · doi:10.1007/978-3-031-75091-5_10 · Cited by 3 · see citing works
Detecting Receptivity for mHealth Interventions
Mishra, V., Künzler, F., Kramer, J.-N., Fleisch, E., Kowatsch, T., & Kotz, D. F. (2023) · GetMobile Mobile Computing and Communications · doi:10.1145/3614214.3614221 · Cited by 3 · see citing works
Self-citationAI applications in diagnostic technologies and services
Catania, L. J. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-824477-7.00005-5 · Cited by 3 · see citing works
Moradi, S., Alivand, M., Khajebishak, Y., ASGHARIJAFARABADI, M., Alipour, M., Faghfouri, A. H., & Alipour, B. (2021) · International Journal of Surgery Protocols · doi:10.29337/ijsp.161 · Cited by 3 · see citing works
Broadened assessments, health education and cognitive aids in the remote memory clinic
Owens, A. P., Krebs, C. R., Kuruppu, S., Brem, A., Kowatsch, T., Aarsland, D., & Klöppel, S. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.1033515 · Cited by 3 · see citing works
Self-citationEstimating Time-Varying Causal Excursion Effect in Mobile Health with Binary OutcomesPreprint
Qian, T., Yoo, H., Klasnja, P., Almirall, D., & Murphy, S. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00528 · Cited by 3 · see citing works
Bhattacharya, S., Majethia, R., Choube, A., & Mishra, V. (2024) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3675094.3678424 · Cited by 2 · see citing works
Self-citationDigital support for female students in physical education universities in Japan
Okuyama, J., Seto, S., Motokawa, T., Kato, T., Miyamoto, A., Maekawa, M., Funakoshi, S., Okazaki, T., & Ebihara, S. (2025) · Scientific Reports · doi:10.1038/s41598-025-98921-0 · Cited by 1 · see citing works
Rodrigues, T. C., de Buisonjé, D. R., Reijnders, T., Santhanam, P., Kowatsch, T., Breeman, L. D., Janssen, V. R., Kraaijenhagen, R. A., Atsma, D. E., & Evers, A. W. M. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100726 · Cited by 1 · see citing works
Self-citationKondo, M., & Oba, K. (2024) · Digital Health · doi:10.1177/20552076241249631 · Cited by 1 · see citing works
Joo, J., Lee, M., Yoon, J., Cho, H., Warrier, G., Thrul, J., & Cho, J. (2025) · JMIR mhealth and uhealth · doi:10.2196/66227 · Cited by 1 · see citing works
Cooperation Strategies for the Amazon Marketplace
Knape, D. A. (2021) · Alexandria (UniSG) (University of St.Gallen) · Cited by 1 · see citing works
Assistente virtual mobile para o auxílio no tratamento da tuberculose
Monedeiro, B. F. D. S. S. (2020) · doi:10.11606/d.17.2020.tde-25082020-092659
Mobile Applications for Behavioral Change
Ofori, M. Q., & El-Gayar, O. (2020) · Advances in medical technologies and clinical practice book series · doi:10.4018/978-1-5225-6067-8.ch011
de Buisonjé, D. R., Reijnders, T., Rodrigues, T. C., Santhanam, P., Kowatsch, T., Lipman, S. A., Bijmolt, T. H. A., Breeman, L. D., Janssen, V. R., Kraaijenhagen, R. A., et al. (2022) · doi:10.2196/preprints.38339
Self-citationOllier, J., Suryapalli, P., Fleisch, E., von Wangenheim, F., Mair, J. L., Salamanca-Sanabria, A., & Kowatsch, T. (2022) · doi:10.2196/preprints.41300
Self-citationLet Your Patrons Know the Benefits of Physical Fitness Apps and Five Free Apps to Try
Becker, D. A. (2022) · Journal of Electronic Resources in Medical Libraries · doi:10.1080/15424065.2022.2150356
Rodrigues, T. C., de Buisonjé, D. R., Reijnders, T., Santhanam, P., Kowatsch, T., Breeman, L. D., Janssen, V. R., Kraaijenhagen, R. A., Atsma, D. E., & Evers, A. W. M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4592380
Self-citationJoo, J., Lee, M., Yoon, J., Cho, H., Warrier, G., Thrul, J., & Cho, J. (2024) · doi:10.2196/preprints.66227
A Systematic Review of Artificial Intelligence in Mobile Fitness Apps: Pathways to Goal Attainment
Zhang, Y., & Iahad, N. A. (2025) · Proceeding of the Electrical Engineering Computer Science and Informatics · doi:10.1109/eecsi67060.2025.11290570
Dhinagaran, D. A., Martinengo, L., Ho, M.-H. R., Joty, S., Kowatsch, T., Atun, R. A., & Car, L. T. (2022) · doi:10.2196/preprints.38740
Self-citationHonnalli, D., Ramachandran, G. S., Degirmenci, K., & Paz, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6100372
Whitney, J., Suhy, V. A., Pauley, A. M., Shao, D., Khan, O., Moore, A. M., Chow, S., Rivera, D. E., & Downs, D. S. (2026) · Behavioral Medicine · doi:10.1080/08964289.2026.2641440
Kor, P. P. K., Tsang, A. P. L., Cheung, D. S. K., Zarit, S. H., Xie, H., Qian, M., Tan, K. C., Zheng, Y., Chu, A. M. Y., & Chou, K. (2026) · JMIR Aging · doi:10.2196/87316
Artificial Intelligence in Exercise Programming and Coaching: Opportunities and Limitations
Reiner, S. L., Pearson, R. C., Reed, R. A., Olenick, A., & Pojednic, R. M. (2026) · Current Sports Medicine Reports · doi:10.1249/jsr.0000000000001357
Ata, S. K., Zhou, W., Tandi, J., Lee, W. Q., Chan, Y. E., Guretno, F., Veeramani, A., Liu, W., Tan, J., Wijaya, F. B., et al. (2026) · Journal of Medical Internet Research · doi:10.2196/86629
Evaluating Cross-Study Generalization of Receptivity Models for Just-in-Time Adaptive Interventions
Negi, S., Keller, R., Mair, J. L., Kleim, B., Allemand, M., von Wangenheim, F., Kowatsch, T., & Mishra, V. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3831652 · Cited by 1 · see citing works
Self-citation
- Authors
- Kramer, J.-N., Künzler, F., Mishra, V., Presset, B., Kotz, D., Smith, S., Scholz, U., & Kowatsch, T.
- Affiliations
- University of St.Gallen (CH)
- ETH Zurich (CH)
- Dartmouth College (US)
- University of Lausanne (CH)
- University of Michigan (US)
- University of Zurich (CH)
- Corresponding author
- Kramer, Jan-Niklas
- ORCID
- Venue
- JMIR Research Protocols
- Publisher
- JMIR Publications Inc.
- Published
- 2019-01-31
- Volume
- 8
- Issue
- 1
- Pages
- e11540
- ISSN
- 1929-0748 (ISSN-L)
- PMC
- PMC6374735
- OpenAlex
- W2898978558
- Cited by
- 74
- References
- 69
- Citations by year
- 2026: 6 · 2025: 7 · 2024: 8 · 2023: 3 · 2022: 10 · 2021: 13 · 2020: 17 · 2019: 10
- FWCI
- 15.27
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Research Protocols (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, cc-by-nc)
- Repository for Publications and Research Data (ETH Zurich) (submittedVersion, cc-by)
- Alexandria (UniSG) (University of St.Gallen) (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, cc-by-nc)
- ETH Zürich Research Collection (cc-by)
- Zurich Open Repository and Archive (University of Zurich)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Physiology › Physical Activity and Health
- Keywords
- physical activity promotion, just-in-time adaptive interventions, smartphone-based intervention, chatbots, mobile health, financial incentives, planning, step goals, smartphone sensor data, intervention moderators, insurance company employees, health behavior change
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review