Agile research to complement agile development: a proposal for an mHealth research lifecycle
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Mobile health (mHealth) technology is increasingly being used, but academic evaluations supporting its use are not keeping pace. This is partly due to the disconnect between the traditional pharmaceutical approach to product evaluation, with its incremental approach, and the flexible way in which mHealth products are developed. An important step to addressing these problems lies in establishing agile research methods that complement the agile development methodologies used to create modern digital health applications. We describe an mHealth research model that mirrors traditional clinical research methods in its attention to safety and efficacy, while also accommodating the rapid and iterative development and evaluation required to produce effective, evidence-based, and sustainable digital products. This approach consists of a project identification stage followed by four phases of clinical evaluation: Phase 1: User Experience Design, Development, & Alpha Testing; Phase 2: Beta testing; Phase 3: Clinical Trial Evaluation; and Phase 4: Post-Market Surveillance. These phases include sample gating questions and are adapted to accommodate the unique nature of digital product development.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The ‘mHealth agile development and evaluation lifecycle’ (figure 1) is a framework created to promote the development of evidence-based, effective and sustainable digital solutions.27”
From Development, evaluation and implementation of a digital behavioural health treatment for chronic pain: study protocol of the multiphase DAHLIA project (2022) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Parasuraman, A. (2000) · Journal of Service Research · doi:10.1177/109467050024001 · Cited by 3,328
Clinical Trials: A Practical Approach.
Hill, I. D., & Pocock, S. J. (1984) · Biometrics · doi:10.2307/2531186 · Cited by 2,930 · cited 1×
“1).(17) This approach sequentially tests a product to determine in sequence its safety, efficacy, and effectiveness.”
BackgroundEysenbach, G., & CONSORT-EHEALTH Group (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1923 · Cited by 1,863
Cockburn, A. (2001) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 1,858
An Updated and Streamlined Technology Readiness Index: TRI 2.0
Parasuraman, A., & Colby, C. L. (2015) · Journal of Service Research · doi:10.1177/1094670514539730 · Cited by 1,440
A decade of agile methodologies: Towards explaining agile software development
Dingsøyr, T., Nerur, S., Balijepally, V., & Moe, N. B. (2012) · Journal of Systems and Software · doi:10.1016/j.jss.2012.02.033 · Cited by 1,113
Adaptive designs in clinical trials: why use them, and how to run and report them
Pallmann, P., Bedding, A. W., Choodari-Oskooei, B., Dimairo, M., Flight, L., Hampson, L. V., Holmes, J., Mander, A. P., Odondi, L., Sydes, M. R., et al. (2018) · BMC Medicine · doi:10.1186/s12916-018-1017-7 · Cited by 829
Scaling Up mHealth: Where Is the Evidence?
Tomlinson, M., Rotheram-Borus, M. J., Swartz, L., & Tsai, A. C. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001382 · Cited by 673
Who uses mobile phone health apps and does use matter? A secondary data analytics approach
Carroll, J. K., Moorhead, A., Bond, R., LeBlanc, W. G., Petrella, R. J., & Fiscella, K. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.5604 · Cited by 540
Adaptive Designs for Clinical Trials
Bhatt, D. L., & Mehta, C. (2016) · New England Journal of Medicine · doi:10.1056/nejmra1510061 · Cited by 499
Research works printed but not linked: 1
- Market Research Reports. Digital Health Market Revenue of US$536. 6 bn by the end of 2025: Technology Advancement and Innovation - Press Release – Digital Journal. Market Research Reports (2017). http://www.digitaljournal.com/pr/3518555. (Accessed 20 Dec 2017).
Cited by
Nelson, B. W., & Allen, N. B. (2019) · JMIR mHealth and uHealth · doi:10.2196/10828 · Cited by 310
“speed of wearable technological advancements often outpaces the typical research cycle [22], making it very difficult for studies to validate each new iteration of wearables.”
BackgroundTran, S., Smith, L., El-Den, S., & Carter, S. (2022) · JMIR mHealth and uHealth · doi:10.2196/30671 · Cited by 121
“This approach of releasing and testing an intervention at multiple stages of the app development stage represents one of the more efficient and effective methods allowing for superior resource management, stakeholder or patient engagement, and product quality compared with the conventional waterfall method and is comm…”
MethodUsability evaluation of mHealth apps for elderly individuals: a scoping review
Wang, Q., Liu, J., Zhou, L., Tian, J., Chen, X., Zhang, W., Wang, H., Zhou, W., & Gao, Y. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-02064-5 · Cited by 141
“After the first two stages, researchers used complete mHealth apps to conduct pilot or feasibility studies among the target population, and the usability evaluation was part of them [101].”
MethodBonten, T. N., Rauwerdink, A., Wyatt, J. C., Kasteleyn, M. J., Witkamp, L., Riper, H. M., van Gemert‐Pijnen, J. E. W. C., Cresswell, K. M., Sheikh, A., Schijven, M. P., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/17774 · Cited by 101
“mHealthi agile and user-centered research and development lifecycle Canada 2018 Wilson et al [57]”
MethodA Social Networking and Gamified App to Increase Physical Activity: Cluster RCT
Edney, S. M., Olds, T. S., Ryan, J. C., Vandelanotte, C., Plotnikoff, R. C., Curtis, R. G., & Maher, C. A. (2020) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2019.09.009 · Cited by 68
Metadata
- Authors
- Wilson, K., Bell, C., Wilson, L., & Witteman, H.
- Affiliations
- University of Ottawa (CA)
- Ottawa Hospital Research Institute (CA)
- Université Laval (CA)
- Corresponding author
- Wilson, Kumanan
- Venue
- npj Digital Medicine
- Published
- 2018-09-13
- Volume
- 1
- Issue
- 1
- Pages
- 46-46
- ISSN
- 2398-6352 (ISSN-L)
- PMC
- PMC6550198
- OpenAlex
- W2889893184
- Cited by
- 118
- References
- 24
- Citations by year
- 2026: 19 · 2025: 18 · 2024: 23 · 2023: 11 · 2022: 17 · 2021: 13 · 2020: 12 · 2019: 3 · 2018: 2
- FWCI
- 1.37
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- npj Digital Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Sanofi
- Public Health Agency of Canada
- Public Health Agency
- Health Canada
- Canadian Institutes of Health Research
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Keywords
- mobile health, agile research, agile software development, research lifecycle, clinical trial evaluation, beta testing, alpha testing, post-marketing surveillance, user experience design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Agile research to complement agile development: a proposal for an mHealth research lifecycle. https://app.cochat.ai/papers/10.1038/s41746-018-0053-1
- The paper
- Wilson, K., Bell, C., Wilson, L., & Witteman, H. (2018). Agile research to complement agile development: a proposal for an mHealth research lifecycle. npj Digital Medicine. https://doi.org/10.1038/s41746-018-0053-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.