A Framework for Recruiting into a Remote Measurement Technologies (RMTs) study: Experiences from a major depressive disorder cohort
Open accessAbstract
The use of remote measurement technologies (RMTs) across mobile health (mHealth) studies is becoming increasingly popular, given their potential for high-frequency symptom monitoring outside of routine clinical appointments. However, many RMT studies fail to report on engagement and recruitment statistics, with the few who do citing a wide range of recruitment rates. There is a need for the standardisation of best practices for successful recruitment into RMT research, critical for both research validity and reproducibility. The current paper aims to create a framework for successful recruitment into RMT studies, reflecting on the experience of RADAR-MDD, a large-scale, multi-site prospective cohort study utilising RMT to explore the clinical course of people with major depressive disorder across the UK, Netherlands, and Spain. More specifically, the paper assesses four key strategies for successful recruitment, alongside a review of the common barriers to participation and how to avoid them. Finally, the strategies and barriers outlined are combined into a single model of recruitment, that can be used as a framework to inform future study design and evaluation. Such a model will be applicable to a variety of stakeholders using RMT in healthcare research and practice.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Recruitment into RADAR-MDD was highly successful, exceeding recruitment targets despite the COVID-19 pandemic, due to the flexibility of face-to-face and remote enrolments.
“Recruitment into RADAR-MDD was highly successful, with the flexibility of face-to-face and remote enrolments resulting in the study exceeding its recruitment targets despite the COVID-19 pandemic [42].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040297 · Cited by 8,613 · see citing works
Holmes, E. A., O'Connor, R. C., Perry, V. H., Tracey, I., Wessely, S., Arseneault, L., Ballard, C., Christensen, H., Cohen Silver, R., Everall, I., et al. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30168-1 · Cited by 5,715 · see citing works
Self-citationHow mental health care should change as a consequence of the COVID-19 pandemic
Moreno, C., Wykes, T., Galderisi, S., Nordentoft, M., Crossley, N., Jones, N., Cannon, M., Correll, C. U., Byrne, L., Carr, S., et al. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30307-2 · Cited by 1,840 · see citing works
Self-citationReal-time tracking of self-reported symptoms to predict potential COVID-19
Menni, C., Valdes, A. M., Freidin, M. B., Sudre, C. H., Nguyen, L. H., Drew, D. A., Ganesh, S., Varsavsky, T., Cardoso, M. J., El-Sayed Moustafa, J. S., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0916-2 · Cited by 1,517 · see citing works
Yardley, L., Morrison, L., Bradbury, K., & Muller, I. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4055 · Cited by 1,442 · see citing works
What is user engagement? A conceptual framework for defining user engagement with technology
O'Brien, H. L., & Toms, E. G. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20801 · Cited by 1,397 · see citing works
Mohr, D. C., Cuijpers, P., & Lehman, K. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1602 · Cited by 1,097 · see citing works
Self-citationRetention strategies in longitudinal cohort studies: a systematic review and meta-analysis
Theme, T. S. L. S., Teague, S. J., Youssef, G. J., Macdonald, J. A., Sciberras, E., Shatte, A. B. R., Fuller‐Tyszkiewicz, M., Greenwood, C. J., McIntosh, J. E., Olsson, C. A., et al. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0586-7 · Cited by 483 · see citing works
Pratap, A., Neto, E. C., Snyder, P., Stepnowsky, C., Elhadad, N., Grant, D., Mohebbi, M. H., Mooney, S., Suver, C., Wilbanks, J., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0224-8 · Cited by 410 · see citing works
Rapid implementation of mobile technology for real-time epidemiology of COVID-19
Drew, D. A., Nguyen, L. H., Steves, C. J., Menni, C., Freydin, M., Varsavsky, T., Sudre, C. H., Cardoso, M. J., Ourselin, S., Wolf, J., et al. (2020) · Science · doi:10.1126/science.abc0473 · Cited by 389 · see citing works
Anticipatory pleasure predicts motivation for reward in major depression.
Sherdell, L., Waugh, C. E., & Gotlib, I. H. (2011) · Journal of Abnormal Psychology · doi:10.1037/a0024945 · Cited by 369 · see citing works
Emerging mHealth and eHealth interventions for serious mental illness: a review of the literature
Naslund, J. A., Marsch, L. A., McHugo, G. J., & Bartels, S. J. (2015) · Journal of Mental Health · doi:10.3109/09638237.2015.1019054 · Cited by 327 · see citing works
A systematic review on the relationship between user involvement and system success
Bano, M., & Zowghi, D. (2014) · Information and Software Technology · doi:10.1016/j.infsof.2014.06.011 · Cited by 297 · see citing works
Participant retention practices in longitudinal clinical research studies with high retention rates
Abshire, M., Dinglas, V. D., Cajita, M. I. A., Eakin, M. N., Needham, D. M., & Himmelfarb, C. D. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0310-z · Cited by 274 · see citing works
COVID-19 and the digital divide in the UK
Watts, G. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30169-2 · Cited by 274 · see citing works
Simblett, S., Greer, B., Matcham, F., Curtis, H., Polhemus, A., Ferrão, J., Gamble, P., & Wykes, T. (2018) · Journal of Medical Internet Research · doi:10.2196/10480 · Cited by 270 · see citing works
Self-citationDo We Still Have a Digital Divide in Mental Health? A Five-Year Survey Follow-up
Robotham, D., Satkunanathan, S., Doughty, L., & Wykes, T. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6511 · Cited by 184 · see citing works
Self-citationThe Future of Wearable Technologies and Remote Monitoring in Health Care
Liao, Y., Thompson, C. A., Peterson, S. K., Mandrola, J. M., & Beg, M. S. (2019) · American Society of Clinical Oncology Educational Book · doi:10.1200/edbk_238919 · Cited by 180 · see citing works
Maximizing Engagement in Mobile Health Studies
Druce, K. L., Dixon, W. G., & McBeth, J. (2019) · Rheumatic Disease Clinics of North America · doi:10.1016/j.rdc.2019.01.004 · Cited by 158 · see citing works
Comprehensive meta-analysis of the construct validity of the employment interview
Salgado, J. F., & Moscoso, S. (2002) · European Journal of Work and Organizational Psychology · doi:10.1080/13594320244000184 · Cited by 148 · see citing works
Matcham, F., Pietro, C. B. D. S., Bulgari, V., de Girolamo, G., Dobson, R., Eriksson, H., Folarin, A., Haro, J. M., Kerz, M., Lamers, F., et al. (2019) · BMC Psychiatry · doi:10.1186/s12888-019-2049-z · Cited by 141 · see citing works
Self-citationSimblett, S., Matcham, F., Siddi, S., Bulgari, V., Barattieri di San Pietro, C., Hortas López, J., Ferrão, J., Polhemus, A., Haro, J. M., de Girolamo, G., et al. (2019) · JMIR mHealth and uHealth · doi:10.2196/11325 · Cited by 120 · see citing works
Self-citationWatson, N. L., Mull, K. E., Heffner, J. L., McClure, J. B., & Bricker, J. B. (2018) · Journal of Medical Internet Research · doi:10.2196/10351 · Cited by 118 · see citing works
Parkinson, B., Meacock, R., Sutton, M., Fichera, E., Mills, N., Shorter, G. W., Treweek, S. P., Harman, N., Brown, R. C. H., Gillies, K., et al. (2019) · Trials · doi:10.1186/s13063-019-3710-z · Cited by 107 · see citing works
Recruitment and retention strategies in mental health trials – A systematic review
Liu, Y., Pencheon, E., Hunter, R. M., Moncrieff, J., & Freemantle, N. (2018) · PLoS ONE · doi:10.1371/journal.pone.0203127 · Cited by 98 · see citing works
Immediate Mood Scaler: Tracking Symptoms of Depression and Anxiety Using a Novel Mobile Mood Scale
Nahum, M., Vleet, T. V., Sohal, V. S., Mirzabekov, J. J., Rao, V. R., Wallace, D. L., Lee, M. B., Dawes, H. E., Stark‐Inbar, A., Jordan, J. T., et al. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.6544 · Cited by 91 · see citing works
Remote health diagnosis and monitoring in the time of COVID-19
Behar, J. A., Liu, C., Kotzen, K., Tsutsui, K., Corino, V. D. A., Singh, J., Pimentel, M. A. F., Warrick, P., Zaunseder, S., Andreotti, F., et al. (2020) · Physiological Measurement · doi:10.1088/1361-6579/abba0a · Cited by 86 · see citing works
Acceptability of mHealth augmentation of Collaborative Care: A mixed methods pilot study
Bauer, A. M., Iles-Shih, M., Ghomi, R. H., Rue, T. C., Grover, T., Kincler, N., Miller, M., & Katon, W. J. (2017) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2017.11.010 · Cited by 84 · see citing works
Implementing Remote Memory Clinics to Enhance Clinical Care During and After COVID-19
Owens, A. P., Ballard, C. G., Beigi, M., Kalafatis, C., Brooker, H. J., Lavelle, G., Brønnick, K., Sauer, J., Boddington, S., Velayudhan, L., et al. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.579934 · Cited by 58 · see citing works
Self-citationCould providing financial incentives to research participants be ultimately self-defeating?
Zutlevics, T. L. (2016) · Research Ethics · doi:10.1177/1747016115626756 · Cited by 51 · see citing works
Pfammatter, A. F., Mitsos, A., Wang, S. D., Hood, S. H., & Spring, B. J. (2017) · mHealth · doi:10.21037/mhealth.2017.09.02 · Cited by 46 · see citing works
EXPLOITATION IN PAYMENTS TO RESEARCH SUBJECTS
Phillips, T. B. (2009) · Bioethics · doi:10.1111/j.1467-8519.2009.01717.x · Cited by 40 · see citing works
Jones, M. C., & Johnston, D. W. (2011) · Journal of Health Services Research & Policy · doi:10.1258/jhsrp.2010.010016 · Cited by 38 · see citing works
Polhemus, A. M., Novák, J. M., Majid, S., Simblett, S. K., Morris, D., Bruce, S., Burke, P., Dockendorf, M. F., Temesi, G., & Wykes, T. (2021) · JMIR Mental Health · doi:10.2196/25249 · Cited by 36 · see citing works
Self-citationLattie, E. G., Kaiser, S. M., Alam, N., Tomasino, K. N., Sargent, E., Rubanovich, C. K., Palac, H., & Mohr, D. C. (2018) · Journal of Medical Internet Research · doi:10.2196/11050 · Cited by 31 · see citing works
Self-citationBrown, J. S. L., Murphy, C., Kelly, J., & Goldsmith, K. (2019) · Trials · doi:10.1186/s13063-018-3033-5 · Cited by 30 · see citing works
Using Patient Advisory Boards to Solicit Input Into Clinical Trial Design and Execution
Anderson, A., Benger, J., & Getz, K. (2019) · Clinical Therapeutics · doi:10.1016/j.clinthera.2019.06.006 · Cited by 19 · see citing works
Anawar, S., Adnan, W. A. W., & Ahmad, R. (2017) · Cited by 4 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Matcham, F., Leightley, D., Siddi, S., Lamers, F., White, K. M., Annas, P., de Girolamo, G., Difrancesco, S., Haro, J. M., Horsfall, M., et al. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-03753-1 · Cited by 110 · see citing works
“Recruitment into RADAR-MDD was highly successful, with the flexibility of face-to-face and remote enrol-ments resulting in the study exceeding its recruitment targets despite the COVID-19 pandemic [42].”
Self-citation
- Authors
- Oetzmann, C., White, K. M., Ivan, A., Julie, J., Leightley, D., Lavelle, G., Lamers, F., Siddi, S., Annas, P., Garcia, S. A., Haro, J. M., Mohr, D. C., Penninx, B. W., Simblett, S., Wykes, T., Narayan, V. A., Hotopf, M., & Matcham, F.
- Affiliations
- King's College London (GB)
- Amsterdam Public Health (NL)
- Parc Sanitari Sant Joan de Déu (ES)
- Northwestern University (US)
- ORCID
- Publisher
- Center for Open Science
- Published
- 2021-06-09
- OpenAlex
- W4255524762
- Cited by
- 5
- References
- 38
- Citations by year
- 2022: 3 · 2021: 2
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- OSF Preprints (OSF Preprints) (submittedVersion, cc-by)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Funders
- European Federation of Pharmaceutical Industries and Associations
- National Institute for Health and Care Research
- European Commission
- Innovative Medicines Initiative (115902)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics in Clinical Research
- Keywords
- participant recruitment, participant recruitment strategies, barriers to participation, mobile health, major depressive disorder, research engagement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
