Assessing the Efficacy of an Educational Smartphone or Tablet App With Subdivided and Interactive Content to Increase Patients’ Medical Knowledge: Randomized Controlled Trial
Open accessPublished version of a preprint
Abstract
BACKGROUND: Modern health care focuses on shared decision making (SDM) because of its positive effects on patient satisfaction, therapy compliance, and outcomes. Patients' knowledge about their illness and available treatment options, gained through medical education, is one of the key drivers for SDM. Current patient education relies heavily on medical consultation and is known to be ineffective. OBJECTIVE: This study aimed to determine whether providing patients with information in a subdivided, categorized, and interactive manner via an educational app for smartphone or tablet might increase the knowledge of their illness. METHODS: A surgeon-blinded randomized controlled trial was conducted with 213 patients who were referred to 1 of the 6 Dutch hospitals by their general practitioner owing to knee complaints that were indicative of knee osteoarthritis. An interactive app that, in addition to standard care, actively sends informative and pertinent content to patients about their illness on a daily basis by means of push notifications in the week before their consultation. The primary outcome was the level of perceived and actual knowledge that patients had about their knee complaints and the relevant treatment options after the intervention. RESULTS: In total, 122 patients were enrolled in the control group and 91 in the intervention group. After the intervention, the level of actual knowledge (measured on a 0-36 scale) was 52% higher in the app group (26.4 vs 17.4, P<.001). Moreover, within the app group, the level of perceived knowledge (measured on a 0-25 scale) increased by 22% during the week within the app group (from 13.5 to 16.5, P<.001), compared with no gain in the control group. CONCLUSIONS: Actively offering patients information in a subdivided (per day), categorized (per theme), and interactive (video and quiz questions) manner significantly increases the level of perceived knowledge and demonstrates a higher level of actual knowledge, compared with standard care educational practices. TRIAL REGISTRATION: International Standard Randomized Controlled Trial Number ISRCTN98629372; http://www.isrctn.com/ISRCTN98629372 (Archived by WebCite at http://www.webcitation.org/73F5trZbb).
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The same educational app improved perceived knowledge by 22%.
“The app improved the level of actual disease-related knowledge at clinical attendance by 52% and the perceived knowledge by 22%.”
From What is the clinical value of mHealth for patients? (2020) · cites this paper as [25]
An educational app with structured interactive content improved the level of actual disease-related knowledge at clinical attendance by 52% in patients with knee pain.
“The app improved the level of actual disease-related knowledge at clinical attendance by 52% and the perceived knowledge by 22%.”
From What is the clinical value of mHealth for patients? (2020) · cites this paper as [25]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Decision aids for people facing health treatment or screening decisions
Stacey, D., Légaré, F., Lewis, K., Barry, M. J., Bennett, C. L., Eden, K. B., Holmes-Rovner, M., Llewellyn-Thomas, H., Lyddiatt, A., Thomson, R., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001431.pub5 · Cited by 6,685 · see citing works
Charles, C., Gafni, A., & Whelan, T. (1997) · Social Science & Medicine · doi:10.1016/s0277-9536(96)00221-3 · Cited by 4,137 · see citing works
Patient Satisfaction after Total Knee Arthroplasty: Who is Satisfied and Who is Not?
Bourne, R. B., Chesworth, B. M., Davis, A. M., Mahomed, N. N., & Charron, K. D. J. (2009) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-009-1119-9 · Cited by 2,578 · see citing works
Patients' memory for medical information
Kessels, R. P. C. (2003) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.96.5.219 · Cited by 1,426 · see citing works
Joseph‐Williams, N., Elwyn, G. J., & Edwards, A. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.10.031 · Cited by 1,244 · see citing works
Patients’ preference for involvement in medical decision making: A narrative review
Say, R., Murtagh, M. J., & Thomson, R. (2005) · Patient Education and Counseling · doi:10.1016/j.pec.2005.02.003 · Cited by 633 · see citing works
Self-management education programmes by lay leaders for people with chronic conditions
Foster, G., Taylor, S. J., Eldridge, S. M., Ramsay, J., & Griffiths, C. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005108.pub2 · Cited by 596 · see citing works
Perruccio, A. V., Lohmander, S. L., Cañizares, M., Tennant, A., HAWKER, G. A., Conaghan, P. G., Roos, E. M., Jordan, J. M., Maillefert, J.-F., Dougados, M., et al. (2008) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2007.12.014 · Cited by 425 · see citing works
eHealth for Patient Engagement: A Systematic Review
Barello, S., Triberti, S., Graffigna, G., Libreri, C., Serino, S., Hibbard, J., & Riva, G. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.02013 · Cited by 411 · see citing works
Roque, N. A., & Boot, W. R. (2016) · Journal of Applied Gerontology · doi:10.1177/0733464816642582 · Cited by 316 · see citing works
Bastiaens, H., Royen, P. V., Pavlič, D. R., Raposo, V., & Baker, R. (2007) · Patient Education and Counseling · doi:10.1016/j.pec.2007.03.025 · Cited by 304 · see citing works
Randomized Trials to Modify Patients' Preoperative Expectations of Hip and Knee Arthroplasties
Mancuso, C. A., Graziano, S., Briskie, L. M., Peterson, M. G. E., Pellicci, P. M., Salvati, E. A., & Sculco, T. P. (2008) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-007-0052-z · Cited by 270 · see citing works
Power imbalance between nurses and patients: a potential inhibitor of partnership in care
Henderson, S. (2003) · Journal of Clinical Nursing · doi:10.1046/j.1365-2702.2003.00757.x · Cited by 262 · see citing works
I can’t get no satisfaction after my total knee replacement
Dunbar, M., Richardson, G. C., & Robertsson, O. (2013) · The Bone & Joint Journal · doi:10.1302/0301-620x.95b11.32767 · Cited by 262 · see citing works
Ekdahl, A. W., Andersson, L., & Friedrichsen, M. (2010) · Patient Education and Counseling · doi:10.1016/j.pec.2009.10.026 · Cited by 202 · see citing works
Remembering what the doctor said: Organization and adults' memory for medical information
McGuire, L. C. (1996) · Experimental Aging Research · doi:10.1080/03610739608254020 · Cited by 172 · see citing works
Physical function and properties of quadriceps femoris muscle in men with knee osteoarthritis.
Liikavainio, T., Lyytinen, T., Tyrväinen, E., Sipilä, S., & Arokoski, J. (2008) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2008.04.012 · Cited by 160 · see citing works
Patient information systems that tailor to the individual
Bental, D. S., Cawsey, A. J., & Jones, R. B. (1999) · Patient Education and Counseling · doi:10.1016/s0738-3991(98)00133-5 · Cited by 120 · see citing works
Recall in Older Cancer Patients: Measuring Memory for Medical Information
Jansen, J., van Weert, J. C. M., van der Meulen, N., van Dulmen, S., Heeren, T. J., & Bensing, J. M. (2008) · The Gerontologist · doi:10.1093/geront/48.2.149 · Cited by 117 · see citing works
Conservative management of symptomatic knee osteoarthritis: a flawed strategy?
Crawford, D. C., Miller, L. E., & Block, J. E. (2013) · Orthopedic Reviews · doi:10.4081/or.2013.e2 · Cited by 114 · see citing works
Improving the Readability and Processability of a Pediatric Informed Consent Document
Tait, A. R., Voepel‐Lewis, T., Malviya, S. V., et al. (2005) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.159.4.347 · Cited by 104 · see citing works
The association of health literacy and socio-demographic factors with medication knowledge
Marks, J. R., Schectman, J. M., Groninger, H., & Plews-Ogan, M. L. (2009) · Patient Education and Counseling · doi:10.1016/j.pec.2009.06.017 · Cited by 86 · see citing works
Deficits in retention for verbally presented medical information
Sandberg, E. H., Sharma, R., & Sandberg, W. S. (2012) · Anesthesiology · doi:10.1097/aln.0b013e31826a4b02 · Cited by 85 · see citing works
Sepucha, K., Atlas, S. J., Chang, Y., Dorrwachter, J. M., Freiberg, A. A., Mangla, M., Rubash, H. E., Simmons, L. H., & Cha, T. (2017) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.16.01045 · Cited by 82 · see citing works
Bol, N., Smets, E. M. A., Rutgers, M. M., Burgers, J. A., de Haes, J. C. J. M., Loos, E. F., & van Weert, J. C. M. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.06.004 · Cited by 68 · see citing works
Adult age differences in explanations and memory for behavioral information.
Hess, T. M., & Tate, C. S. (1991) · Psychology and Aging · doi:10.1037//0882-7974.6.1.86 · Cited by 55 · see citing works
What factors affect patients' recall of general practitioners' advice?
Selič, P., Švab, I., Repolusk, M., & Guček, N. K. (2011) · BMC Family Practice · doi:10.1186/1471-2296-12-141 · Cited by 55 · see citing works
Selinger, C. P., Carbery, I., Warren, V., Rehman, A. F., Williams, C. J. M., Mumtaz, S., Bholah, H. M., Sood, R., Gracie, D. J., Hamlin, P. J., et al. (2016) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.13831 · Cited by 49 · see citing works
Ferguson, M., Brandreth, M., Brassington, W., & Wharrad, H. J. (2015) · American Journal of Audiology · doi:10.1044/2015_aja-14-0088 · Cited by 42 · see citing works
Computer-based patient education: a progress report.
Kahn, G. (1993) · PubMed · Cited by 40 · see citing works
Adult age differences in explanations and memory for behavioral information.
Hess, T. M., & Tate, C. S. (1991) · Psychology and Aging · doi:10.1037/0882-7974.6.1.86 · Cited by 37 · see citing works
Tait, A. R., Teig, M., & Voepel‐Lewis, T. (2014) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-014-0188-8 · Cited by 36 · see citing works
Influences on patient participation and decision-making in care.
Henderson, S. (2002) · PubMed · Cited by 31 · see citing works
COMPUTER-BASED PATIENT EDUCATION
Murphy, K. R. (1998) · Otolaryngologic Clinics of North America · doi:10.1016/s0030-6665(05)70050-5 · Cited by 27 · see citing works
Multimedia in Nursing and Patient Education
Adsit, K. I. (1996) · Orthopaedic Nursing · doi:10.1097/00006416-199607000-00012 · Cited by 16 · see citing works
Latorre, J. M., Ros, L., Bravo, B. N., Ricarte, J. J., Serrano, J. P., & Hidalgo, J. D. L.-T. (2016) · Patient Education and Counseling · doi:10.1016/j.pec.2016.08.001 · Cited by 15 · see citing works
Kawabata, H., Konishi, K., Murakami, M., et al. (2009) · PubMed · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
What is the clinical value of mHealth for patients?
Rowland, S. P., Fitzgerald, J. E., Holme, T., Powell, J., & McGregor, A. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0206-x · Cited by 454 · see citing works
Timmers, T., Janssen, L., van der Weegen, W., Das, D., Marijnissen, W.-J., Hannink, G., van der Zwaard, B. C., Plat, A., Thomassen, B., Swen, J.-W., et al. (2019) · JMIR mHealth and uHealth · doi:10.2196/15323 · Cited by 162 · see citing works
Self-citation
- Authors
- Timmers, T., Janssen, L., Pronk, Y., van der Zwaard, B. C., Koëter, S., van Oostveen, D., de Boer, S., Kremers, K., Rutten, S., Das, D., van Geenen, R. C., Koenraadt, K. L., Kusters, R., & van der Weegen, W.
- Affiliations
- Radboud University Medical Center (NL)
- VieCuri Medisch Centrum (NL)
- Kliniek ViaSana (NL)
- Canisius-Wilhelmina Ziekenhuis (NL)
- St. Anna Ziekenhuis (NL)
- Amphia Ziekenhuis (NL)
- Corresponding author
- Timmers, Thomas
- ORCID
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2018-12-21
- Volume
- 6
- Issue
- 12
- Pages
- e10742
- ISSN
- 2291-5222 (ISSN-L)
- PMC
- PMC6320423
- OpenAlex
- W2905916649
- Cited by
- 59
- References
- 37
- Citations by year
- 2025: 6 · 2024: 14 · 2023: 9 · 2022: 6 · 2021: 9 · 2020: 11 · 2019: 3 · 2017: 1
- FWCI
- 8.78
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR mhealth and uhealth (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- TU/e Research Portal (publishedVersion, other-oa)
- TU/e Research Portal (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- DSpace (Open University in the Netherlands) (submittedVersion, cc-by)
- DSpace (Open University in the Netherlands) (submittedVersion, other-oa)
- TU/e Research Portal (submittedVersion, other-oa)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Physical Sciences › Computer Science › Information Systems › Mobile Learning in Education
- Health Sciences › Health Professions › General Health Professions › Patient-Provider Communication in Healthcare
- Keywords
- patient education, mobile health apps, shared decision-making, knee osteoarthritis, patient knowledge, push notifications, interactive learning materials, perceived knowledge, actual knowledge
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review