A prospective observational real world feasibility study assessing the role of app-based remote patient monitoring in reducing primary care clinician workload during the COVID pandemic
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index; 8 of the 13 sources its claims cite were checked for support.
Abstract
Background: The novel coronavirus disease in 2019 (COVID-19) has placed unprecedented strain on healthcare providers, in particular, primary care services. General practitioners (GP) have to effectively manage patients remotely preserving social distancing. We aim to assess an app-based remote patient monitoring solution in reducing the workload of a clinician and reflect this as time-saved in an economic context. Primary care COVID patients in West London deemed medium risk were recruited into the virtual ward. Patients were monitored for 14 days by telephone or by both the Huma app and telephone. Information on number of phone calls, duration of phone calls and duration of time spent reviewing the app data was recorded. Results: The amount of time spent reviewing one patient in the telephone only arm of the study was 490 min, compared with 280 min spent reviewing one patient who was monitored via both the Huma app and telephone. Based on employed clinicians monitoring patients, this equates to a 0.04 reduction of full-time equivalent staffing I.e. for every 100 patients, it would require 4 less personnel to remotely monitor them. There was no difference in mortality or adverse events between the two groups. Conclusion: App-based remote patient monitoring potentially holds large economic benefit to COVID-19 patients. In wake of further waves or future pandemics, and even in routine care, app-based remote monitoring patients could free up vital resources in terms of clinical team’s time, allowing a better reallocation of services.
Overview
CoChat Summary
TL;DR
This prospective observational feasibility study assessed app-based remote patient monitoring for primary care COVID-19 patients in a West London virtual ward. It found that adding a monitoring app to telephone follow-up reduced clinician time per patient and implied an FTE staffing saving, with no raw difference in clinical outcomes.
Key findings
- Telephone-only monitoring took a mean total of 490 min per patient over 14 days, versus 280 min for app plus telephone monitoring, a saving of 210 min (3 h 30 min) per patient.
- The app-based pathway saved 0.04 full-time equivalent per patient; for every 100 patients, this equates to 4 fewer full-time staff (GPs and nurses) to remotely monitor them.
- There was no raw difference between groups in clinical outcomes: both showed the same percentage who recovered or needed further medical intervention, with no deceased in either group.
- Informal qualitative feedback from care teams reported positive patient comments and clinician-perceived reassurance/mental wellbeing benefits.
Methods
- Prospective observational real-world feasibility study in a London CCG COVID-19 Hub virtual ward in May 2020; 35 patients with moderate or milder COVID-19 were consented and monitored for 14 days, with 23 enrolled on app plus telephone calls and 12 monitored by telephone calls only.
- Telephone-only patients received nurse calls three times daily (42 calls) plus one GP call daily (14 calls); app-plus-telephone patients had app data reviewed three times daily by a nurse and received one planned GP call daily.
- Call duration and app review time were recorded, means and SDs calculated, and FTE calculated by comparing total mean call time in the telephone-only group with combined telephone time plus app review time, adjusted for personnel and working hours; clinical outcomes were collected as an exploratory objective in raw form.
Limitations
- Stated: this was a small pilot/feasibility study; it represents only COVID-19 patients, so broader generalisability across disease groups is needed; the opt-in design creates selection bias, likely recruiting patients more confident with digital technology and possibly younger with less complex medical backgrounds.
- Stated: larger-scale investigations into true economic and clinical benefits are needed, and future studies should break down past medical and social history in greater detail.
- Evident from the text: allocation was by patient choice rather than randomisation, the sample was very small (35 patients), and clinical outcome comparisons were raw/exploratory rather than formally powered or statistically tested.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
4 Valid · 2 Not valid · 2 Not checked · 26 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“there is limited research carried out on the economic/fiscal impact mHealth solutions have had in this unique time [27, 28].”
§ A prospective observational real world feasibility study assessing the role of app-based remote patient monitoring in reducing primary care clinician workload during the COVID pandemic > Discussion > Comparison with existing literature
What the sources say
- Partly supportedcites [27] Budd J, Miller BS, Manning EM, Lampos V, Zhuang M, et al. Digital technologies in the public-health response to COVID-19. Nat Med. 2020;26:1183–92. https://doi.org/10.1038/s41591-020-1011-4. sourceExperimental — accuracy not yet measured
The Conclusion (page unavailable) says it is too early to fully quantify the added value of digital technologies in the COVID-19 response. Future directions (page unavailable) notes a lack of evidence on contact-tracing apps, including their costs. These passages support a gap in evaluation, but do not specifically establish that research on the economic or fiscal impact of mHealth solutions generally is limited. (LLM, conf=0.79)
- Partly supportedcites [28] Vindrola-Padros C, Singh K, Sidhu M, Georghiou T, Sherlaw-Johnson C. Remote home monitoring (virtual wards) for confirmed or suspected COVID-19 patients: a rapid systemic review. Eclinm The Lancet. 2021;37:100965. sourceExperimental — accuracy not yet measured
The Discussion says economic evidence for COVID-19 remote home monitoring was limited, and the Results say very few selected studies provided an economic analysis. This supports the claim for remote monitoring, but the paper does not establish that research was limited across mHealth solutions generally. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Economic evidence of digital solutions in primary care is rare, indicating the significance of this paper to drive more research into the true economic benefit digital solutions can hold in general practice.”
§ A prospective observational real world feasibility study assessing the role of app-based remote patient monitoring in reducing primary care clinician workload during the COVID pandemic > Discussion > Comparison with existing literature
What the sources say
- Could not verifycites [26] Rowland SP, Fitzgerald JE, Holme T, Powell J, McGregor A. What is the clinical value of mHealth for patients? npj Digit Med. 2020;3:4. https://doi.org/10.1038/s41746-019-0206-x. sourceExperimental — accuracy not yet measured
The ‘Challenges in taking an evidence-based approach to clinical use of mHealth apps’ section says high-quality clinical evidence is limited, while ‘What value will clinical use of mHealth hold for patients in the future?’ describes cost-effectiveness as a potential benefit. Neither establishes that economic evidence for digital solutions in primary care is rare. Searches for economic evidence, cost-effectiveness, and primary care found no passage making that point; page numbers were unavailable in our copy. (LLM, conf=0.76)
- Partly supportedcites [29] Tarricone R, Petracca F, Ciani O, Cucciniello M. Distinguishing features in the assessment of mHealth apps. Expert Rev Pharmacoecon Outcomes Res. 2021;21(4):521–6. sourceExperimental — accuracy not yet measured
The Article highlights (p. 4) say mHealth apps often lack adequate economic evidence. The paper does not establish that economic evidence is rare specifically for digital solutions in primary care; its discussion concerns mHealth apps more broadly. (LLM, conf=0.86)
- Partly supportedcites [30] Iribarren SJ, Cato K, Falzon L, Stone PW. What is the economic evidence for mHealth? A systematic review of economic evaluations of mHealth solutions. PLoS One. 2017;12(2):e0170581. sourceExperimental — accuracy not yet measured
The Introduction says evidence for mHealth cost-effectiveness has been limited, and the Abstract Results report 39 economic evaluations. But the review concerns mobile-health interventions, not digital solutions generally, and does not establish that economic evidence is rare specifically in primary care or general practice. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“a GP practice employing an app-based virtual ward would theoretically be able to hire 4 less full-time staff (GPs and Nurses) to manage each 100 patients for whom they provide care, when compared to a practice utilising a telephone-based virtual ward.”
§ A prospective observational real world feasibility study assessing the role of app-based remote patient monitoring in reducing primary care clinician workload during the COVID pandemic > Results
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This represents a saving of 210 min (3 h and 30 min) per patient over 14 days, when compared to staffing of the telephone-based virtual ward described above (Fig. 4).”
§ A prospective observational real world feasibility study assessing the role of app-based remote patient monitoring in reducing primary care clinician workload during the COVID pandemic > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As a result, a mean total of 490 min (8 h and 10 min) over 14 days was spent monitoring each patient in this cohort.”
§ A prospective observational real world feasibility study assessing the role of app-based remote patient monitoring in reducing primary care clinician workload during the COVID pandemic > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
11 more claims
Create a free account to see all 34 claims and every source verdict.
- Probably not a substantial claim. 13
- It may state two separate claims as one. 13
- The quote only partly states this claim. 2
Citations
Cites
Digital technologies in the public-health response to COVID-19
Budd, J., Miller, B. S., Manning, E. M., Lampos, V., Zhuang, M., Edelstein, M., Rees, G., Emery, V. C., Stevens, M. M., Keegan, N., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1011-4 · Cited by 1,195 · cited 1×
“Whilst there is plenty of evidence supporting the role of mHealth technology in the management of the COVID pandemic [25], and generally in health [26] there is limited research carried out on the economic/fiscal impact mHealth solutions have had in this unique time [27, 28].”
BackgroundVideo consultations for covid-19
Greenhalgh, T., Wherton, J., Shaw, S., & Morrison, C. (2020) · BMJ · doi:10.1136/bmj.m998 · Cited by 866 · cited 1×
“These studies observed a reduction in costs with no substantial change in service use [18].”
BackgroundCovid-19: a remote assessment in primary care
Greenhalgh, T., Koh, G. C. H., & Car, J. (2020) · BMJ · doi:10.1136/bmj.m1182 · Cited by 705 · cited 1×
“The NHS swiftly implemented guidelines suggesting that the majority of COVID-19 patients should be monitored remotely with advice on symptom management and self-isolation, given that information on safety netting was provided [19].”
BackgroundIribarren, S. J., Cato, K., Falzon, L., & Stone, P. W. (2017) · PLOS ONE · doi:10.1371/journal.pone.0170581 · Cited by 519 · cited 1×
“Multiple products and research discuss the cost effective-ness of a solution but rarely provide tangible evidence to support these statements [30].”
BackgroundWhat is the clinical value of mHealth for patients?
Rowland, S. P., Fitzgerald, J. E., Holme, T., Powell, J., & McGregor, A. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0206-x · Cited by 454
Covid-19: how doctors and healthcare systems are tackling coronavirus worldwide
Tanne, J. H., Hayasaki, E., Zastrow, M., Pulla, P., Smith, P., & Rada, A. G. (2020) · BMJ · doi:10.1136/bmj.m1090 · Cited by 437
Fagherazzi, G., Goetzinger, C., Rashid, M. A., Aguayo, G. A., & Huiart, L. (2020) · Journal of Medical Internet Research · doi:10.2196/19284 · Cited by 426
Verhoeven, V., Tsakitzidis, G., Philips, H., & Van Royen, P. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-039674 · Cited by 332
Glynn, L. G., Hayes, P. S., Casey, M., Glynn, F., Alvarez-Iglesias, A., Newell, J., ÓLaighin, G., Heaney, D., O’Donnell, M., & Murphy, A. W. (2014) · British Journal of General Practice · doi:10.3399/bjgp14x680461 · Cited by 280
Noah, B., Keller, M. S., Mosadeghi, S., Stein, L., Johl, S., Delshad, S., Tashjian, V. C., Lew, D., Kwan, J. T., Jusufagic, A., et al. (2018) · npj Digital Medicine · doi:10.1038/s41746-017-0002-4 · Cited by 273
Research works printed but not linked: 3
- Bower E, Bowstock N. How a pandemic changed the face of general practice. 2020. GPonline. Gponline.com. . Available from: https://www.gponline.com/pandemic-changed-face-general-practice/article/1703338
- PMC E. Europe PMC. 2020 Europepmc.org. [cited 10 September 2020]. Available from: http://europepmc.org/article/MED/12459044
- Intelligence P. Telemedicine market to witness robust growth ahead: P&S Intelligence. 2020. Prnewswire.co.uk. [cited 10 September 2020]. Available from: https://www.prnewswire.co.uk/news-releases/telemedicine-market-to-witness-robust-growth-ahead-p-amp-s-intelligence-859284803.html.
Cited by
Erku, D., Khatri, R., Endalamaw, A., Wolka, E., Nigatu, F., Zewdie, A., & Assefa, Y. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20196854 · Cited by 177
Mosadeghrad, A. M., Afshari, M., Isfahani, P., Ezzati, F., Abbasi, M., Farahani, S. A., Zahmatkesh, M., & Eslambolchi, L. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-11278-4 · Cited by 34
A Review of Recent Innovations in Remote Health Monitoring
Dalloul, A. H., Miramirkhani, F., & Kouhalvandi, L. (2023) · Micromachines · doi:10.3390/mi14122157 · Cited by 22
Nowell, W. B., & Curtis, J. R. (2023) · Medical Research Archives · doi:10.18103/mra.v11i7.2.3957 · Cited by 17
Denker, K., Dean, M., Chapman, D., et al. (2022) · Journal of Pediatric Nursing · doi:10.1016/j.pedn.2022.12.028 · Cited by 11
Metadata
- Authors
- Shah, S. S., Safa, A., Johal, K., Obika, D., & Valentine, S.
- Corresponding author
- Shah, Sachin Shailendra
- Venue
- BMC Family Practice
- Published
- 2021-12
- Volume
- 22
- Issue
- 1
- Pages
- 248-248
- ISSN
- 1471-2296 (ISSN-L)
- PMC
- PMC8674098
- OpenAlex
- W4200399020
- Cited by
- 21
- References
- 20
- Citations by year
- 2026: 4 · 2025: 2 · 2024: 4 · 2023: 9 · 2022: 2
- FWCI
- 3.10
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor, 15 d)
- Locations
- BMC Family Practice (publishedVersion, cc-by)
- Research Square (submittedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Family Practice › Primary Care and Health Outcomes
- Keywords
- remote patient monitoring, mobile health apps, clinician workload, primary care, COVID-19 pandemic, virtual wards, telephone monitoring, staffing reduction, economic benefits
- MeSH terms
- COVID-19, SARS-CoV-2, Feasibility Studies, Humans, Monitoring, Physiologic, Primary Health Care, Workload, Pandemics, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A prospective observational real world feasibility study assessing the role of app-based remote patient monitoring in reducing primary care clinician workload during the COVID pandemic. https://app.cochat.ai/papers/10.1186/s12875-021-01594-7
- The paper
- Shah, S. S., Safa, A., Johal, K., Obika, D., & Valentine, S. (2021). A prospective observational real world feasibility study assessing the role of app-based remote patient monitoring in reducing primary care clinician workload during the COVID pandemic. BMC Family Practice. https://doi.org/10.1186/s12875-021-01594-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.