The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview
Open accessThe DOI matches its Crossref record; 165 of the 168 references it cites were found in a registry or an index; 4 of the 32 sources its claims cite were checked for support.
Abstract
BACKGROUND: There is considerable international interest in exploiting the potential of digital solutions to enhance the quality and safety of health care. Implementations of transformative eHealth technologies are underway globally, often at very considerable cost. In order to assess the impact of eHealth solutions on the quality and safety of health care, and to inform policy decisions on eHealth deployments, we undertook a systematic review of systematic reviews assessing the effectiveness and consequences of various eHealth technologies on the quality and safety of care. METHODS AND FINDINGS: We developed novel search strategies, conceptual maps of health care quality, safety, and eHealth interventions, and then systematically identified, scrutinised, and synthesised the systematic review literature. Major biomedical databases were searched to identify systematic reviews published between 1997 and 2010. Related theoretical, methodological, and technical material was also reviewed. We identified 53 systematic reviews that focused on assessing the impact of eHealth interventions on the quality and/or safety of health care and 55 supplementary systematic reviews providing relevant supportive information. This systematic review literature was found to be generally of substandard quality with regards to methodology, reporting, and utility. We thematically categorised eHealth technologies into three main areas: (1) storing, managing, and transmission of data; (2) clinical decision support; and (3) facilitating care from a distance. We found that despite support from policymakers, there was relatively little empirical evidence to substantiate many of the claims made in relation to these technologies. Whether the success of those relatively few solutions identified to improve quality and safety would continue if these were deployed beyond the contexts in which they were originally developed, has yet to be established. Importantly, best practice guidelines in effective development and deployment strategies are lacking. CONCLUSIONS: There is a large gap between the postulated and empirically demonstrated benefits of eHealth technologies. In addition, there is a lack of robust research on the risks of implementing these technologies and their cost-effectiveness has yet to be demonstrated, despite being frequently promoted by policymakers and "techno-enthusiasts" as if this was a given. In the light of the paucity of evidence in relation to improvements in patient outcomes, as well as the lack of evidence on their cost-effectiveness, it is vital that future eHealth technologies are evaluated against a comprehensive set of measures, ideally throughout all stages of the technology's life cycle. Such evaluation should be characterised by careful attention to socio-technical factors to maximise the likelihood of successful implementation and adoption.
Overview
CoChat Summary
TL;DR
This systematic overview of 108 reviews found that the empirical evidence for most common eHealth technologies’ benefits on quality and safety is weak, inconsistent, or absent. The paper argues that large-scale eHealth investments should not be justified by assumed gains alone, because patient-level and cost-effectiveness benefits were rarely demonstrated.
Key findings
- The searches retrieved 46,349 references, and the authors included 108 reviews: 53 as the main empirical evidence base and 55 supplementary reviews for context.
- For EHRs, the paper found only weak evidence for benefits in time efficiency and data quality (legibility, completeness, comprehensiveness), while risks such as time costs, increased costs, and reduced patient-centeredness were mostly anecdotal.
- For PACS, there were only 3 reviews; evidence for improved organizational efficiency was weak, and overall cost-effectiveness could not be determined because economic findings were often contradictory and of poor quality.
- For CPOE and ePrescribing, the review reports moderate evidence for some organizational/practitioner benefits, but weak or inconsistent evidence for patient-level outcomes; for ePrescribing, there was no clear evidence of patient outcome benefit outside prescribing, and medication-error reductions were not clearly linked to patient harm reduction.
Methods
- Systematic overview of systematic reviews focused on clinician-oriented eHealth technologies related to storage/retrieval of data and support for clinical decision making; patient-focused interventions were excluded.
- Searched PubMed/MEDLINE, EMBASE, and the Cochrane Library for secondary research reports published from 1997 to 2007, with no language restrictions; searches were updated through end of April 2010.
- Performed dual-reviewer screening and critical appraisal (with arbitration by a third reviewer), then used narrative synthesis because the literature was too diverse for quantitative pooling; evidence was classified using a modified WHO Health Evidence Network approach as strong, moderate, or weak.
Limitations
- The paper states that poor indexing, reliance on English-language databases, and a novel multimethod approach meant some reviews may have been missed and the synthesis was “less rigorous” than a conventional systematic review because individual primary studies were not appraised.
- The authors note that they had to adapt the critical appraisal instrument, and that overlap in reviews plus inconsistent terminology required judgment calls about which reviews and primary studies mapped to which interventions.
- Evident from the text: the overview covers mostly economically developed country settings and clinician-orientated information systems, so the findings may not generalize well to patient-oriented technologies or other contexts.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 0 Not valid · 24 Not checked · 67 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“NHS Connecting for Health's difficulties with the implementation of EHRs into hospitals in England is a prime example of the challenges that can ensue if such socio-technical factors are given insufficient attention [148].”
§ The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview > Discussion
What the sources say
- Supportedcites [148] AR Robertson, 2010, Prospective evaluation of the implementation and adoption of NHS Connecting for Health's electronic health record in secondary care in England: interim results from a national evaluation., BMJ source
The Methods (Data analysis; page not specified) explicitly frame implementation as a socio-technical process in which organisational, human, and technical factors shape one another. The Results (Trusts want systems that are tailored; page not specified) describe implementation difficulties caused by a centrally conceived standardised system that did not meet end users’ needs. This supports the citing sentence’s use of the programme as an example of challenges arising when those factors receive insufficient attention. (LLM, conf=0.90)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Additionally, it is not unusual for insufficient time and effort to be devoted to the all-important customisation process [147].”
§ The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview > Discussion
What the sources say
- Partly supportedcites [147] N Pollock, 2003, Fitting standard software packages to non-standard organizations: the “biography' of an enterprise-wide system., Tech Anal Strat Manag sourceExperimental — accuracy not yet measured
In “Building a Global Product” (pp. 16–17), the paper reports that the supplier had more requests for changes than resources and was pruning what it would deliver for a pilot site. This supports a resource constraint on adaptation in that case, but the paper does not establish that insufficient time and effort are often devoted to customisation across commercial systems. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Also of note is that we found virtually no evidence in support of the cost-effectiveness claims (Tables 2– 11) that are frequently being made by policy makers when constructing business cases to raise funding for the large-scale eHealth deployments that are now taking place in many parts of the world [1].”
§ The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview > Discussion
What the sources say
- Partly supportedcites [1] L Catwell, 2009, Evaluating eHealth interventions., PLoS Med sourceExperimental — accuracy not yet measured
The ‘Recognising the Risk of Harm’ section says governments around the world are undertaking large eHealth rollouts, and the Conclusions call for scientific evidence to inform policy decisions. The paper does not specifically document frequent cost-effectiveness claims in policymakers’ funding business cases. The citing authors’ statement that ‘we found virtually no evidence’ refers to their own findings, not a finding attributed to this source. (LLM, conf=0.79)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found only anecdotal evidence of the fundamental expected benefits and risks relating to the organisational efficiency resulting from the storage and management facilities within the EHR and thus the potential for secondary uses (Table 2).”
§ The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview > Results > Data Storage, Management, and Retrieval Systems
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Our final selection of 53 reviews provided the main empirical evidence base in relation to assessing the impact of the selected eHealth technologies (see Table 1 for our critical appraisal of these studies) [15]–[67], full details of which can be found in Table S2.”
§ The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview > Results
What the sources say
- Not checked yetcites [15]–[67]
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
41 more claims
Create a free account to see all 95 claims and to verify the 28 references still open.
- Probably not a substantial claim. 27
- It may state two separate claims as one. 28
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While such technologies can be effective [1,2], one of the main problems is that users’ adoption and long-term use remains lower than expected [3-5].”
From Opening the Black Box of Electronic Health: Collecting, Analyzing, and Interpreting Log Data (2017) · cites this paper as [5]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“overall effectiveness in clinical practice is unclear.14”
From ‘Too much, too late’: mixed methods multi-channel video recording study of computerized decision support systems and GP prescribing (2013) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“Several authors [1,2,4,6,62,76-87] note that a broader view is needed to assess the overall impact on health care.”
From A Holistic Framework to Improve the Uptake and Impact of eHealth Technologies (2011) · cites this paper as [2]
The cited source says what the claim attributes to it.
In the citing paper
“The foundation of the framework is based on the aforementioned principles, reviews in the field of eHealth [2,3,22,96-99], progressive insights from eHealth research (see Multimedia Appendix 4), and multidisciplinary theories from psychology, communication, and human–computer interaction design.”
From A Holistic Framework to Improve the Uptake and Impact of eHealth Technologies (2011) · cites this paper as [2]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The scale, volume of data obtained, and real time nature of this evaluation of the implementation of electronic health records in English secondary healthcare settings are strengths of our work.1”
From Implementation and adoption of nationwide electronic health records in secondary care in England: final qualitative results from prospective national evaluation in early adopter hospitals (2011) · cites this paper as [1]
Experimental — accuracy not yet measured
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Older Adults' Reasons for Using Technology while Aging in Place
Peek, S. T. M., Luijkx, K. G., Rijnaard, M. D., Nieboer, M. E., van der Voort, C. S., Aarts, S., van Hoof, J., Vrijhoef, H. J. M., & Wouters, E. J. M. (2016) · Gerontology · doi:10.1159/000430949 · Cited by 19,690
To Err Is Human: Building a Safer Health System
(2000) · National Academies Press eBooks · doi:10.17226/9728 · Cited by 14,044
Crossing the Quality Chasm: A New Health System for the 21st Century
Baker, A. (2001) · BMJ · doi:10.1136/bmj.323.7322.1192 · Cited by 10,736
Wall, A. (2000) · British Journal of Healthcare Management · doi:10.12968/bjhc.2000.6.9.19311 · Cited by 5,903
Crossing the Quality Chasm: A New Health System for the 21st Century
Bloom, B. S. (2002) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.287.5.646-a · Cited by 3,726
Chaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S. C., & Shekelle, P. G. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-10-200605160-00125 · Cited by 3,159
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Kawamoto, K., Houlihan, C. A., Balas, E. A., & Lobach, D. F. (2005) · BMJ · doi:10.1136/bmj.38398.500764.8f · Cited by 2,703
The Technology Acceptance Model: Its past and its future in health care
Holden, R. J., & Karsh, B.-T. (2010) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.07.002 · Cited by 2,669
Critical appraisal skills programme
Singh, J. (2013) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.107697 · Cited by 2,556
Synthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132
Popay, J., Roberts, H., Sowden, A., Petticrew, M., Arai, L., Rodgers, M., Britten, N., Roen, K., & Duffy, S. (2006) · Lancaster University · doi:10.13140/2.1.1018.4643 · Cited by 2,070
Charbonneau, D. H. (2005) · Europe PMC (PubMed Central) · Cited by 2,041
To Err is Human: Building a Safer Health System in 1999.
Stefl, M. E. (2001) · PubMed · Cited by 1,738
Guidance on the conduct of narrative synthesis in sytematic reviews
Popay, J., Roberts, H. M., Sowden, A. J., Petticrew, M. P., Arai, L., Rodgers, M., & Britten, N. (2006) · Cited by 1,363
HAYRINEN, K., SARANTO, K., & NYKANEN, P. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2007.09.001 · Cited by 1,297
Overriding of Drug Safety Alerts in Computerized Physician Order Entry
van der Sijs, H., Aarts, J., Vulto, A., & Berg, M. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1809 · Cited by 1,117
The Use and Interpretation of Quasi-Experimental Studies in Medical Informatics
Harris, A. D., McGregor, J. C., Perencevich, E. N., Furuno, J. P., Zhu, J., Peterson, D. E., & Finkelstein, J. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1749 · Cited by 1,023 · cited 2×
“Moreover, published primary research has been repeatedly found to be of poor quality – particularly with regards to outcome measurement and analysis [73,74,80,86,118].”
BackgroundWhat Is eHealth (3): A Systematic Review of Published Definitions
Oh, H., Jadad, A., Rizo, C., Enkin, M., Powell, J., & Pagliari, C. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e1 · Cited by 1,015 · cited 1×
“At the most elementary level, the literature that constitutes the evidence base is poorly referenced within bibliographic databases reflecting the nonstandard usage of terminology and lack of consensus on a taxonomy relating to eHealth technologies [133– 135].”
BackgroundSelf-citationPoissant, L. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1700 · Cited by 901
Preventing Medication Errors: Quality Chasm Series
(2007) · doi:10.17226/11623 · Cited by 829
LUDWICK, D., & DOUCETTE, J. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.06.005 · Cited by 668 · cited 1×
“An additional 55 supplementary reviews provided context to the findings [68–122], aiding in their interpretation [123].”
BackgroundAmmenwerth, E., Schnell-Inderst, P., Machan, C., & Siebert, U. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2667 · Cited by 668
GREENHALGH, T., POTTS, H. W. W., WONG, G., BARK, P., & SWINGLEHURST, D. (2009) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2009.00578.x · Cited by 541 · cited 1×
“An additional 55 supplementary reviews provided context to the findings [68–122], aiding in their interpretation [123].”
BackgroundPatient Safety: Achieving a New Standard for Care
(2004) · National Academies Press eBooks · doi:10.17226/10863 · Cited by 510
Costs and benefits of health information technology.
Shekelle, P. G., Morton, S. C., & Keeler, E. B. (2006) · doi:10.23970/ahrqepcerta132 · Cited by 501 · cited 2×
“Three related reviews – an update, a fuller report, and its more concise counterpart – were an exception due to the complementary nature of the reports rather than these being duplicative [22,55,56].”
BackgroundTechnology Acceptance among Physicians: A New Take on TAM
Yarbrough, A. K., & Smith, T. B. (2007) · Medical Care Research and Review · doi:10.1177/1077558707305942 · Cited by 482
What Is eHealth (4): A Scoping Exercise to Map the Field
Pagliari, C., Sloan, D., Gregor, P., Sullivan, F., Detmer, D., Kahan, J. P., Oortwijn, W., & MacGillivray, S. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e9 · Cited by 479
Self-citationThe effects of on-screen, point of care computer reminders on processes and outcomes of care
Shojania, K. G., Jennings, A., Ramsay, C. R., Grimshaw, J. M., Kwan, J. L., & Lo, L. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001096.pub2 · Cited by 466
Evaluation of health information systems—problems and challenges
Ammenwerth, E., Gräber, S., Herrmann, G., Bürkle, T., & König, J. (2003) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(03)00131-x · Cited by 412
Can We Systematically Review Studies That Evaluate Complex Interventions?
Shepperd, S., Lewin, S., Straus, S., Clarke, M., Eccles, M. P., Fitzpatrick, R., Wong, G., & Sheikh, A. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000086 · Cited by 408
Self-citationAccuracy of Data in Computer-based Patient Records
Hogan, W. R., & Wagner, M. M. (1997) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1997.0040342 · Cited by 389
Kaplan, B. (2001) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(01)00184-8 · Cited by 380 · cited 1×
“Evaluations have to date largely favoured simplistic approaches, which have provided little insight into why a particular outcome has occurred [145].”
BackgroundGoldzweig, C. L., Towfigh, A., Maglione, M., & Shekelle, P. G. (2009) · Health Affairs · doi:10.1377/hlthaff.28.2.w282 · Cited by 375
Chan, K. S., Fowles, J. B., & Weiner, J. P. (2010) · Medical Care Research and Review · doi:10.1177/1077558709359007 · Cited by 365
Determinants of Success of Inpatient Clinical Information Systems: A Literature Review
van der Meijden, M. J. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1094 · Cited by 363
Evaluating informatics applications – clinical decision support systems literature review
Kaplan, B. (2001) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(01)00183-6 · Cited by 350
Systematic review of scope and quality of electronic patient record data in primary care
Thiru, K., Hassey, A., & Sullivan, F. (2003) · BMJ · doi:10.1136/bmj.326.7398.1070 · Cited by 342
Shiffman, R. N., Liaw, Y., Brandt, C. A., & Corb, G. J. (1999) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1999.0060104 · Cited by 333
Shachak, A., & Reis, S. (2009) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.01065.x · Cited by 309
Evaluating eHealth Interventions: The Need for Continuous Systemic Evaluation
Catwell, L., & Sheikh, A. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000126 · Cited by 307
Self-citationComputerized clinical decision support for prescribing: provision does not guarantee uptake
Moxey, A., Robertson, J., Newby, D., Hains, I., Williamson, M., & Pearson, S.-A. (2010) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3170 · Cited by 305 · cited 1×
“An additional 55 supplementary reviews provided context to the findings [68–122], aiding in their interpretation [123].”
BackgroundElectronic Health Records: A Systematic Review on Quality Requirements
Ammenwerth, E., & Hoerbst, A. (2010) · Methods of Information in Medicine · doi:10.3414/me10-01-0038 · Cited by 303
Building a safer NHS for patients: improving medication safety
Smith, J., & Cavell, G. F. (2004) · Cited by 284
Design and Evaluation in eHealth: Challenges and Implications for an Interdisciplinary Field
Pagliari, C. (2007) · Journal of Medical Internet Research · doi:10.2196/jmir.9.2.e15 · Cited by 275
Self-citationEslami, S., Keizer, N. F. D., & Abu-Hanna, A. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2007.10.001 · Cited by 272
Mitchell, E. (2001) · BMJ · doi:10.1136/bmj.322.7281.279 · Cited by 271
Reckmann, M. H., Westbrook, J. I., Koh, Y., Lo, C., & Day, R. O. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3050 · Cited by 270
van Rosse, F., Maat, B., Rademaker, C. M. A., van Vught, A. J., Egberts, A. C. G., & Bollen, C. W. (2009) · Pediatrics · doi:10.1542/peds.2008-1494 · Cited by 265
Schedlbauer, A., Prasad, V., Mulvaney, C., Phansalkar, S., Stanton, W., Bates, D. W., & Avery, A. J. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2910 · Cited by 262 · cited 1×
“Our final selection of 53 reviews provided the main empirical evidence base in relation to assessing the impact of the selected eHealth technologies (see Table 1 for our critical appraisal of these studies) [15–67], full details of which can be found in Table S2.”
BackgroundInformatics systems to promote improved care for chronic illness: a literature review
Dorr, D., Bonner, L. M., Cohen, A. N., Shoai, R. S., Perrin, R., Chaney, E., & Young, A. S. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2255 · Cited by 257 · cited 1×
“An additional 55 supplementary reviews provided context to the findings [68–122], aiding in their interpretation [123].”
BackgroundGreenhalgh, T., Stramer, K., Bratan, T., Byrne, E., Mohammad, Y., & Russell, J. (2008) · BMJ · doi:10.1136/bmj.a1786 · Cited by 257
Computerized advice on drug dosage to improve prescribing practice
Durieux, P., Trinquart, L., Colombet, I., Niès, J., Walton, R., Rajeswaran, A., Rège-Walther, M., Harvey, E., & Burnand, B. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002894.pub2 · Cited by 253
(2004) · UCL Discovery (University College London) · Cited by 246
Wolfstadt, J. I., Gurwitz, J. H., Field, T. S., Lee, M., Kalkar, S., Wu, W., & Rochon, P. A. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0504-5 · Cited by 235
Visions and strategies to improve evaluation of health information systems
Ammenwerth, E., Brender, J., Nykänen, P., Prokosch, H.-U., Rigby, M., & Talmon, J. (2004) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2004.04.004 · Cited by 233
Robertson, A., Cresswell, K., Takian, A., Petrakaki, D., Crowe, S., Cornford, T., Barber, N., Avery, A., Fernando, B., Jacklin, A., et al. (2010) · BMJ · doi:10.1136/bmj.c4564 · Cited by 230
Self-citationEvaluating information technology in health care: barriers and challenges
Heathfield, H., Pitty, D., & Hanka, R. (1998) · BMJ · doi:10.1136/bmj.316.7149.1959 · Cited by 226
Jamal, A., McKenzie, K., & Clark, M. (2009) · Health Information Management Journal · doi:10.1177/183335830903800305 · Cited by 222
Ward, R., Stevens, C., Brentnall, P., & Briddon, J. (2008) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2008.00777.x · Cited by 212
Kukafka, R., Johnson, S. B., Linfante, A., & Allegrante, J. P. (2003) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2003.09.002 · Cited by 206
HURYK, L. A. (2010) · Journal of Nursing Management · doi:10.1111/j.1365-2834.2010.01084.x · Cited by 202
Niazkhani, Z., Pirnejad, H., Berg, M., & Aarts, J. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2419 · Cited by 200
Evaluation of Outpatient Computerized Physician Medication Order Entry Systems: A Systematic Review
Eslami, S., Abu-Hanna, A., & de Keizer, N. F. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2238 · Cited by 200 · cited 1×
“Our final selection of 53 reviews provided the main empirical evidence base in relation to assessing the impact of the selected eHealth technologies (see Table 1 for our critical appraisal of these studies) [15–67], full details of which can be found in Table S2.”
BackgroundQuality of morbidity coding in general practice computerized medical records: a systematic review
Jordan, K. (2004) · Family Practice · doi:10.1093/fampra/cmh409 · Cited by 199
Rohm, A. J., & Milne, G. R. (2004) · Journal of Business Research · doi:10.1016/s0148-2963(02)00345-4 · Cited by 197
Hendy, J., Reeves, B. C., Fulop, N., Hutchings, A., & Masseria, C. (2005) · BMJ · doi:10.1136/bmj.331.7512.331 · Cited by 197
Delpierre, C. (2004) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzh064 · Cited by 194
Pearson, S.-A., Moxey, A., Robertson, J., Hains, I., Williamson, M., Reeve, J., & Newby, D. (2009) · BMC Health Services Research · doi:10.1186/1472-6963-9-154 · Cited by 193
Impact of emerging technologies on medication errors and adverse drug events
Oren, E., Shaffer, E. R., & Guglielmo, B. J. (2003) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/60.14.1447 · Cited by 190
Dexheimer, J. W., Talbot, T. R., Sanders, D. L., Rosenbloom, S. T., & Aronsky, D. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2555 · Cited by 179
Bryan, C., & Boren, S. (2008) · Journal of Innovation in Health Informatics · doi:10.14236/jhi.v16i2.679 · Cited by 170
Shamliyan, T. A., Duval, S., Du, J., & Kane, R. L. (2008) · Health Services Research · doi:10.1111/j.1475-6773.2007.00751.x · Cited by 165
Gagnon, M.-P., Légaré, F., Labrecque, M., Frémont, P., Pluye, P., Gagnon, J., Car, J., Pagliari, C., Desmartis, M., Turcot, L., et al. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006093.pub2 · Cited by 157
Self-citationA Systematic Review of the Literature on Multidisciplinary Rounds to Design Information Technology
Gurses, A. P., & Xiao, Y. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1992 · Cited by 154
Resistance Is Futile: But It Is Slowing the Pace of EHR Adoption Nonetheless
Ford, E. W., Menachemi, N., Peterson, L. T., & Huerta, T. R. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3042 · Cited by 150
Methods to Evaluate Health information Systems in Healthcare Settings: A Literature Review
Rahimi, B., & Vimarlund, V. (2007) · Journal of Medical Systems · doi:10.1007/s10916-007-9082-z · Cited by 147
The quality, safety and content of telephone and face-to-face consultations: a comparative study
McKinstry, B., Hammersley, V., Burton, C., Pinnock, H., Elton, R., Dowell, J., Sawdon, N., Heaney, D., Elwyn, G., & Sheikh, A. (2010) · Quality and Safety in Health Care · doi:10.1136/qshc.2008.027763 · Cited by 147
Self-citationBennett, J. W., & Glasziou, P. P. (2003) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2003.tb05166.x · Cited by 146 · cited 1×
“Our final selection of 53 reviews provided the main empirical evidence base in relation to assessing the impact of the selected eHealth technologies (see Table 1 for our critical appraisal of these studies) [15–67], full details of which can be found in Table S2.”
Telephone consulting in primary care: a triangulated qualitative study of patients and providers
McKinstry, B., Watson, P., Pinnock, H., Heaney, D., & Sheikh, A. (2009) · British Journal of General Practice · doi:10.3399/bjgp09x420941 · Cited by 139
Self-citationComputerized Knowledge Management in Diabetes Care
Balas, E. A., Krishna, S., Kretschmer, R. A., Cheek, T. R., Lobach, D. F., & Boren, S. A. (2004) · Medical Care · doi:10.1097/01.mlr.0000128008.12117.f8 · Cited by 136
Value of the electronic patient record: An analysis of the literature
Uslu, A., & Stausberg, J. (2008) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2008.02.001 · Cited by 133
Best practices in EMR implementation: a systematic review.
Keshavjee, K., Bosomworth, J., Copen, J., Lai, J., Küçükyazicı, B., Lilani, R., & Holbrook, A. M. (2006) · PubMed · Cited by 129
The effectiveness of computerized clinical guidelines in the process of care: a systematic review
Damiani, G., Pinnarelli, L., Colosimo, S. C., Almiento, R., Sicuro, L., Galasso, R., Sommella, L., & Ricciardi, W. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-2 · Cited by 129
Mollon, B., Chong, J. J., Holbrook, A. M., Sung, M., Thabane, L., & Foster, G. (2009) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-9-11 · Cited by 124 · cited 1×
“An additional 55 supplementary reviews provided context to the findings [68–122], aiding in their interpretation [123].”
BackgroundA taxonomic description of computer-based clinical decision support systems
Berlin, A., Sorani, M., & Sim, I. (2006) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.12.003 · Cited by 123
The Challenge of Measuring Quality of Care From the Electronic Health Record
Roth, C. P., Lim, Y.-W., Pevnick, J. M., Asch, S. M., & McGlynn, E. A. (2009) · American Journal of Medical Quality · doi:10.1177/1062860609336627 · Cited by 121
Yourman, L. C., Concato, J., & Agostini, J. V. (2008) · The American Journal of Geriatric Pharmacotherapy · doi:10.1016/j.amjopharm.2008.06.001 · Cited by 111
The impact of computerised physician order entry systems on pathology services: A systematic review
Georgiou, A., WILLIAMSON, M., Westbrook, J. I., & RAY, S. (2006) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2006.02.004 · Cited by 110
Challenges and Opportunities of eHealth Research
Ahern, D. K. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.016 · Cited by 103 · cited 1×
“Our greatest cause for concern was the weakness of the evidence base itself. A strong evidence base is characterised by quantity, quality, and consistency. Unfortunately, we found that the eHealth evidence base falls short in all of these respects. In addition, relative to the number of eHealth implementations that ha…”
BackgroundRandell, R., Mitchell, N., Dowding, D., Cullum, N., & Thompson, C. (2007) · Journal of Health Services Research & Policy · doi:10.1258/135581907782101543 · Cited by 100
Impact of CPOE on Mortality Rates – Contradictory Findings, Important Messages
Talmon, J., Ash, J. S., Bates, D. W., Beuscart-Zéphir, M.-C., Duhamel, A., Elkin, P. L., Gardner, R. M., Geissbuhler, A., & Ammenwerth, E. (2006) · Methods of Information in Medicine · doi:10.1055/s-0038-1634123 · Cited by 99
Pollock, N., Williams, R., & Procter, R. (2003) · Technology Analysis & Strategic Management · doi:10.1080/09537320310001601504 · Cited by 96 · cited 1×
“Additionally, it is not unusual for insufficient time and effort to be devoted to the allimportant customisation process [147].”
BackgroundSelf-citationHandler, S. M., Altman, R. L., Perera, S., Hanlon, J. T., Studenski, S. A., Bost, J. E., Saul, M. I., & Fridsma, D. B. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2369 · Cited by 94
Mador, R. L., & Shaw, N. T. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2009.01.002 · Cited by 90
VANDEWETERING, R., & Batenburg, R. S. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.06.010 · Cited by 90
Health Information System Implementation: A Qualitative Meta-analysis
Rahimi, B., Vimarlund, V., & Timpka, T. (2009) · Journal of Medical Systems · doi:10.1007/s10916-008-9198-9 · Cited by 82 · cited 1×
“An additional 55 supplementary reviews provided context to the findings [68–122], aiding in their interpretation [123].”
BackgroundUnderstanding the implementation and integration of e-health services
Mair, F. S., May, C., Finch, T., Murray, E., Anderson, G., Sullivan, F., O'donnell, C., Wallace, P., & Epstein, O. (2007) · Journal of Telemedicine and Telecare · doi:10.1258/135763307781645112 · Cited by 82
Kawamoto, K., & Lobach, D. F. (2003) · PubMed Central · Cited by 78
The Use of Electronic Health Records in the Exam Room and Patient Satisfaction: A Systematic Review
Irani, J. S., Middleton, J. L., Marfatia, R., Omana, E. T., & D'Amico, F. (2009) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2009.05.080259 · Cited by 78
Implementing the NHS information technology programme: qualitative study of progress in acute trusts
Hendy, J., Fulop, N., Reeves, B. C., Hutchings, A., & Collin, S. (2007) · BMJ · doi:10.1136/bmj.39195.598461.551 · Cited by 76
(2007) · PubMed · Cited by 74
Alexander, G., & Staggers, N. (2009) · Advances in Nursing Science · doi:10.1097/ans.0b013e3181b0d737 · Cited by 74
Heselmans, A., Van de Velde, S., Donceel, P., Aertgeerts, B., & Ramaekers, D. (2009) · Implementation Science · doi:10.1186/1748-5908-4-82 · Cited by 71
Rothschild, J. M. (2004) · Journal of Critical Care · doi:10.1016/j.jcrc.2004.08.006 · Cited by 69
Barriers That Impede the Adoption of Pediatric Information Technology
Johnson, K. B. (2001) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpedi.155.12.1374 · Cited by 66
Car, J., Black, A. D., Anandan, C., Cresswell, K. M., Pagliari, C., Mckinstry, B., Procter, R., Majeed, A., & Sheikh, A. (2008) · Cited by 66
Self-citationNiazkhani, Z., Berg, M., Bal, R. A., & Pirnejad, H. (2008) · Methods of Information in Medicine · doi:10.3414/me0502 · Cited by 65
Tight glycemic control and computerized decision-support systems: a systematic review
Eslami, S., Abu-Hanna, A., de Jonge, E., & de Keizer, N. F. (2009) · Intensive Care Medicine · doi:10.1007/s00134-009-1542-0 · Cited by 64
Bravata, D. M., McDonald, K. M., Shojania, K. G., Sundaram, V., & Owens, D. K. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-142-12_part_2-200506211-00005 · Cited by 59
CPOE system design aspects and their qualitative effect on usability.
Khajouei, R., & Jaspers, M. (2008) · PubMed · Cited by 58
Factors Influencing Outcomes of Clinical Information Systems Implementation: A Systematic Review
GRUBER, D., CUMMINGS, G. G., LEBLANC, L., & SMITH, D. L. (2009) · CIN: Computers, Informatics, Nursing · doi:10.1097/ncn.0b013e31819f7c07 · Cited by 56 · cited 1×
“An additional 55 supplementary reviews provided context to the findings [68–122], aiding in their interpretation [123].”
BackgroundChuang, J.-H. (2002) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m0997 · Cited by 55
STARE-HI -Statement on Reporting of Evaluation Studies in Health Informatics
Ammenwerth, E., Brender, J., de Keizer, N., Nykänen, P., Rigby, M., & Talmon, J. (2009) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638633 · Cited by 53
Clinical decision support systems and antibiotic use
Shebl, N. A., Franklin, B. D., & Barber, N. (2007) · Pharmacy World & Science · doi:10.1007/s11096-007-9113-3 · Cited by 52
Wollersheim, D., Sari, A., & Rahayu, W. (2009) · Health Information Management Journal · doi:10.1177/183335830903800202 · Cited by 52
A Plea for Controlled Trials in Medical Informatics
Tierney, W. M., Overhage, J. M., & McDonald, C. J. (1994) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1994.95236170 · Cited by 51
Hart, M. D. (2008) · CIN Computers Informatics Nursing · doi:10.1097/01.ncn.0000336462.94939.4c · Cited by 51
A systematic review of the use of computers in the management of hypertension.
Montgomery, A. A., & Fahey, T. (1998) · Journal of Epidemiology and Community Health · doi:10.1136/jech.52.8.520 · Cited by 49
Telemedicine for management of patients with COPD?
McKinstry, B., Pinnock, H., & Sheikh, A. (2009) · The Lancet · doi:10.1016/s0140-6736(09)61542-7 · Cited by 48
Self-citationCollin, S., Reeves, B. C., Hendy, J., Fulop, N., Hutchings, A., & Priedane, E. (2008) · BMJ · doi:10.1136/bmj.a939 · Cited by 48
Sintchenko, V., Magrabi, F., & Tipper, S. (2007) · Medical Informatics and the Internet in Medicine · doi:10.1080/14639230701447701 · Cited by 47
Clinical decision support systems for neonatal care
Tan, K., Dear, P. R., & Newell, S. J. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004211.pub2 · Cited by 47
Niès, J., Colombet, I., Degoulet, P., & Durieux, P. (2006) · Europe PMC (PubMed Central) · Cited by 44
Considering clustering: a methodological review of clinical decision support system studies.
Chuang, J.-H., Hripcsak, G. M., & Jenders, R. A. (2000) · Europe PMC (PubMed Central) · Cited by 43
Eminovic, N., Wyatt, J. C., Tarpey, A. M., Murray, G., & Ingrams, G. J. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.2.e17 · Cited by 43
Review of computerized decision support systems for oral anticoagulation management
Fitzmaurice, Hobbs, Delaney, Wilson, & Mcmanus (1998) · British Journal of Haematology · doi:10.1046/j.1365-2141.1998.00858.x · Cited by 43
de Keizer, N. F., & Ammenwerth, E. (2007) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2006.11.009 · Cited by 43
Ensuring the Safety of Health Information Systems: Using Heuristics for Patient Safety
Carvalho, C., Borycki, E. M., & Kushniruk, A. W. (2009) · Healthcare Quarterly · doi:10.12927/hcq.2009.20966 · Cited by 42
Weir, C. R., Staggers, N., & Phansalkar, S. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.12.001 · Cited by 42
Scientific production of electronic health record research, 1991–2005
Wen, H., Ho, Y., Jian, W., Li, H.-C., & Hsu, Y.-H. E. (2007) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2007.02.002 · Cited by 41
Jerant, A. F., & Hill, D. B. (2000) · PubMed · Cited by 40
Friedman, C. P., & Abbas, U. L. (2003) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(02)00109-0 · Cited by 38
Electronic health records: is the evidence base any use?
Clamp, S., & Keen, J. (2007) · Medical Informatics and the Internet in Medicine · doi:10.1080/14639230601097903 · Cited by 37
The Impact of eHealth on the Quality and Safety of Healthcare
Majeed, A., Black, A., Car, J., Anandan, C., Cresswell, K. M., McKinstry, B., Pagliari, C., Procter, R., & Sheikh, A. (2009) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-642-11284-3_21 · Cited by 36
Self-citationA systematic review of medication safety outcomes related to drug interaction software.
Wong, K., Yu, S. K. H., & Holbrook, A. M. (2010) · PubMed · Cited by 34
The Impact of Electronic Medical Records on Nursing Efficiency
Thompson, D. I., Johnston, P., & Spurr, C. D. (2009) · JONA The Journal of Nursing Administration · doi:10.1097/nna.0b013e3181b9209c · Cited by 34
Vision and challenges of Evidence-Based Health Informatics: A case study of a CPOE meta-analysis
Ammenwerth, E., Schnell‐Inderst, P., & Siebert, U. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.11.003 · Cited by 33
Development of a taxonomy for health information technology.
Dixon, B. E., Zafar, A., & McGowan, J. J. (2007) · PubMed · Cited by 32
Pinnock, H., Hanley, J., Lewis, S. C., MacNee, W., Pagliari, C., Pol, M. M. V. D., Sheikhg, A., & McKinstry, B. (2009) · Primary Care Respiratory Journal · doi:10.4104/pcrj.2009.00040 · Cited by 32
Self-citationAmmenwerth, E., & de Keizer, N. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2276 · Cited by 31
Campion, T. R., Waitman, L. R., May, A. K., Özdaş, A., Lorenzi, N. M., & Gadd, C. S. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2009.09.004 · Cited by 31
Châtellier, G., Colombet, I., & Patrice Degoulet, A. (1998) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(98)00087-2 · Cited by 30
Kaushal, R., Shojania, K. G., & Bates, D. W. (2003) · Archives of Internal Medicine · doi:10.1001/archinte.163.12.1409 · Cited by 30
Methodologic challenges of e-health research
Bowling, J. M., Rimer, B. K., Lyons, E., Golin, C. E., Frydman, G., & Ribisl, K. M. (2006) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2006.08.011 · Cited by 28
Methodologic Issues in Health Informatics Trials: The Complexities of Complex Interventions
Shcherbatykh, I., Holbrook, A., Thabane, L., Dolovich, L., & COMPETE III investigators (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2518 · Cited by 27
Using health information technology to improve drug monitoring: a systematic review
Hayward, G. L., Parnes, A. J., & Simon, S. R. (2009) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1831 · Cited by 25
Computerized Decision-Support Systems for Chronic Pain Management in Primary Care
Smith, M. Y., DePue, J. D., & Rini, C. K. (2007) · Pain Medicine · doi:10.1111/j.1526-4637.2007.00278.x · Cited by 24
McKinstry, B., Watson, P., Pinnock, H., Heaney, D., & Sheikh, A. (2009) · Family Practice · doi:10.1093/fampra/cmp032 · Cited by 20
Self-citationPublication Bias in Medical Informatics
Friedman, C. P., & Wyatt, J. C. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080189 · Cited by 18
The Value of Electronic Health Records
Middleton, B. (2005) · Computers in health care · doi:10.1007/0-387-27375-1_4 · Cited by 18
Categorizing Communication Errors in Integrated Hospital Information Systems
Ammenwerth, E., & Saboor, S. (2009) · Methods of Information in Medicine · doi:10.3414/me9220 · Cited by 16
Understanding communication capacity. Communication patterns and ICT usage in clinical settings.
Fitzpatrick, L.-A., Melnikas, A., Weathers, M., & Kachnowski, S. (2008) · PubMed · Cited by 14
Publication bias in medical informatics evaluation research: is it an issue or not?
Machan, C., Ammenwerth, E., & Bodner, T. (2006) · PubMed · Cited by 12
(1997) · Cited by 11
Black, A. D., Car, J., Majeed, A., & Sheikh, A. (2008) · Journal of Innovation in Health Informatics · doi:10.14236/jhi.v16i3.690 · Cited by 9
Self-citation[Economic and organizational evaluation of an imaging network (PACS)].
Charvet-Protat, S., & Thoral, F. (1998) · PubMed · Cited by 9
Building Nursing Intellectual Capital for Safe Use of Information Technology: A Systematic Review
Poe, S. (2011) · Journal of Nursing Care Quality · doi:10.1097/ncq.0b013e3181e15c88 · Cited by 8
Implementation of Health Information Systems in Romania
Bazavan, M., Farcas, D. D., & Mihalas, G. I. (2006) · Methods of Information in Medicine · doi:10.1055/s-0038-1634048 · Cited by 8
E-health interventions as complex interventions: improving the quality of methods of assessment.
Holbrook, A. M., Thabane, L., Shcherbatykh, I. Y., & O’Reilly, D. J. (2006) · PubMed Central · Cited by 8
Report on conference track 5: evaluation metrics and outcome
Friedman, C. P. (2003) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(03)00004-2 · Cited by 8
Aarts, P. J., Ammenwerth, E., Berghold, A., Beuscart-Zéphir, M.-C., Brender, J., Bürkle, T., Deibl, M., Denz, M. D., Eminović, N., Holle, R., et al. (2006) · PubMed · Cited by 7
Assessing the quality of medical information technology economic evaluations: room for improvement.
Eisenstein, E. L., Ortiz, M., Anstrom, K. J., Crosslin, D. R., & Lobach, D. F. (2006) · Europe PMC (PubMed Central) · Cited by 7
Assessing and Improving Evidence Based Health Informatics Research
Wyatt, J. C. (2010) · Studies in health technology and informatics · doi:10.3233/978-1-60750-476-4-435 · Cited by 4
Overview of Assessment Methods
Brender, J. (2006) · Elsevier eBooks · doi:10.1016/b978-012370464-1.50006-x · Cited by 1
Research works printed but not linked: 3
- C Pagliari, 2004, EH1 E-Health scoping exercise. Review of wider Web-based information sources.
- C Pagliari, 2004, EH1 E-Health scoping exercise. Review of the traditional research literature.
- PG Shekelle, 2009, Costs and benefits of health technology information: an updated systematic review.
Cited by
Allocation of Physician Time in Ambulatory Practice: A Time and Motion Study in 4 Specialties
Sinsky, C., Colligan, L., Li, L., Prgomet, M., Reynolds, S., Goeders, L., Westbrook, J., Tutty, M., & Blike, G. (2016) · Annals of Internal Medicine · doi:10.7326/m16-0961 · Cited by 1,494
Buntin, M. B., Burke, M. F., Hoaglin, M. C., & Blumenthal, D. (2011) · Health Affairs · doi:10.1377/hlthaff.2011.0178 · Cited by 1,311
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308
“This approach has been recommended in recent literature [10, 11, 13, 23] and has been the key point in the field of persuasive technology [24], where there are examples of studies on the persuasive capacities of technology to support web-based interventions in the health care domain [25-28].”
BackgroundGlobal health 2035: a world converging within a generation
Jamison, D. T., Summers, L. H., Alleyne, G., Arrow, K. J., Berkley, S., Binagwaho, A., Bustreo, F., Evans, D., Feachem, R. G. A., Frenk, J., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)62105-4 · Cited by 1,220
A Holistic Framework to Improve the Uptake and Impact of eHealth Technologies
van Gemert-Pijnen, J. E., Nijland, N., van Limburg, M., Ossebaard, H. C., Kelders, S. M., Eysenbach, G., & Seydel, E. R. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1672 · Cited by 1,126
Metadata
- Authors
- Black, A. D., Car, J., Pagliari, C., Anandan, C., Cresswell, K., Bokun, T., McKinstry, B., Procter, R., Majeed, A., & Sheikh, A.
- Affiliations
- Imperial College London (GB)
- University of Edinburgh (GB)
- University of Manchester (GB)
- Corresponding author
- Sheikh, Aziz
- ORCID
- Venue
- PLoS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-01-18
- Volume
- 8
- Issue
- 1
- Pages
- e1000387
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC3022523
- OpenAlex
- W2002144979
- Semantic Scholar
- 8989e6727eab5d5fc760d0c7a63fb3864fe49a4f
- Cited by
- 1,442
- References
- 168
- Citations by year
- 2026: 23 · 2025: 26 · 2024: 44 · 2023: 46 · 2022: 55 · 2021: 81 · 2020: 94 · 2019: 102 · 2018: 109 · 2017: 110 · 2016: 129 · 2015: 109 · 2014: 126 · 2013: 207 · 2012: 111
- FWCI
- 24.19
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (publishedVersion)
- Warwick Research Archive Portal (University of Warwick) (acceptedVersion)
- Research Publications (Maastricht University) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Research Explorer (The University of Manchester) (submittedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- Spiral (Imperial College London) (submittedVersion, other-oa)
- Research Publications (Maastricht University) (submittedVersion, other-oa)
- Funders
- Economic and Social Research Council
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Keywords
- e-health, quality of care, patient safety, clinical decision support, telemedicine, health data management, digital health technologies, cost-effectiveness, evidence gaps, health policy
- MeSH terms
- Cost-Benefit Analysis, Delivery of Health Care, Health Policy, Medical Informatics, Quality of Health Care, Radiology Information Systems, Review Literature as Topic, Efficiency, Organizational, Electronic Prescribing, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
