Health technology, quality and safety in a learning health system
Open accessThe DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
Health technology quality and safety is an important issue for health informatics (i.e. digital health) professionals. Health technologies have been used to (1) collect data that can be analyzed to improve the quality and safety of healthcare activities and (2) re-engineer and/or automate error-prone processes. Health technologies are also able to introduce new types of errors (i.e. technology-induced errors) and have been implicated in propagating errors across digital health ecosystems. To develop a learning health system, health technologies need to be considered in terms of how they can improve the quality and safety of health activities traditionally carried out by humans (patients and health professionals) and also how the technology’s quality and safety can be improved. This article outlines how this can be done by integrating evidence from health informatics research into practice using a learning health systems approach.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Several methodological cross-disciplinary reviews have advocated for triangulating qualitative and quantitative methods to capture complexity in digital health safety (32, 56).”
From Why digital health fails silently: a sociotechnical theory of health information technology–related risk (2026) · cites this paper as [56]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
Role of Computerized Physician Order Entry Systems in Facilitating Medication Errors
Koppel, R. (2005) · JAMA · doi:10.1001/jama.293.10.1197 · Cited by 2,126
Biomedical Informatics: Computer Applications in Health Care and Biomedicine
(2024) · Biomedical Informatics: Computer Applications in Health Care and Biomedicine · doi:10.33029/9704-8204-9-bin-2024-1-744 · Cited by 777
Koppel, R., Wetterneck, T., Telles, J. L., & Karsh, B.-T. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2616 · Cited by 685 · cited 2×
“Researchers have created taxonomies, methods, and educational approaches to improve quality, safety, and risk management in a digital health system.(10-55,59) Training programs are available and trained health professionals (i.”
BackgroundThe Learning Healthcare System: Workshop Summary
Olsen, L., Aisner, D. L., & McGinnis, J. M. (2013) · Cited by 582
Poon, E. G., Cina, J. L., Churchill, W., Patel, N., Featherstone, E., Rothschild, J. M., Keohane, C. A., Whittemore, A. D., Bates, D. W., & Gandhi, T. K. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-145-6-200609190-00006 · Cited by 294 · cited 2×
“Researchers have created taxonomies, methods, and educational approaches to improve quality, safety, and risk management in a digital health system.(10-55,59) Training programs are available and trained health professionals (i.”
BackgroundKushniruk, A. W., Triola, M. M., Borycki, E. M., Stein, B., & Kannry, J. L. (2005) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2005.01.003 · Cited by 277
Self-citationComprehensive Analysis of a Medication Dosing Error Related to CPOE: Table 1
Horsky, J., Kuperman, G. J., & Patel, V. L. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1740 · Cited by 197 · cited 1×
“Researchers have created taxonomies, methods, and educational approaches to improve quality, safety, and risk management in a digital health system.(10-55,59) Training programs are available and trained health professionals (i.”
BackgroundUsing FDA reports to inform a classification for health information technology safety problems
Magrabi, F., Ong, M.-S., Runciman, W., & Coiera, E. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000369 · Cited by 193 · cited 1×
“Health technologies have also been involved in patient safety incidents.(4-10) Patient safety incidents involving technology have been documented in acute care,(6,8-10) clinic,(10) home care,(11) and community settings.”
BackgroundAn analysis of electronic health record–related patient safety incidents
Palojoki, S., Mäkelä, M., Lehtonen, L., & Saranto, K. (2017) · Health Informatics Journal · doi:10.1177/1460458216631072 · Cited by 108
Magrabi, F., Baker, M., Sinha, I., Ong, M.-S., Harrison, S., Kidd, M. R., Runciman, W. B., & Coiera, E. (2015) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.12.003 · Cited by 100
Business process re‐engineering in healthcare management: a case study
Bertolini, M., Bevilacqua, M., Ciarapica, F. E., & Giacchetta, G. (2011) · Business Process Management Journal · doi:10.1108/14637151111105571 · Cited by 89
McLaughlin and Kaluzny's Continuous Quality Improvement In Health Care
Sollecito, W. A., & Johnson, J. K. (2005) · Medical Entomology and Zoology · Cited by 76
Kushniruk, A. W., Bates, D. W., Bainbridge, M., Househ, M. S., & Borycki, E. M. (2013) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.12.006 · Cited by 74
Self-citationKhodambashi, S. (2013) · Procedia Technology · doi:10.1016/j.protcy.2013.12.106 · Cited by 74
Kushniruk, A. W., Beuscart-Zéphir, M.-C., Grzes, A., Borycki, E. M., Watbled, L., & Kannry, J. L. (2010) · Healthcare Quarterly · doi:10.12927/hcq.2010.21967 · Cited by 62
Self-citationKnowledge Management and E-Learning
Costarides, M. V. (2014) · Health Promotion Practice · doi:10.1177/1524839914548451 · Cited by 60
Business process management in health care: current challenges and future prospects
Buttiġieġ, S. C., Dey, P. K., & Gauci, D. (2016) · Innovation and Entrepreneurship in Health · doi:10.2147/ieh.s68183 · Cited by 56
Ensuring the Safety of Health Information Systems: Using Heuristics for Patient Safety
Carvalho, C., Borycki, E. M., & Kushniruk, A. W. (2009) · Healthcare Quarterly · doi:10.12927/hcq.2009.20966 · Cited by 52
Self-citationKushniruk, A. W., Bellwood, P. S., Brender, J., & Borycki, E. M. (2012) · Methods of Information in Medicine · doi:10.3414/me11-02-0009 · Cited by 51
Self-citationBorycki, E. M., & Kushniruk, A. W. (2010) · The Open Medical Informatics Journal · doi:10.2174/1874431101004010181 · Cited by 51
Self-citationKushniruk, A. W., Nøhr, C. G., Takeda, H., Kuwata, S., Carvalho, C., Bainbridge, M., Kannry, J. L., & Borycki, E. M. (2013) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638828 · Cited by 49
Self-citationCharles, K., Cannon, M., Hall, R. S., & Coustasse, A. (2014) · Europe PMC (PubMed Central) · Cited by 49
Health IT and Patient Safety: Building Safer Systems for Better Care
Institute of Medicine (2012) · National Academies Press eBooks · doi:10.17226/13269 · Cited by 45
Borycki, E. M., & Kushniruk, A. W. (2008) · IGI Global eBooks · doi:10.4018/978-1-59904-792-8.ch009 · Cited by 43
Self-citationMethods to Assess the Safety of Health Information Systems
Borycki, E. M., & Keay, E. (2010) · Healthcare Quarterly · doi:10.12927/hcq.2010.21966 · Cited by 38
Self-citationBorycki, E. M., Kushniruk, A. W., Keay, E., Nicoll, J. A. R., Anderson, J. G., & Anderson, M. (2009) · Healthcare Quarterly · doi:10.12927/hcq.2009.20974 · Cited by 34
Self-citationBorycki, E. M. (2013) · Healthcare Informatics Research · doi:10.4258/hir.2013.19.2.69 · Cited by 32
Self-citationLow-Cost Rapid Usability Testing for health information systems: is it worth the effort?
Baylis, T. B., Kushniruk, A. W., & Borycki, E. M. (2012) · PubMed · Cited by 27
Self-citationTransforming the future of health together: The Learning Health Systems Consensus Action Plan
Rubin, J. C., Silverstein, J. C., Friedman, C. P., Kush, R. D., Anderson, W. H., Lichter, A. S., Humphreys, D. J., Brown, J. S., Crawford, L., Walker, J. M., et al. (2018) · Learning Health Systems · doi:10.1002/lrh2.10055 · Cited by 27
Methods for Addressing Technology-induced Errors: The Current State
Dexheimer, J. W., Cossio, C. H. L., Gong, Y., Jensen, S., Kaipio, J., Kennebeck, S., Kirkendall, E., Kushniruk, A. W., Kuziemsky, C., Marcilly, R., et al. (2016) · Yearbook of Medical Informatics · doi:10.15265/iy-2016-029 · Cited by 26
Self-citationBig Data, Big Challenges: A Healthcare Perspective
(2019) · Lecture notes in bioengineering · doi:10.1007/978-3-030-06109-8 · Cited by 19
Borycki, E. M., & Kushniruk, A. W. (2022) · Healthcare Management Forum · doi:10.1177/08404704211062575 · Cited by 18
Self-citationKang, H., Wang, J., Yao, B., Zhou, S., & Gong, Y. (2018) · JAMIA Open · doi:10.1093/jamiaopen/ooy042 · Cited by 17
Borycki, E. M., Kushniruk, A. W., & Carvalho, C. (2013) · Computational and Mathematical Methods in Medicine · doi:10.1155/2013/526419 · Cited by 15
Self-citationBorycki, E. M., Kushniruk, A. W., Kuwata, S., & Kannry, J. L. (2011) · Studies in health technology and informatics · doi:10.3233/978-1-60750-740-6-197 · Cited by 14
Self-citationA Framework for Diagnosing and Identifying Where Technology-Induced Errors Come From
Borycki, E. M., Kushniruk, A. W., Keay, L. J., & Kuo, A. (2009) · Studies in health technology and informatics · doi:10.3233/978-1-60750-043-8-181 · Cited by 14
Self-citationAn Evidence-Based Tool for Safe Configuration of Electronic Health Records: The eSafety Checklist
Dhillon-Chattha, P., McCorkle, R. C., & Borycki, E. M. (2018) · Applied Clinical Informatics · doi:10.1055/s-0038-1675210 · Cited by 14
Self-citationIntroduction to Health Informatics: A Canadian Perspective
MacVane Phipps, F. (2019) · International Journal of Health Governance · doi:10.1108/ijhg-03-2019-073 · Cited by 13
Business Intelligence Dashboards for Patient Safety and Quality: A Narrative Literature Review
Davy, A., & Borycki, E. M. (2022) · Studies in health technology and informatics · doi:10.3233/shti220113 · Cited by 13
Self-citationInvestigating health information systems-induced errors
Yusof, M. M., & Sahroni, M. N. (2018) · International Journal of Health Care Quality Assurance · doi:10.1108/ijhcqa-07-2017-0125 · Cited by 12
Creating a database for health IT events via a hybrid deep learning model
Kang, H., & Gong, Y. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103556 · Cited by 11
FIN-TIERA: A Tool for Assessing Technology Induced Errors
Pajunen, T., Lehtonen, L., Saranto, K., & Palojoki, S. (2017) · Methods of Information in Medicine · doi:10.3414/me16-01-0097 · Cited by 9
Borycki, E. M., Farghali, A., & Kushniruk, A. W. (2022) · Studies in health technology and informatics · doi:10.3233/shti220716 · Cited by 8
Self-citationElectronic Health Record System-Related Patient Safety Incidents – How to Classify Them?
Palojoki, S., Vuokko, R., Vakkuri, A., & Saranto, K. (2020) · Studies in health technology and informatics · doi:10.3233/shti200714 · Cited by 6
A Safety Maturity Model for Technology-Induced Errors
Borycki, E. M., & Kushniruk, A. W. (2022) · Studies in health technology and informatics · doi:10.3233/shti210954 · Cited by 5
Self-citationComplexity and Health Technology Safety
Borycki, E. M., Farghali, A., & Kushniruk, A. W. (2022) · Studies in health technology and informatics · doi:10.3233/shti220787 · Cited by 5
Self-citationA Resilience Model for Moderating Outcomes Related to Electronic Medical Record Downtime
Walsh, J. M., & Borycki, E. M. (2022) · Studies in health technology and informatics · doi:10.3233/shti210951 · Cited by 4
Self-citationStrategies in Electronic Medical Record Downtime Planning: A Scoping Study.
Walsh, J. M., Borycki, E. M., & Kushniruk, A. W. (2019) · PubMed · Cited by 2
Self-citationUsing Publicly Available Recall and Safety Alert Reports for Learning from Technology-Induced Error
Borycki, E. M., & Kushniruk, A. W. (2022) · Studies in health technology and informatics · doi:10.3233/shti220114 · Cited by 2
Self-citationIsolating the Effects of a Mobile Phone on the Usability and Safety of eHealth Software Applications
Borycki, E. M., Griffith, J., Monkman, H., & Reid‐Haughian, C. (2017) · Studies in health technology and informatics · doi:10.3233/978-1-61499-742-9-37 · Cited by 1
Self-citation
Research works printed but not linked: 9
- Institute of Medicine (US). In: Kohn LT Corrigan JM Donaldson MS, eds. Committee on Quality of Health Care in America. To Err is Human: Building a Safer Health System. Washington, DC: National Academies Press (US); 2000. PMID: 25077248. 25077248
- Patton R. Software testing. 2nd ed.. Carmel, IN: Sams Publishing; 2006.
- Kushniruk A Surich J Borycki E. Detecting and classifying technology-induced error in transmission of healthcare data; 2012. 24th International Conference of the European Federation for Medical Informatics; Pisa, Italy; 26-29 August 2019.
- Young VL Borycki EM Kushniruk AW. On-the-job training of health professionals for electronic health record and electronic medical record use: A scoping review. Knowledge Management and eLearning. 2015; 7(3): 436- 439.
- Borycki EM. Towards a framework for teaching about information technology risk in health care: Simulating threat to health data and patient safety. Knowledge management and eLearning: An international journal. 2015; 7(3): 480- 488.
- Burns LR Bradley EH Weiner BJ. Health care management: Organization design and behaviour. 6th ed. USA: Delmar CENGAGE Learning; 2012.
- Digital Health Canada (Canada’s Health Informatics Association). Health informatics professional core competencies. Toronto, Ontario, Canada: Digital Health Canada; 2012. Available at: https://digitalhealthcanada.com/wp-content/uploads/2019/07/Health-Informatics-Core-Competencies.pdf
- School of Health Information Science. Patient safety and quality in health informatics. Victoria, British Columbia, Canada: 2022. Available at: https://www.uvic.ca
- Digital Health Canada. Digital health Canada professional career matrix. Toronto, Ontario, Canada: Digital Health Canada; 2019.
Cited by
Snowdon, A. W., Hussein, A. A., Danforth, M., Wright, A., & Oakes, R. (2024) · Journal of Medical Internet Research · doi:10.2196/56316 · Cited by 48
Mezei, F., Horváth, K., Pálfi, M., Lovas, K., Ádám, I., & Túri, G. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1197949 · Cited by 44
Digital Maturity as a Strategy for Advancing Patient Experience in US Hospitals
Snowdon, A. W., Hussein, A. A., Olubisi, A., & Wright, A. (2024) · Journal of Patient Experience · doi:10.1177/23743735241228931 · Cited by 28
Binsar, F., Abdurachman, E., Sutoto, S., & Abdurohman, M. (2025) · Leadership in health services · doi:10.1108/lhs-09-2024-0113 · Cited by 24
Co-Creation in the Development of Digital Therapeutics: A Narrative Review
Mimoso, I., Figueiredo, T., Midão, L., Carrilho, J., Henriques, D. V., Alves, S., Duarte, N. S. C., Bessa, M. J., Facal-Mayo, D., Felpete, A., et al. (2024) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph21121589 · Cited by 22
Metadata
- Authors
- Borycki, E. M., & Kushniruk, A. W.
- Affiliations
- University of Victoria (CA)
- Corresponding author
- Borycki, Elizabeth M.
- Venue
- Healthcare Management Forum
- Publisher
- SAGE Publications
- Published
- 2022-12-23
- Volume
- 36
- Issue
- 2
- Pages
- 79-85
- ISSN
- 0840-4704 (ISSN-L)
- 2352-3883
- PMC
- PMC9975897
- OpenAlex
- W4312113792
- Cited by
- 23
- References
- 51
- Citations by year
- 2026: 7 · 2025: 7 · 2024: 8 · 2023: 1
- FWCI
- 3.00
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Healthcare Management Forum (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- UVic’s Research and Learning Repository (University of Victoria) (submittedVersion)
- Funders
- Natural Sciences and Engineering Research Council of Canada
- Michael Smith Health Research BC (Health Professional Investigator Award)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Patient Safety and Medication Errors
- Keywords
- learning health systems, health technology, quality of care, patient safety, technology-induced errors, error propagation, digital health ecosystem, health informatics, evidence-based practice, process automation, health data collection
- MeSH terms
- Learning Health System, Delivery of Health Care, Humans, Medical Informatics, Ecosystem, Biomedical Technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
