Quantifying the impact of health IT implementations on clinical workflow: a new methodological perspective
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Health IT implementations often introduce radical changes to clinical work processes and workflow. Prior research investigating this effect has shown conflicting results. Recent time and motion studies have consistently found that this impact is negligible; whereas qualitative studies have repeatedly revealed negative end-user perceptions suggesting decreased efficiency and disrupted workflow. We speculate that this discrepancy may be due in part to the design of the time and motion studies, which is focused on measuring clinicians' 'time expenditures' among different clinical activities rather than inspecting clinical 'workflow' from the true 'flow of the work' perspective. In this paper, we present a set of new analytical methods consisting of workflow fragmentation assessments, pattern recognition, and data visualization, which are accordingly designed to uncover hidden regularities embedded in the flow of the work. Through an empirical study, we demonstrate the potential value of these new methods in enriching workflow analysis in clinical settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bates, D. W. (1998) · JAMA · doi:10.1001/jama.280.15.1311 · Cited by 2,107
Computer-supported cooperative work: history and focus
Grudin, J. (1994) · Computer · doi:10.1109/2.291294 · Cited by 1,639
Types of Unintended Consequences Related to Computerized Provider Order Entry
Campbell, E. M., Sittig, D. F., Ash, J. S., Guappone, K. P., & Dykstra, R. H. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2042 · Cited by 823
Chesler, E. J., Lu, L., Shou, S., Qu, Y., Gu, J., Wang, J., Hsu, H. C., Mountz, J. D., Baldwin, N. E., Langston, M. A., et al. (2005) · Nature Genetics · doi:10.1038/ng1518 · Cited by 719
Overhage, J. M., Perkins, S., Tierney, W. M., & McDonald, C. J. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080361 · Cited by 232
Computerized Provider Order Entry Adoption: Implications for Clinical Workflow
Campbell, E. M., Guappone, K. P., Sittig, D. F., Dykstra, R. H., & Ash, J. S. (2009) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0857-9 · Cited by 139 · cited 1×
“Qualitative studies investigating HIT-related ‘unintended consequences’ have amply demonstrated that disruption to established work processes and workflow introduced by HIT adoption is a principal cause of these suboptimal or adverse outcomes.”
BackgroundAn Interface-driven Analysis of User Interactions with an Electronic Health Records System
Zheng, K., Padman, R., Johnson, M. P., & Diamond, H. S. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2852 · Cited by 122
Self-citationGuss, D. A., Chan, T. C., & Killeen, J. P. (2008) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2007.03.010 · Cited by 69
Ali, N. A., Mekhjian, H. S., Kuehn, P. L., Bentley, T. D., Kumar, R., Ferketich, A. K., & Hoffmann, S. P. (2005) · Critical Care Medicine · doi:10.1097/01.ccm.0000150266.58668.f9 · Cited by 66
Cited by
Review of health information technology usability study methodologies
Yen, P.-Y., & Bakken, S. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2010-000020 · Cited by 390
Moy, A. J., Schwartz, J. M., Chen, R., Sadri, S., Lucas, E., Cato, K. D., & Rossetti, S. C. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa325 · Cited by 284
“In addition to concerns regarding the generalizability of TM studies, prior research has identified widespread methodological inconsistencies in their design and conduct as well as in their quantitative analyses and reporting of results, making it difficult to synthesize findings across studies.(70,86) Readily accessi…”
ResultHermes, E. D., Lyon, A. R., Schueller, S. M., & Glass, J. E. (2019) · Journal of Medical Internet Research · doi:10.2196/11752 · Cited by 149
“Assessing the existing health information technology infrastructure, workflow, and use, as well as the potential interoperability of the BIT at a site, are key factors later in the process [45,46].”
Zheng, K., Ratwani, R. M., & Adler-Milstein, J. (2020) · Annals of Internal Medicine · doi:10.7326/m19-0871 · Cited by 105
“In time–motion studies, independent human observers shadow clinician subjects for a continuous period to record how they perform their clinical tasks (what, when, where, how, and for how long) (20).”
BackgroundInfluentialSelf-citationTime requirements for electronic health record use in an academic ophthalmology center
Read-Brown, S., Hribar, M. R., Reznick, L. G., Lombardi, L. H., Parikh, M., Chamberlain, W. D., Bailey, S. T., Wallace, J. B., Yackel, T. R., & Chiang, M. F. (2017) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2017.4187 · Cited by 85
Metadata
- Authors
- Zheng, K., Haftel, H. M., Hirschl, R. B., O'Reilly, M., & Hanauer, D. A.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2010-07
- Volume
- 17
- Issue
- 4
- Pages
- 454-461
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2145678224
- Cited by
- 176
- References
- 9
- FWCI
- 21.84
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Quantifying the impact of health IT implementations on clinical workflow: a new methodological perspective. https://app.cochat.ai/papers/10.1136/jamia.2010.004440
- The paper
- Zheng, K., Haftel, H. M., Hirschl, R. B., O'Reilly, M., & Hanauer, D. A. (2010). Quantifying the impact of health IT implementations on clinical workflow: a new methodological perspective. Journal of the American Medical Informatics Association. https://doi.org/10.1136/jamia.2010.004440
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.