Toward a better understanding of task demands, workload, and performance during physician-computer interactions.
Open accessThe DOI matches its Crossref record; 70 of the 71 references it cites were found in a registry or an index.
Abstract
Objective To assess the relationship between (1) task demands and workload, (2) task demands and performance, and (3) workload and performance, all during physician-computer interactions in a simulated environment. Methods Two experiments were performed in 2 different electronic medical record (EMR) environments: WebCIS ( n = 12) and Epic ( n = 17). Each participant was instructed to complete a set of prespecified tasks on 3 routine clinical EMR-based scenarios: urinary tract infection (UTI), pneumonia (PN), and heart failure (HF). Task demands were quantified using behavioral responses (click and time analysis). At the end of each scenario, subjective workload was measured using the NASA-Task-Load Index (NASA-TLX). Physiological workload was measured using pupillary dilation and electroencephalography (EEG) data collected throughout the scenarios. Performance was quantified based on the maximum severity of omission errors. Results Data analysis indicated that the PN and HF scenarios were significantly more demanding than the UTI scenario for participants using WebCIS ( P < .01), and that the PN scenario was significantly more demanding than the UTI and HF scenarios for participants using Epic ( P < .01). In both experiments, the regression analysis indicated a significant relationship only between task demands and performance ( P < .01). Discussion Results suggest that task demands as experienced by participants are related to participants' performance. Future work may support the notion that task demands could be used as a quality metric that is likely representative of performance, and perhaps patient outcomes. Conclusion The present study is a reasonable next step in a systematic assessment of how task demands and workload are related to performance in EMR-evolving environments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The NASA–Task Load Index (NASA-TLX) is a widely applied and valid tool used to measure workload,29,30,31,32,33,34 including the following 6 dimensions:”
From Association of the Usability of Electronic Health Records With Cognitive Workload and Performance Levels Among Physicians (2019) · cites this paper as [31]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
(2001) · doi:10.1017/cbo9780511546396 · Cited by 4,482
Chaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S. C., & Shekelle, P. G. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-10-200605160-00125 · Cited by 3,159
Independent Component Analysis of Electroencephalographic Data
Makeig, S., Bell, A. J., Jung, T., & B, T. J. S. A. (1995) · neural information processing systems · Cited by 2,476
Bates, D. W. (1998) · JAMA · doi:10.1001/jama.280.15.1311 · Cited by 2,107
Task-evoked pupillary responses, processing load, and the structure of processing resources.
Beatty, J. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.91.2.276 · Cited by 1,959
Ash, J. S. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1471 · Cited by 1,789
Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work
Vicente, K. J. (1999) · Cited by 1,686
Gevins, A. (1997) · Cerebral Cortex · doi:10.1093/cercor/7.4.374 · Cited by 1,623
Cycle-octave and related transforms in seismic signal analysis
Goupillaud, P., Grossmann, A., & Morlet, J. (1984) · Geoexploration · doi:10.1016/0016-7142(84)90025-5 · Cited by 1,504
Research works printed but not linked: 3
- Warden, 2011, Health IT and Patient Safety: Builder Safer Systems for Better Care
- Hart, NASA-TLX Load Index (NASA-TLX); 20 years later, 50th Annual Proceedings of the Human Factors and Ergonomics Society Meeting, Santa Monica, CA, 2006, 904
- Tremoulet, 2006, Augmented cognition for tactical tomahawk weapons control system operators, 313
Cited by
What Clinicians Want: Contextualizing Explainable Machine Learning for Clinical End Use
Tonekaboni, S., Joshi, S., McCradden, M. D., & Goldenberg, A. (2019) · arXiv · doi:10.48550/arxiv.1905.05134 · Cited by 318
The Validity of Physiological Measures to Identify Differences in Intrinsic Cognitive Load
Ayres, P., Lee, J. Y., Paas, F., & van Merriënboer, J. J. G. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.702538 · Cited by 222
Mazur, L. M., Mosaly, P. R., Moore, C., & Marks, L. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.1709 · Cited by 127
Self-citationAssociation of electronic health record use with physician fatigue and efficiency
Khairat, S., Coleman, C., Ottmar, P., Jayachander, D. I., Bice, T., & Carson, S. S. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.7385 · Cited by 118
Health Information Technology in Healthcare Quality and Patient Safety: Literature Review
Feldman, S. S., Buchalter, S. E., & Hayes, L. (2018) · JMIR Medical Informatics · doi:10.2196/10264 · Cited by 85
Metadata
- Authors
- Mazur, L. M., Mosaly, P. R., Moore, C., Comitz, E., Yu, F., Falchook, A. D., Eblan, M. J., Hoyle, L. M., Tracton, G., Chera, B. S., & Marks, L. B.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-03-28
- Volume
- 23
- Issue
- 6
- Pages
- 1113-1120
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7784278
- OpenAlex
- W2334858943
- Cited by
- 45
- References
- 71
- Citations by year
- 2025: 2 · 2024: 4 · 2023: 2 · 2022: 7 · 2021: 5 · 2020: 9 · 2019: 7 · 2018: 4 · 2017: 3 · 2016: 2
- FWCI
- 9.08
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Carolina Digital Repository (University of North Carolina at Chapel Hill) (submittedVersion)
- HighWire Press Open Archive (submittedVersion)
- UNC Libraries
- Funders
- Johns Hopkins University
- Agency for Healthcare Research and Quality (R18HS023458, R21 HS024062)
- Sidney Kimmel Comprehensive Cancer Center
- Sidney Kimmel Center for Prostate and Urologic Cancers
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- task demands, workload, physician performance, electronic health records, NASA-TLX, pupil dilation, EEG, omission errors, clinical decision support, simulated clinical scenarios, epic, quality metrics
- MeSH terms
- Efficiency, Electroencephalography, Humans, Physicians, Task Performance and Analysis, User-Computer Interface, Workload, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Toward a better understanding of task demands, workload, and performance during physician-computer interactions. https://app.cochat.ai/papers/10.1093/jamia/ocw016
- The paper
- Mazur, L. M., Mosaly, P. R., Moore, C., Comitz, E., Yu, F., Falchook, A. D., Eblan, M. J., Hoyle, L. M., Tracton, G., Chera, B. S., & Marks, L. B. (2016). Toward a better understanding of task demands, workload, and performance during physician-computer interactions. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocw016
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.