The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Characterizing a Naturalistic Decision-Making Phenomenon: Loss of System Resilience Associated With Implementation of New Technology
Open accessAbstract
We describe a phenomenon viewed through the conceptual lens of a naturalistic decision-making perspective: a loss of system resilience, due to increased difficulty in performing macrocognition functions, associated with the implementation of new information technology. Examples of the phenomenon collected in a targeted literature review are characterized by stakeholder groups, technology, typical changes in workflow before and after implementation, and potential impacts on macrocognition and patient outcomes for four clinical care environments. The loss of system resilience is due to increased difficulty in performing macrocognition functions: (a) sensemaking due to less effective cognitive warm-up and collaborative framing strategies, (b) detecting events due to missing trends in data and changes to orders, and (c) coordinating due to less clinical knowledge during scheduling and updating information and less effective cross-checks. Potential impacts to patient safety include an increase in unnecessary care, missed care, delays in diagnoses and treatment, redundant care, inaccurate diagnoses, medication errors, and adverse events. We recommended future conceptually driven research in other complex, sociotechnical settings in order to develop useful metrics and reduce the risk of incurring undesirable and unnecessary impacts on cognitive work associated with new technology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Organizational psychologists emphasize the importance of macrocognition: that is, reflecting collectively and continuously about how the organization is responding to change, including ongoing sense making, detecting critical events, and coordinating adaptive actions [118,119].”
From Beyond Adoption: A New Framework for Theorizing and Evaluating Nonadoption, Abandonment, and Challenges to the Scale-Up, Spread, and Sustainability of Health and Care Technologies (2017) · cites this paper as [118]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Introduction of new health care information technology systems can lead to loss of system resilience, since new technologies intended to automate work and assure safety may have the unintended effect of reducing time for collaborative dialogue, masking key trends in data (perhaps through information overload and loss of overview), making work routines brittle, and bypassing clinical judgment [118,”
The cited source says what the claim attributes to it.
In the citing paper
“Question 7B concerns organizational resilience, and particularly what May and Finch called “reflexive monitoring” [27] and Patterson et al called the “macrocognitive functions” of sense making, including in particular the ability to detect critical events or issues and respond to these through coordinated action [118].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Resilience Engineering: Concepts and Precepts
Wears, R. L. (2006) · Quality and Safety in Health Care · doi:10.1136/qshc.2006.018390 · Cited by 2,900
Klein, G. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288385 · Cited by 2,231 · cited 1×
“In naturalistic decision making (NDM), the theoretical perspectives have emphasized how expert practitioners perform cognitively complex functions in demanding, real-world situations characterized by uncertainty, high stakes, and team and organizational constraints (Klein, 2008).”
BackgroundRole of Computerized Physician Order Entry Systems in Facilitating Medication Errors
Koppel, R. (2005) · JAMA · doi:10.1001/jama.293.10.1197 · Cited by 2,126
Vicente, K. J. (1999) · CRC Press eBooks · doi:10.1201/b12457 · Cited by 1,389
Goldzweig, C. L., Orshansky, G., Paige, N. M., Towfigh, A. A., Haggstrom, D. A., Miake-Lye, I., Beroes, J. M., & Shekelle, P. G. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-159-10-201311190-00006 · Cited by 468 · cited 1×
“Increasingly, patients request or are asked to schedule their visits directly via patient portals (Hogan, Wakefield, Nazi, Houston, & Weaver, 2011; Goldzweig et al., 2013).”
BackgroundPatterson, E. S., Cook, R. I., & Render, M. L. (2002) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1061 · Cited by 370 · cited 2×
“…and others have documented negative unintended consequences to patient safety from the introduction of electronic medication administration (e-MAR; Patterson et al., 2002) for nurses and electronic health records (EHRs) for physicians (Koppel et al., 2005) and nurses (Gephart, Carrington, &…”
BackgroundSelf-citationHenriksen, K., Battles, J. B., Keyes, M. A., & Grady, M. L. (2008) · Cited by 340
Horwitz, L. I., Meredith, T., Schuur, J. D., Shah, N. R., Kulkarni, R. G., & Jenq, G. Y. (2009) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2008.05.007 · Cited by 304 · cited 1×
“They are conducted as needed and might include a review of some patients’ written or audiotaped information captured on forms, faxes, and voicemail (Horwitz et al., 2009) during the early portion of a shift period.”
BackgroundFactors Affecting Physician Professional Satisfaction
Friedberg, M., Van Busum, K., Chen, P., Aunon, F., Pham, C., Caloyeras, J., Mattke, S., Pitchforth, E., Quigley, D., Brook, R., et al. (2013) · RAND Corporation eBooks · doi:10.7249/rb9740 · Cited by 216 · cited 1×
“Without the time to adequately review historical data, inaccurate diagnoses, delays in diagnosis, and delays in treatment are more likely to occur (Friedberg et al., 2013).”
BackgroundSingh, H., Thomas, E. J., Mani, S., Sittig, D., Arora, H., Espadas, D., Khan, M. M., & Petersen, L. A. (2009) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.263 · Cited by 212 · cited 1×
“One study showed that when it is known that alerts are sent to more than one health care provider, they are less frequently viewed (Singh et al., 2009).”
Background
Research works printed but not linked: 3
- Collins S. A., 2012, Nurs In-form, 2012, 93
- Hunter K., 2011, Online Journal of Nursing Informatics, 15
- Miller R. H., 2004, Journal of Healthcare Information Management, 18, 72
Cited by
Greenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A'Court, C., Hinder, S., Fahy, N., Procter, R., & Shaw, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8775 · Cited by 2,887
“Introduction of new health care information technology systems can lead to loss of system resilience, since new technologies intended to automate work and assure safety may have the unintended effect of reducing time for collaborative dialogue, masking key trends in data (perhaps through information overload and loss…”
Making sense out of uncertainty: cognitive strategies in the child custody decision-making process
Mendes, J. A. D. A., & Ormerod, T. C. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1387549 · Cited by 14
Test results management and distributed cognition in electronic health record–enabled primary care
Smith, M. W., Hughes, A. M., Brown, C. R., Russo, E. M., Giardina, T. D., Mehta, P., & Singh, H. (2018) · Health Informatics Journal · doi:10.1177/1460458218779114 · Cited by 14
Neville, K., Pires, B., Madhavan, P., Booth, M., Rosfjord, K., & Patterson, E. S. (2022) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181322661177 · Cited by 13
“As a result, the technology is introduced, and the host work system bears the burden of coping with its limitations; limitations that can include para-lyzing forms of dark debt (e.g., Aaronson et al., 2021; Finkel-stein & Dowell, 1996; Patterson et al., 2016; Sherwood et al., 2020).”
BackgroundSelf-citationUncertainty in Child Custody Cases After Parental Separation: Context and Decision-Making Process
Mendes, J. A. D. A., & Ormerod, T. C. (2023) · Trends in Psychology · doi:10.1007/s43076-022-00253-9 · Cited by 13
“This approach highlights “how expert practitioners perform cognitively complex functions in demanding, real-world situations characterized by uncertainty, high stakes, and team and organizational constraints” (Patterson et al., 2016, p. 229).”
Metadata
- Authors
- Patterson, E. S., Militello, L. G., Su, G., & Sarkar, U.
- Affiliations
- University of California, San Francisco (US)
- Corresponding author
- Patterson, Emily S.
- Venue
- Journal of Cognitive Engineering and Decision Making
- Publisher
- SAGE Publications
- Published
- 2016-07-08
- Volume
- 10
- Issue
- 3
- Pages
- 229-243
- ISSN
- 1555-3434 (ISSN-L)
- PMC
- PMC5271605
- OpenAlex
- W2441218777
- Cited by
- 20
- References
- 31
- Citations by year
- 2026: 3 · 2025: 1 · 2024: 2 · 2023: 1 · 2022: 5 · 2021: 1 · 2019: 2 · 2018: 2 · 2017: 1 · 2016: 2
- FWCI
- 4.03
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Journal of Cognitive Engineering and Decision Making (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Funders
- Agency for Healthcare Research and Quality (P30HS023558)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Patient Safety and Medication Errors
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- naturalistic decision making, macrocognition, system resilience, information technology implementation, clinical workflow, sensemaking, event detection, coordination, patient safety, medication errors, adverse events, unnecessary care, missed nursing care, clinical knowledge, cross-checking, socio-technical systems, health technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Characterizing a Naturalistic Decision-Making Phenomenon: Loss of System Resilience Associated With Implementation of New Technology. https://app.cochat.ai/papers/10.1177/1555343416652524
- The paper
- Patterson, E. S., Militello, L. G., Su, G., & Sarkar, U. (2016). Characterizing a Naturalistic Decision-Making Phenomenon: Loss of System Resilience Associated With Implementation of New Technology. Journal of Cognitive Engineering and Decision Making. https://doi.org/10.1177/1555343416652524
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.