The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
A Systematic Review and Meta-Analysis of Direct Objective Measures of Situation Awareness: A Comparison of SAGAT and SPAM
Abstract
Objective: To examine evidence of sensitivity, predictiveness, and methodological concerns regarding direct, objective measures of situation awareness (SA). Background: The ability to objectively measure SA is important to the evaluation of user interfaces and displays, training programs, and automation initiatives, as well as for studies that seek to better understand SA in both individuals and teams. A number of methodological criticisms have been raised creating significant confusion in the research field. Method: A meta-analysis of 243 studies was conducted to examine evidence of sensitivity and predictiveness, and to address methodological questions regarding Situation Awareness Global Assessment Technique (SAGAT), Situation Present Assessment Technique (SPAM), and their variants. Results: SAGAT and SPAM were found to be equally predictive of performance. SPAM (64%) and real-time probes (73%) were found to have significantly lower sensitivity in comparison to SAGAT (94%). While SAGAT was found not to be overly memory reliant nor intrusive into operator performance, SPAM resulted in problems with intrusiveness in 40% of the studies examined, as well as problems with speed-accuracy tradeoffs, sampling bias, and confounds with workload. Concerns about memory reliance, the utility of these measures for assessing Team SA, and other issues are also addressed. Conclusion: SAGAT was found to be a highly sensitive, reliable, and predictive measure of SA that is useful across a wide variety of domains and experimental settings. Application: Direct, objective SA measurement provides useful and diagnostic insights for research and design in a wide variety of domains and study objectives.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Telling more than we can know: Verbal reports on mental processes.
Nisbett, R. E., & Wilson, T. D. (1977) · Psychological Review · doi:10.1037/0033-295x.84.3.231 · Cited by 11,317 · cited 1×
“By assessing SA at different points in time, SAGAT avoids the problem of relying on memory of events after the scenario is completed (Nisbett & Wilson, 1977).”
BackgroundThe New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
Measurement of Situation Awareness in Dynamic Systems
Endsley, M. R. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049499 · Cited by 2,039
Self-citationA controlled-attention view of working-memory capacity.
Kane, M. J., Bleckley, M. K., Conway, A. R. A., & Engle, R. W. (2001) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.130.2.169 · Cited by 1,414
The mechanisms of working memory capacity: Primary memory, secondary memory, and attention control
Shipstead, Z., Lindsey, D. R. B., Marshall, R. L., & Engle, R. W. (2014) · Journal of Memory and Language · doi:10.1016/j.jml.2014.01.004 · Cited by 330 · cited 2×
“…(the ability to hold information in memory), attentional control, and the ability to recall information from secondary memory have been shown to be separate aspects of cognition that all contribute to Operation Span—a measure of complex working memory (Shipstead, Lindsey, Marshall, & Engle, 2014).”
BackgroundSituation awareness during driving: Explicit and implicit knowledge in dynamic spatial memory.
Gugerty, L. J. (1997) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.3.1.42 · Cited by 227 · cited 1×
“…in Level 3 SA questions. e 22 145 Month XXXX - Human Factors Additional concerns have been raised over whether SA queries, which tap into operator’s explicit awareness, are in some way unreflective of implicit awareness (de Winter et al., 2019; Gugerty, 1997; Lo, Sehic, Brookhuis, & Meijer, 2016).”
Background
Cited by
Supporting Human-AI Teams:Transparency, explainability, and situation awareness
Endsley, M. R. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107574 · Cited by 309
Self-citationSocial media trust: Fighting misinformation in the time of crisis
Shahbazi, M., & Bunker, D. (2024) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2024.102780 · Cited by 126
Colceriu, C., Theis, S., Brell-Cokcan, S., & Nitsch, V. (2023) · i-com · doi:10.1515/icom-2023-0016 · Cited by 9
Metadata
- Authors
- Endsley, M. R.
- Venue
- Human Factors: The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 2019-09-27
- Volume
- 63
- Issue
- 1
- Pages
- 124-150
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W2977055143
- Cited by
- 246
- References
- 6
- FWCI
- 2.95
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Systematic Review and Meta-Analysis of Direct Objective Measures of Situation Awareness: A Comparison of SAGAT and SPAM. https://app.cochat.ai/papers/10.1177/0018720819875376
- The paper
- Endsley, M. R. (2021). A Systematic Review and Meta-Analysis of Direct Objective Measures of Situation Awareness: A Comparison of SAGAT and SPAM. Human Factors: The Journal of the Human Factors and Ergonomics Society. https://doi.org/10.1177/0018720819875376
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.