False Alerts in Air Traffic Control Conflict Alerting System: Is There a “Cry Wolf” Effect?
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Objective: The aim is to establish the extent to which the high false-alarm rate of air traffic control midair conflict alerts is responsible for a “cry wolf” effect—where true alerts are not responded to and all alerts are delayed in their response. Background: Some aircraft collisions have been partly attributed to the cry wolf effect, and in other domains (health care and systems monitoring), there is a causal connection between false-alarm rate and cry wolf behavior. We hypothesized that a corresponding relationship exists in air traffic control (ATC). Method: Aircraft track and alert system behavior data surrounding 495 conflict alerts were analyzed to identify true and false alerts, trajectory type, and controller behavior. Forty-five percent of the alerts were false, ranging from 0.28 to 0.58. Results: Although centers with more false alerts contributed to more nonresponses, there was no evidence that these were nonresponses to true alerts or that response times were delayed in those centers. Instead, controllers showed desirable anticipatory behavior by issuing trajectory changes prior to the alert. Those trajectory pairs whose conflicts were more difficult to visualize induced more reliance on, and less compliance with, the alerting system. Conclusion: The high false-alarm rate does not appear to induce cry wolf behavior in the context of en route ATC conflict alerts. Application: There is no need to substantially modify conflict alert algorithms, but the conflict alert system may be modified to address difficult-to-visualize conflicts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 2×
“In turn, this operator distrust, or disuse, leads to a disregard of (or late response to) some true alarms (Lee & See, 2004; Parasuraman & Riley, 1997).”
BackgroundHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 1×
“In turn, this operator distrust, or disuse, leads to a disregard of (or late response to) some true alarms (Lee & See, 2004; Parasuraman & Riley, 1997).”
BackgroundThe benefits of imperfect diagnostic automation: a synthesis of the literature
Wickens, C. D., & Dixon, S. R. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500370105 · Cited by 423 · cited 2×
“The approach based on d′ asks how low the reliability of an alerting or diagnostic system can get while preserving performance that is superior to that of the unaided human (Wickens & Dixon, 2007; Xu Rantanen & Wickens, 2007).”
BackgroundMethodSelf-citationLawless (1994) · doi:10.1097/00003246-199406000-00017 · Cited by 406
Automation failures on tasks easily performed by operators undermine trust in automated aids
Madhavan, P., Wiegmann, D. A., & Lacson, F. C. (2006) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872006777724408 · Cited by 268
Parasuraman, R. (1987) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088702900609 · Cited by 175 · cited 2×
“A general conclusion from research in this area appears to be that although misses may be catastrophic in a multitask system in which there is no human backup to monitor the raw data in parallel, in systems that allow such parallel human–machine monitoring (Getty et al., 1995; Parasuraman, 1987), FA-prone systems may…”
Background
Cited by
Schaefer, K. E., Chen, J. Y. C., Szalma, J. L., & Hancock, P. A. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816634228 · Cited by 768
Modeling and predicting trust dynamics in human–robot teaming: A Bayesian inference approach
Guo, Y., & Yang, X. J. (2021) · International Journal of Social Robotics · doi:10.1007/s12369-020-00703-3 · Cited by 133
Rayo, M. F., & Moffatt-Bruce, S. D. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2014-003373 · Cited by 115
Yang, X. J., Schemanske, C., & Searle, C. (2023) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208211034716 · Cited by 132
“…Rogers, & Fisk, 2011; Rau, Li, & Li, 2009), system factors such as reliability and level of automation (Du, Huang, & Yang, 2020; Parasuraman, Sheridan, & Wickens, 2000; Wickens & Dixon, 2007; Wickens et al., 2009), and environmental factors such as multi-tasking requirement (Zhang & Yang, 2017).”
Merritt, S. M., Lee, D., Unnerstall, J. L., & Huber, K. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814561675 · Cited by 83
“…false alarms rather than misses, especially in cases when misses are particularly damaging (however, a cry-wolf effect could occur in which users begin to disregard system warnings; Wickens et al., 2009). conclusIon Much attention has been given to the notion of trust calibration in the literature.”
Background
Metadata
- Authors
- Wickens, C. D., Rice, S., Keller, D., Hutchins, S., Hughes, J., & Clayton, K.
- Venue
- Human Factors: The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 2009-08
- Volume
- 51
- Issue
- 4
- Pages
- 446-462
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W2133394319
- Cited by
- 113
- References
- 6
- FWCI
- 8.85
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: False Alerts in Air Traffic Control Conflict Alerting System: Is There a “Cry Wolf” Effect? https://app.cochat.ai/papers/10.1177/0018720809344720
- The paper
- Wickens, C. D., Rice, S., Keller, D., Hutchins, S., Hughes, J., & Clayton, K. (2009). False Alerts in Air Traffic Control Conflict Alerting System: Is There a “Cry Wolf” Effect? Human Factors: The Journal of the Human Factors and Ergonomics Society. https://doi.org/10.1177/0018720809344720
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.