The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Critical decision method for eliciting knowledge
Abstract
A critical decision method is described for modeling tasks in naturalistic environments characterized by high time pressure, high information content, and changing conditions. The method is a variant of a J.C. Flanagan's (1954) critical incident technique extended to include probes that elicit aspects of expertise such as the basis for making perceptual discriminations, conceptual discriminations, typicality judgments, and critical cues. The method has been used to elicit domain knowledge from experienced personnel such as urban and wildland fireground commanders, tank platoon leaders, structural engineers, design engineers, paramedics, and computer programmers. A model of decision-making derived from these investigations is presented as the theoretical background to the methodology. Instruments and procedures for implementing the approach are described. Applications of the method include developing expert systems, evaluating expert systems' performance, identifying training requirements, and investigating basic decision research issues.>
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The critical incident technique.
Flanagan, J. C. (1954) · Psychological Bulletin · doi:10.1037/h0061470 · Cited by 8,191
(2007) · Encyclopedia of Industrial and Organizational Psychology · doi:10.4135/9781412952651.n55 · Cited by 5,287
Ericsson (1993) · doi:10.1037/0033-295x.87.3.215 · Cited by 4,539
Norm theory: Comparing reality to its alternatives.
Kahneman, D., & Miller, D. T. (1986) · Psychological Review · doi:10.1037/0033-295x.93.2.136 · Cited by 3,024
"Schema abstraction" in a multiple-trace memory model.
Hintzman, D. L. (1986) · Psychological Review · doi:10.1037//0033-295x.93.4.411 · Cited by 1,926
Hayes-Roth, F. A., WATERMAN, D. A., & Lenat, D. B. (1983) · Andalas University Repository (Andalas University) · Cited by 1,702
Decision Analysis: Introductory Lectures on Choices Under Uncertainty.
Raiffa, H. (1969) · The Statistician · doi:10.2307/2987280 · Cited by 940
Practical intelligence : nature and origins of competence in the everyday world
Sternberg, R. J., & Wagner, R. K. (1986) · Cambridge University Press eBooks · Cited by 708
Nonanalytic Cognition: Memory, Perception, and Concept Learning
Jacoby, L. L., & Brooks, L. R. (1984) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60358-8 · Cited by 441
Rapid Decision Making on the Fire Ground
Klein, G. A., Calderwood, R., & Clinton-Cirocco, A. (1986) · Proceedings of the Human Factors Society Annual Meeting · doi:10.1177/154193128603000616 · Cited by 375
Self-citationThe problem of extracting the knowledge of experts
Hoffman, R. R. (1987) · AI Magazine · doi:10.1609/aimag.v8i2.583 · Cited by 338
Geiselman, R. E., Fisher, R. P., MacKinnon, D. P., & Holland, H. L. (1985) · Journal of Applied Psychology · doi:10.1037/0021-9010.70.2.401 · Cited by 304
Geiselman, R. E., Fisher, R. P., MacKinnon, D. P., & Holland, H. L. (1985) · Journal of Applied Psychology · doi:10.1037//0021-9010.70.2.401 · Cited by 254
Measuring the structure of expertise
Schvaneveldt, R. W., Durso, F. T., Goldsmith, T. E., Breen, T. J., Cooke, N. M., Tucker, R. G., & De Maio, J. C. (1985) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(85)80064-x · Cited by 207
A knowledge acquisition program for expert systems based on personal construct psychology
Boose, J. H. (1985) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(85)80055-9 · Cited by 198
Time pressure, training and decision effectiveness
ZAKAY, D., & WOOLER, S. (1984) · Ergonomics · doi:10.1080/00140138408963489 · Cited by 197
The Relative Efficacy of Intuitive and Analytical Cognition: A Second Direct Comparison
Hammond, K. R., Hamm, R. M., Grassia, J., & Pearson, T. (1984) · Defense Technical Information Center (DTIC) · doi:10.21236/ada142866 · Cited by 24
Distributed Decision Making in Wildland Firefighting
Taynor, J., Klein, G. A., & Thordsen, M. L. (1990) · Defense Technical Information Center (DTIC) · doi:10.21236/ada225413 · Cited by 11
Self-citation
Cited by
Analysis of errors reported by surgeons at three teaching hospitals
Gawande, A. A., Zinner, M. J., Studdert, D. M., & Brennan, T. A. (2003) · Surgery · doi:10.1067/msy.2003.169 · Cited by 1,082
Fletcher, G., Flin, R., McGeorge, P., Glavin, R., Maran, N., & Patey, R. (2003) · British Journal of Anaesthesia · doi:10.1093/bja/aeg112 · Cited by 958
Stimulated recall: a report on its use in naturalistic research
Lyle, J. (2003) · British Educational Research Journal · doi:10.1080/0141192032000137349 · Cited by 774
Taking stock of naturalistic decision making
Lipshitz, R., Klein, G., Orasanu, J., & Salas, E. (2001) · Journal of Behavioral Decision Making · doi:10.1002/bdm.381 · Cited by 761
Self-citationMILITELLO, L. G., & HUTTON, R. J. B. (1998) · Ergonomics · doi:10.1080/001401398186108 · Cited by 581
Metadata
- Authors
- Klein, G. A., Calderwood, R., & MacGregor, D.
- Venue
- IEEE Transactions on Systems, Man, and Cybernetics
- Published
- 1989
- Volume
- 19
- Issue
- 3
- Pages
- 462-472
- ISSN
- 0018-9472 (ISSN-L)
- OpenAlex
- W2080862045
- Cited by
- 1,029
- References
- 18
- FWCI
- 8.60
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.