The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Exceptional Paper—Probability Encoding in Decision Analysis
Abstract
This paper presents the present philosophy and practice used in probability encoding by the Decision Analysis Group at Stanford Research Institute. Probability encoding, the process of extracting and quantifying individual judgment about uncertain quantities, is one of the major functions required in the performance of decision analysis. The paper discusses the setting of the encoding process, including the use of sensitivity analyses to identify crucial state variables for which extensive encoding procedures are appropriate. The importance of balancing modeling and encoding techniques is emphasized and examples of biases and unconscious modes of judgment are reviewed. A variety of encoding methods are presented and their applicability is discussed. The authors recommend and describe a structured interview process that utilizes a trained interviewer and a number of techniques designed to reduce biases and aid in the quantification of judgment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
Availability: A heuristic for judging frequency and probability
Tversky, A., & Kahneman, D. (1973) · Cognitive Psychology · doi:10.1016/0010-0285(73)90033-9 · Cited by 9,984
On the psychology of prediction.
Kahneman, D., & Tversky, A. (1973) · Psychological Review · doi:10.1037/h0034747 · Cited by 6,202
Subjective probability: A judgment of representativeness
Kahneman, D., & Tversky, A. (1972) · Cognitive Psychology · doi:10.1016/0010-0285(72)90016-3 · Cited by 4,851
Man as an intuitive statistician.
Peterson, C. R., & Beach, L. R. (1967) · Psychological Bulletin · doi:10.1037/h0024722 · Cited by 963
The Foundations of Decision Analysis
Howard, R. A. (1968) · IEEE Transactions on Systems Science and Cybernetics · doi:10.1109/tssc.1968.300115 · Cited by 377
Rapoport, A., & Wallsten, T. S. (1972) · Annual Review of Psychology · doi:10.1146/annurev.ps.23.020172.001023 · Cited by 252
Experiments in the laboratory and the real world
Winkler, R. L., & Murphy, A. H. (1973) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(73)90017-2 · Cited by 163
The Decision to Seed Hurricanes
Howard, R. A., Matheson, J. E., & North, D. (1972) · Science · doi:10.1126/science.176.4040.1191 · Cited by 156
Subjective Probability and Its Measurement
Hampton, J. M., Moore, P. G., & Thomas, H. (1973) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2344419 · Cited by 129
Cited by
Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment.
Tversky, A., & Kahneman, D. (1983) · Psychological Review · doi:10.1037/0033-295x.90.4.293 · Cited by 3,991
Heuristics and Biases: The Psychology of Intuitive Judgment
Bottom, W. P., Gilovich, T., Griffin, D., & Kahneman, D. (2004) · The Academy of Management Review · doi:10.2307/20159081 · Cited by 3,536
Representativeness revisited: Attribute substitution in intuitive judgment.
Kahneman, D., & Frederick, S. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.004 · Cited by 3,476
Norm theory: Comparing reality to its alternatives.
Kahneman, D., & Miller, D. T. (1986) · Psychological Review · doi:10.1037/0033-295x.93.2.136 · Cited by 3,024
Slovic, P., Finucane, M., Peters, E., & MacGregor, D. G. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.025 · Cited by 2,349
“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298
Heuristics and Biases: The Psychology of Intuitive Judgment
(2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098 · Cited by 2,192
The weighing of evidence and the determinants of confidence
Griffin, D., & Tversky, A. (1992) · Cognitive Psychology · doi:10.1016/0010-0285(92)90013-r · Cited by 1,841
Recent developments in modeling preferences: Uncertainty and ambiguity
Camerer, C., & Weber, M. (1992) · Journal of Risk and Uncertainty · doi:10.1007/bf00122575 · Cited by 1,795
A Tutorial on Learning with Bayesian Networks
Heckerman, D. (2008) · Studies in Computational Intelligence · doi:10.1007/978-3-540-85066-3_3 · Cited by 1,693
The Hot Hand in Basketball: On the Misperception of Random Sequences
Gilovich, T., Vallone, R., & Tversky, A. (1985) · Cognitive Psychology · doi:10.1016/0010-0285(85)90010-6 · Cited by 1,649
A Tutorial on Learning with Bayesian Networks
Heckerman, D. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_11 · Cited by 1,220
Uncertainty in the environmental modelling process – A framework and guidance
Refsgaard, J. C., van der Sluijs, J. P., Højberg, A. L., & Vanrolleghem, P. A. (2007) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2007.02.004 · Cited by 1,197
Support theory: a nonextensional representation of subjective probability
Tversky, A., & Koehler, D. J. (1994) · Psychological Review · doi:10.1037/0033-295x.101.4.547 · Cited by 1,167
The use of statistical heuristics in everyday inductive reasoning.
Nisbett, R. E., Krantz, D. H., Jepson, C., & Kunda, Z. (1983) · Psychological Review · doi:10.1037/0033-295x.90.4.339 · Cited by 811
Uncertainties in risk analysis: Six levels of treatment
Paté-Cornell, M. E. (1996) · Reliability Engineering & System Safety · doi:10.1016/s0951-8320(96)00067-1 · Cited by 811
Statistical Methods for Eliciting Probability Distributions
Garthwaite, P. H., Kadane, J. B., & O'Hagan, A. (2005) · Journal of the American Statistical Association · doi:10.1198/016214505000000105 · Cited by 801
Dunning, D., Meyerowitz, J. A., & Holzberg, A. D. (1989) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.57.6.1082 · Cited by 758
Use (and abuse) of expert elicitation in support of decision making for public policy
Morgan, M. G. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1319946111 · Cited by 702
Dunning, D., Meyerowitz, J. A., & Holzberg, A. D. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.020 · Cited by 678
Generating Scenario Trees for Multistage Decision Problems
Høyland, K., & Wallace, S. W. (2001) · Management Science · doi:10.1287/mnsc.47.2.295.9834 · Cited by 673
Feature Article—Decision Analysis: An Overview
Keeney, R. L. (1982) · Operations Research · doi:10.1287/opre.30.5.803 · Cited by 672
Bayesian Networks for Data Mining
Heckerman, D. (1997) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009730122752 · Cited by 630
The Concept of Probability in Safety Assessments of Technological Systems
Apostolakis, G. (1990) · Science · doi:10.1126/science.2255906 · Cited by 629
Forecasting and Planning: An Evaluation
Hogarth, R. M., & Makridakis, S. (1981) · Management Science · doi:10.1287/mnsc.27.2.115 · Cited by 608
Cognitive and Motivational Biases in Decision and Risk Analysis
Montibeller, G., & von Winterfeldt, D. (2015) · Risk Analysis · doi:10.1111/risa.12360 · Cited by 578
Calibration and probability judgements: Conceptual and methodological issues
Keren, G. (1991) · Acta Psychologica · doi:10.1016/0001-6918(91)90036-y · Cited by 549
Overconfidence in Interval Estimates.
Soll, J. B., & Klayman, J. (2004) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.30.2.299 · Cited by 493
Cognitive Processes and the Assessment of Subjective Probability Distributions
Hogarth, R. M. (1975) · Journal of the American Statistical Association · doi:10.1080/01621459.1975.10479858 · Cited by 479
Unpacking, repacking, and anchoring: Advances in support theory.
Rottenstreich, Y., & Tversky, A. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.406 · Cited by 425
Incorporating the Irrelevant: Anchors in Judgments of Belief and Value
Chapman, G. B., & Johnson, E. J. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.008 · Cited by 410
Sloman, S. A. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.024 · Cited by 395
Sherman, S. J., Cialdini, R. B., Schwartzman, D. F., & Reynolds, K. D. (1985) · Personality and Social Psychology Bulletin · doi:10.1177/0146167285111011 · Cited by 382
Modeling uncertainty in multi-criteria decision analysis
Durbach, I. N., & Stewart, T. J. (2012) · European Journal of Operational Research · doi:10.1016/j.ejor.2012.04.038 · Cited by 378
Uncertainty Modeling and Analysis in Engineering and the Sciences
Ayyub, B. M., & Klir, G. J. (2006) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420011456 · Cited by 371
Decision theory in expert systems and artificial intelligence
Horvitz, E. J., Breese, J. S., & Henrion, M. (1988) · International Journal of Approximate Reasoning · doi:10.1016/0888-613x(88)90120-x · Cited by 362
Subjective Judgments by Climate Experts
MORGAN, M. G., & KEITH, D. W. (1995) · Environmental Science & Technology · doi:10.1021/es00010a753 · Cited by 357
Chapman, R. J. (2001) · International Journal of Project Management · doi:10.1016/s0263-7863(99)00070-8 · Cited by 352
SOURCES OF BIAS IN ASSESSMENT PROCEDURES FOR UTILITY FUNCTIONS
Hershey, J. C., Kunreuther, H. C., & Schoemaker, P. J. H. (1988) · Decision Making · doi:10.1017/cbo9780511598951.021 · Cited by 340
Assessing uncertainty in physical constants
Henrion, M., & Fischhoff, B. (1986) · American Journal of Physics · doi:10.1119/1.14447 · Cited by 316
Introduction – Heuristics and Biases: Then and Now
Gilovich, T., & Griffin, D. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.002 · Cited by 305
Interactive Elicitation of Opinion for a Normal Linear Model
Kadane, J. B., Dickey, J. M., Winkler, R. L., Smith, W. S., & Peters, S. C. (1980) · Journal of the American Statistical Association · doi:10.1080/01621459.1980.10477562 · Cited by 294
A causal mapping approach to constructing Bayesian networks
Nadkarni, S., & Shenoy, P. P. (2004) · Decision Support Systems · doi:10.1016/s0167-9236(03)00095-2 · Cited by 293
Norm Theory: Comparing Reality to Its Alternatives
Kahneman, D., & Miller, D. T. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.022 · Cited by 289
Choy, S. L., O'Leary, R., & Mengersen, K. (2009) · Ecology · doi:10.1890/07-1886.1 · Cited by 283
The use of expert elicitation in environmental health impact assessment: a seven step procedure
Knol, A. B., Slottje, P., van der Sluijs, J. P., & Lebret, E. (2010) · Environmental Health · doi:10.1186/1476-069x-9-19 · Cited by 277
Fox, C. R., & Clemen, R. T. (2005) · Management Science · doi:10.1287/mnsc.1050.0409 · Cited by 255
Mental Contamination and the Debiasing Problem
Wilson, T. D., Centerbar, D. B., & Brekke, N. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.012 · Cited by 160
The calibration of expert judgment: heuristics and biases beyond the laboratory
Koehler, D. J., Brenner, L., & Griffin, D. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.041 · Cited by 146
Metadata
- Authors
- Spetzler, C. S., & Staël Von Holstein, C.-A. S.
- Venue
- Management Science
- Published
- 1975-11
- Volume
- 22
- Issue
- 3
- Pages
- 340-358
- ISSN
- 0025-1909 (ISSN-L)
- 1526-5501
- OpenAlex
- W2063760437
- Cited by
- 662
- References
- 11
- FWCI
- 8.13
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.