The effects of asymmetry among advisors on the aggregation of their opinions
The DOI matches its Crossref record; 55 of the 57 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“judgments are often made based on some weighted average of the opinions of experts (Budescu, Rantilla, Yu, and Karelitz, 2003), which suggests that portrayals of consensus uncertainty could affect judgments by influencing the perceived average of expert opinion.”
From A review of the effects of uncertainty in public science communication (2020) · cites this paper as Budescu, Rantilla, Yu, and Karelitz, 2003
Citations
Cites
Payne, J. W., Bettman, J. R., & Johnson, E. J. (1993) · doi:10.1017/cbo9781139173933 · Cited by 3,487
Leave, C. (1994) · Journal of the Operational Research Society · doi:10.1057/jors.1994.133 · Cited by 3,309
Combining forecasts: A review and annotated bibliography
Clemen, R. T. (1989) · International Journal of Forecasting · doi:10.1016/0169-2070(89)90012-5 · Cited by 2,164
Combining forecasts: A review and annotated bibliography
(1990) · Long Range Planning · doi:10.1016/0024-6301(90)90316-v · Cited by 1,465
Confidence in judgment: persistence of the illusion of validity
Einhorn, H. J., & Hogarth, R. M. (1978) · Psychological Review · doi:10.1037/0033-295x.85.5.395 · Cited by 1,209
Principles of Forecasting: A Handbook for Researchers and Practitioners
(2001) · International Series in Operations Research & Management Science · doi:10.1007/978-0-306-47630-3 · Cited by 1,041
Advice taking in decision making: egocentric discounting and reputation formation
Yaniv, I., & Kleinberger, E. (2000) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2000.2909 · Cited by 701
Simultaneous over- and underconfidence: the role of error in judgment processes
Erev, I., Wallsten, T. S., & Budescu, D. V. (1994) · Psychological Review · doi:10.1037/0033-295x.101.3.519 · Cited by 644
Self-citationTaking Advice: Accepting Help, Improving Judgment, and Sharing Responsibility
Harvey, N., & Fischer, I. (1997) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1997.2697 · Cited by 588
Cueing and Cognitive Conflict in Judge-Advisor Decision Making
Sniezek, J. A., & Buckley, T. (1995) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1995.1040 · Cited by 427
Accuracy and confidence in group judgment
Sniezek, J. A., & Henry, R. A. (1989) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(89)90055-1 · Cited by 357
A note on aggregating opinions
Hogarth, R. M. (1978) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(78)90037-5 · Cited by 321
Limits for the Precision and Value of Information from Dependent Sources
Clemen, R. T., & Winkler, R. L. (1985) · Operations Research · doi:10.1287/opre.33.2.427 · Cited by 303
Groups under uncertainty: An examination of confidence in group decision making
Sniezek, J. A. (1992) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(92)90048-c · Cited by 281
Armstrong, J. S. (2001) · International Series in Operations Research & Management Science · doi:10.1007/978-0-306-47630-3_19 · Cited by 237
Decision Making and Change in Human Affairs
(1977) · Springer eBooks · doi:10.1007/978-94-010-1276-8 · Cited by 219
Helmer, O. (1988) · Futures · doi:10.1016/0016-3287(88)90054-7 · Cited by 207
Confidence in aggregation of expert opinions
Budescu, D. V., & Rantilla, A. K. (2000) · Acta Psychologica · doi:10.1016/s0001-6918(00)00037-8 · Cited by 170
Self-citationThe Effect of Decision Strategy on Deciding to Defer Choice
DHAR, R. (1996) · Journal of Behavioral Decision Making · doi:10.1002/(sici)1099-0771(199612)9:4<265::aid-bdm231>3.0.co;2-4 · Cited by 157
Aggregating Subjective Forecasts: Some Empirical Results
Ashton, A. H., & Ashton, R. H. (1985) · Management Science · doi:10.1287/mnsc.31.12.1499 · Cited by 156
Principles of Forecasting: A Handbook for Researchers and Practitioners
Goodwin, P., Ord, J. K., Öller, L., Sniezek, J. A., & Leonard, M. (2002) · International Journal of Forecasting · doi:10.1016/s0169-2070(02)00034-1 · Cited by 148
Evaluating and Combining Subjective Probability Estimates
WALLSTEN, T. S., BUDESCU, D. V., EREV, I., & DIEDERICH, A. (1997) · Journal of Behavioral Decision Making · doi:10.1002/(sici)1099-0771(199709)10:3<243::aid-bdm268>3.0.co;2-m · Cited by 145
Self-citationThe effects of averaging subjective probability estimates between and within judges.
Ariely, D., Tung Au, W., Bender, R. H., Budescu, D. V., Dietz, C. B., Gu, H., Wallsten, T. S., & Zauberman, G. (2000) · Journal of Experimental Psychology: Applied · doi:10.1037//1076-898x.6.2.130 · Cited by 144
Self-citationCombining the judgments of experts: How many and which ones?
Ashton, R. H. (1986) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(86)90009-9 · Cited by 134
Weighting and Trimming: Heuristics for Aggregating Judgments under Uncertainty
Yaniv, I. (1997) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1997.2685 · Cited by 134
Decision Making and Change in Human Affairs
Kidd, J. (1979) · Journal of the Operational Research Society · doi:10.1057/jors.1979.89 · Cited by 133
Using Advice and Assessing Its Quality
Harvey, N., Harries, C., & Fischer, I. (2000) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1999.2874 · Cited by 131
Revision, Weighting, and commitment in consensus group judgment
Sniezek, J. A., & Henry, R. A. (1990) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(90)90005-t · Cited by 128
Combining forecasts: A philosophical basis and some current issues
Winkler, R. L. (1989) · International Journal of Forecasting · doi:10.1016/0169-2070(89)90018-6 · Cited by 125
Intuitive Theories of Information: Beliefs about the Value of Redundancy
Soll, J. B. (1999) · Cognitive Psychology · doi:10.1006/cogp.1998.0699 · Cited by 113
Combining forecasts: What information do judges need to outperform the simple average?
Fischer, I., & Harvey, N. (1999) · International Journal of Forecasting · doi:10.1016/s0169-2070(98)00073-9 · Cited by 100
When oracles fail—A comparison of four procedures for aggregating subjective probability forecasts
Fischer, G. W. (1981) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(81)90017-9 · Cited by 88
Averaging probability judgments: Monte Carlo analyses of asymptotic diagnostic value
Johnson, T. R., Budescu, D. V., & Wallsten, T. S. (2001) · Journal of Behavioral Decision Making · doi:10.1002/bdm.369 · Cited by 77
Self-citationPerceived Expertise and Its Effect on Confidence
Trafimow, D., & Sniezek, J. A. (1994) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1994.1016 · Cited by 74
Probability and Bayesian Statistics
Viertl, R. K. W. (1987) · Springer eBooks · doi:10.1007/978-1-4613-1885-9 · Cited by 74
Confidence depends on level of aggregation
Sniezek, J. A., & Buckley, T. (1991) · Journal of Behavioral Decision Making · doi:10.1002/bdm.3960040404 · Cited by 73
Information Sampling and Confidence Within Groups and Judge Advisor Systems
SAVADORI, L., VAN SWOL, L. M., & SNIEZEK, J. A. (2001) · Communication Research · doi:10.1177/009365001028006002 · Cited by 72
Methods for Aggregating Opinions
Hogarth, R. M. (1977) · Springer eBooks · doi:10.1007/978-94-010-1276-8_16 · Cited by 68
An experimental examination of subjective forecast combination
Maines, L. A. (1996) · International Journal of Forecasting · doi:10.1016/0169-2070(95)00623-0 · Cited by 68
Combining Overlapping Information
Clemen, R. T. (1987) · Management Science · doi:10.1287/mnsc.33.3.373 · Cited by 66
The uses and abuses of ‘consensus’ forecasts
McNees, S. K. (1992) · Journal of Forecasting · doi:10.1002/for.3980110807 · Cited by 64
The role of variable labels in cue probability learning tasks
Sniezek, J. A. (1986) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(86)90013-0 · Cited by 56
Calibrating and Combining Precipitation Probability Forecasts
Clemen, R. T., & Winkler, R. L. (1987) · Springer eBooks · doi:10.1007/978-1-4613-1885-9_10 · Cited by 55
Probability and Bayesian Statistics.
Lee, P. M., & Viertl, R. K. W. (1989) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348313 · Cited by 53
The Use of Redundancy in Multiple-Cue Judgments: Data from a Suppressor-Variable Task
Armelius, B.-Å., Armelius, K., & Armelius, B.-A. (1974) · The American Journal of Psychology · doi:10.2307/1421380 · Cited by 47
Understanding pooled subjective probability estimates
Wallsten, T. S., & Diederich, A. (2001) · Mathematical Social Sciences · doi:10.1016/s0165-4896(00)00053-6 · Cited by 42
Information Integration Theory
Heath, R. L. (2013) · Sage eBooks · doi:10.4135/9781452276236.n253 · Cited by 38
A Framework for the Combination of Forecasts
Flores, B. E., & White, E. M. (1988) · Journal of the Academy of Marketing Science · doi:10.1007/bf02723365 · Cited by 34
On combining diagnostic ‘forecasts’: Thoughts and some evidence
Hogarth, R. M. (1989) · International Journal of Forecasting · doi:10.1016/0169-2070(89)90015-0 · Cited by 20
Qualitative aspects of decision making
Scholz, R. W. (1997) · Cited by 18
A Framework for the Combination of Forecasts
Flores, B. E., & White, E. M. (1988) · Journal of the Academy of Marketing Science · doi:10.1177/009207038801600313 · Cited by 18
Gonzalez, R. (1994) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1994.1035 · Cited by 17
A dynamic oligopoly model with demand inertia and inventories
Phlips, L., & Richard, J. (1989) · Mathematical Social Sciences · doi:10.1016/0165-4896(89)90067-x · Cited by 16
Collective judgement: combining individual value judgements
Münnich, Á., Maksa, G., & Mokken, R. J. (1999) · Mathematical Social Sciences · doi:10.1016/s0165-4896(98)00030-4 · Cited by 15
Clemen, R. T., & Murphy, A. H. (1986) · Weather and Forecasting · doi:10.1175/1520-0434(1986)001<0213:oasppf>2.0.co;2 · Cited by 14
Research works printed but not linked: 6
- Budescu, 1997, On the importance of random error in the study of probability judgment, Part I: New theoretical developments, Journal of Behavioral Decision Making, 10, 157, 10.1002/(sici)1099-0771(199709)10:3<157::aid-bdm260>3.0.co;2-# · DOI · Paper page
- Clemen, 1986, Objective and subjective precipitation probability forecasts: Some methods for improving forecast quality, Weather and Forecasting, 1, 213, 10.1175/1520-0434(1986)001 · doi:10.1175/1520-0434(1986)001
- Juslin, 1997, Brunswikian and Thurstonian origins of bias in probability assessment: On the interpretation of stochastic components of judgment, Journal of Behavioral Decision Making, 10, 189, 10.1002/(sici)1099-0771(199709)10:3<189::aid-bdm258>3.0.co;2-4 · DOI · Paper page
- Neter, J., Kutner, M. H., Nachtsheim, C. J., & Wasserman, W. (1996). Applied Linear Statistical Models (4th ed.). Irwin
- Soll, J. B., & Larrick, R. (2001). Incorporating another person’s judgments: How, and how well, do we use advice. Paper presented at the 18th bi-annual conference on Subjective Probability, Utility and Decision Making (SPUDM). Amsterdam, The Netherlands
- Van Swol, L. M., Sniezek, J. A. (2002). Trust me, I’m an expert: Trust and confidence and acceptance of expert advice. Paper presented at the 8th Conference on Behavioral Decision Research in Management (BDRM), Chicago, IL
Cited by
Group Performance and Decision Making
Kerr, N. L., & Tindale, R. S. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142009 · Cited by 1,331
“Advisors who have been correct in the past or who have more information at their disposal are given more weight than advisors with less-accurate records (Budescu et al. 2003).”
BackgroundBonaccio, S., & Dalal, R. S. (2006) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2006.07.001 · Cited by 1,011
“, the advisors’ accuracy rates and the number of cues seen by each advisor) into account (Budescu et al., 2003; see also Fischer & Harvey, 1999).”
BackgroundMethodInfluentialStrategies for revising judgment: How (and how well) people use others’ opinions.
Soll, J. B., & Larrick, R. P. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0015145 · Cited by 416
The relative influence of advice from human experts and statistical methods on forecast adjustments
Önkal, D., Goodwin, P., Thomson, M., Gönül, S., & Pollock, A. (2009) · Journal of Behavioral Decision Making · doi:10.1002/bdm.637 · Cited by 341
The Effects of Strategic Decision Making on Entrepreneurial Self–Efficacy
Forbes, D. P. (2005) · Entrepreneurship Theory and Practice · doi:10.1111/j.1540-6520.2005.00100.x · Cited by 318
Metadata
- Authors
- Budescu, D. V., Rantilla, A. K., Yu, H.-T., & Karelitz, T. M.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- Corresponding author
- Budescu, David V
- Venue
- Organizational Behavior and Human Decision Processes
- Publisher
- Elsevier BV
- Published
- 2003-01
- Volume
- 90
- Issue
- 1
- Pages
- 178-194
- ISSN
- 0749-5978 (ISSN-L)
- OpenAlex
- W2116122434
- Cited by
- 117
- References
- 57
- Citations by year
- 2026: 4 · 2025: 3 · 2024: 3 · 2023: 3 · 2022: 3 · 2021: 5 · 2020: 13 · 2019: 5 · 2018: 1 · 2017: 1 · 2016: 5 · 2015: 1 · 2014: 7 · 2013: 2 · 2012: 26
- FWCI
- 5.22
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Locations
- Organizational Behavior and Human Decision Processes (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Forecasting Techniques and Applications
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Keywords
- opinion aggregation, probabilistic forecasting, weighted averaging, decision maker confidence, diagnostic cues, forecast accuracy, judgmental forecasting
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.