The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
The relative influence of advice from human experts and statistical methods on forecast adjustments
Open accessAbstract
Decision makers and forecasters often receive advice from different sources including human experts and statistical methods. This research examines, in the context of stock price forecasting, how the apparent source of the advice affects the attention that is paid to it when the mode of delivery of the advice is identical for both sources. In Study 1, two groups of participants were given the same advised point and interval forecasts. One group was told that these were the advice of a human expert and the other that they were generated by a statistical forecasting method. The participants were then asked to adjust forecasts they had previously made in light of this advice. While in both cases the advice led to improved point forecast accuracy and better calibration of the prediction intervals, the advice which apparently emanated from a statistical method was discounted much more severely. In Study 2, participants were provided with advice from two sources. When the participants were told that both sources were either human experts or both were statistical methods, the apparent statistical‐based advice had the same influence on the adjusted estimates as the advice that appeared to come from a human expert. However when the apparent sources of advice were different, much greater attention was paid to the advice that apparently came from a human expert. Theories of advice utilization are used to identify why the advice of a human expert is likely to be preferred to advice from a statistical method. Copyright © 2009 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“more strongly weigh human input than algorithmic input (Önkal, Goodwin, Thomson, Gönül, & Pollock, 2009; Promberger & Baron, 2006)”
From Algorithm aversion: People erroneously avoid algorithms after seeing them err. (2015) · cites this paper as Önkal, Goodwin, Thomson, Gönül, & Pollock, 2009
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
Agency Theory: An Assessment and Review
Eisenhardt, K. M. (1989) · The Academy of Management Review · doi:10.5465/amr.1989.4279003 · Cited by 13,338
“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298
Clinical versus statistical prediction: A theoretical analysis and a review of the evidence.
Meehl, P. E. (1954) · University of Minnesota Press eBooks · doi:10.1037/11281-000 · Cited by 2,171
Grove, W. M., & Meehl, P. E. (1996) · Psychology, Public Policy, and Law · doi:10.1037/1076-8971.2.2.293 · Cited by 1,457
Expert political judgment: how good is it? how can we know?
(2006) · Choice Reviews Online · doi:10.5860/choice.43-3634 · Cited by 1,260
The dominance analysis approach for comparing predictors in multiple regression.
Azen, R., & Budescu, D. V. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.2.129 · Cited by 1,086
Bonaccio, S., & Dalal, R. S. (2006) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2006.07.001 · Cited by 1,011
Kruger, J. (1999) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.77.2.221 · Cited by 898
Regression analyses of repeated measures data in cognitive research.
Lorch, R. F., & Myers, J. L. (1990) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.16.1.149 · Cited by 791
Can Stock Market Forecasters Forecast?
Cowles, A. (1933) · Econometrica · doi:10.2307/1907042 · Cited by 726
Advice taking in decision making: egocentric discounting and reputation formation
Yaniv, I., & Kleinberger, E. (2000) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2000.2909 · Cited by 701
Receiving other people’s advice: Influence and benefit
Yaniv, I. (2004) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2003.08.002 · Cited by 652
Taking Advice: Accepting Help, Improving Judgment, and Sharing Responsibility
Harvey, N., & Fischer, I. (1997) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1997.2697 · Cited by 588
Judgment and decision making: (550512004-001)
WGBH-Boston, B., & American Psychological Association, W. (1990) · PsycEXTRA Dataset · doi:10.1037/e550512004-001 · Cited by 511
Database Models and Managerial Intuition: 50% Model + 50% Manager
Blattberg, R. C., & Hoch, S. J. (1990) · Management Science · doi:10.1287/mnsc.36.8.887 · Cited by 472
Why we still use our heads instead of formulas: Toward an integrative approach.
Kleinmuntz, B. (1990) · Psychological Bulletin · doi:10.1037//0033-2909.107.3.296 · Cited by 437
Cueing and Cognitive Conflict in Judge-Advisor Decision Making
Sniezek, J. A., & Buckley, T. (1995) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1995.1040 · Cited by 427
The Normative Context of Advice as Social Support
GOLDSMITH, D. J., & FITCH, K. (1997) · Human Communication Research · doi:10.1111/j.1468-2958.1997.tb00406.x · Cited by 392
The Routines of Decision Making
Sinclair, M. (2008) · Ergonomics · doi:10.1080/00140130701223733 · Cited by 331
Graininess of judgment under uncertainty: An accuracy-informativeness trade-off.
Yaniv, I., & Foster, D. P. (1995) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.124.4.424 · Cited by 310
Evidence for egocentric comparison in social judgment.
Dunning, D., & Hayes, A. F. (1996) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.71.2.213 · Cited by 301
The Benefit of Additional Opinions
Yaniv, I. (2004) · Current Directions in Psychological Science · doi:10.1111/j.0963-7214.2004.00278.x · Cited by 270
Promberger, M., & Baron, J. (2006) · Journal of Behavioral Decision Making · doi:10.1002/bdm.542 · Cited by 242
Using advice from multiple sources to revise and improve judgments
Yaniv, I., & Milyavsky, M. (2007) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2006.05.006 · Cited by 242
Are Most People Happier than their Peers, or Are They Just Happy?
Klar, Y., & Giladi, E. E. (1999) · Personality and Social Psychology Bulletin · doi:10.1177/0146167299025005004 · Cited by 217
Overconfidence in estimation: Testing the anchoring-and-adjustment hypothesis
Block, R. A., & Harper, D. R. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90048-x · Cited by 209
Precision and accuracy of judgmental estimation
Yaniv, I., & Foster, D. P. (1997) · Journal of Behavioral Decision Making · doi:10.1002/(sici)1099-0771(199703)10:1<21::aid-bdm243>3.0.co;2-g · Cited by 203
Improving judgement with prepaid expert advice
Sniezek, J. A., Schrah, G. E., & Dalal, R. S. (2004) · Journal of Behavioral Decision Making · doi:10.1002/bdm.468 · Cited by 193
The Psychology of Experts An Alternative View
Shanteau, J. (2007) · Expertise and Decision Support · doi:10.1007/978-0-585-34290-0_2 · Cited by 173
Judgemental adjustment of initial forecasts: Its effectiveness and biases
Lim, J. S., & O'Connor, M. (1995) · Journal of Behavioral Decision Making · doi:10.1002/bdm.3960080302 · Cited by 171
No decision-maker is an Island: integrating expert advice with information acquisition
Schrah, G. E., Dalal, R. S., & Sniezek, J. A. (2006) · Journal of Behavioral Decision Making · doi:10.1002/bdm.514 · Cited by 159
Confidence in aggregation of expert opinions
Budescu, D. V., & Rantilla, A. K. (2000) · Acta Psychologica · doi:10.1016/s0001-6918(00)00037-8 · Cited by 151
Goodwin, P. B., & Fildes, R. A. (1999) · Journal of Behavioral Decision Making · doi:10.1002/(sici)1099-0771(199903)12:1<37::aid-bdm319>3.0.co;2-8 · Cited by 140
Self-citationWeighting and Trimming: Heuristics for Aggregating Judgments under Uncertainty
Yaniv, I. (1997) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1997.2685 · Cited by 122
The effects of asymmetry among advisors on the aggregation of their opinions
Budescu, D. V., Rantilla, A. K., Yu, H.-T., & Karelitz, T. M. (2003) · Organizational Behavior and Human Decision Processes · doi:10.1016/s0749-5978(02)00516-2 · Cited by 117
The primacy of self‐referent information in perceptions of social consensus
Clement, R. W., & Krueger, J. I. (2000) · British Journal of Social Psychology · doi:10.1348/014466600164471 · Cited by 114
Improving the voluntary integration of statistical forecasts and judgment
Goodwin, P. (2000) · International Journal of Forecasting · doi:10.1016/s0169-2070(99)00026-6 · Cited by 98
Self-citationMeehl's contribution to clinical versus statistical prediction.
Grove, W. M., & Lloyd, M. D. (2006) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.115.2.192 · Cited by 64
People's perception of human and computer advice
Wærn, Y., & Ramberg, R. (1996) · Computers in Human Behavior · doi:10.1016/0747-5632(95)00016-x · Cited by 63
The Ombudsman: Value of Expertise for Forecasting Decisions in Conflicts
Green, K. C., & Armstrong, J. S. (2007) · INFORMS Journal on Applied Analytics · doi:10.1287/inte.1060.0262 · Cited by 62
The Role of Self-Referent and Other-Referent Knowledge in Perceptions of Group Characteristics
Krueger, J. I., & Stanke, D. (2001) · Personality and Social Psychology Bulletin · doi:10.1177/0146167201277010 · Cited by 53
The anchor and adjustment heuristic in time‐series forecasting
Lawrence, M. J., & O’Connor, M. J. (1995) · Journal of Forecasting · doi:10.1002/for.3980140504 · Cited by 48
Gonul, M. S., Önkal, D., & Goodwin, P. B. (2008) · Journal of Forecasting · doi:10.1002/for.1082 · Cited by 36
Self-citationJudgmental Adjustments of Previously Adjusted Forecasts*
Önkal, D., Gonul, M. S., & Lawrence, M. J. (2008) · Decision Sciences · doi:10.1111/j.1540-5915.2008.00190.x · Cited by 32
Self-citationIn defense of clinical judgment … and mechanical prediction
Dana, J. D., & Thomas, R. P. (2006) · Journal of Behavioral Decision Making · doi:10.1002/bdm.537 · Cited by 29
Lawrence, M. J., & Sim, W. (1999) · Omega · doi:10.1016/s0305-0483(98)00069-3 · Cited by 18
Cited by
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
Algorithm appreciation: People prefer algorithmic to human judgment
Logg, J. M., Minson, J. A., & Moore, D. A. (2019) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2018.12.005 · Cited by 2,061
Resistance to Medical Artificial Intelligence
Longoni, C., Bonezzi, A., & Morewedge, C. K. (2019) · Journal of Consumer Research · doi:10.1093/jcr/ucz013 · Cited by 2,015
Task-Dependent Algorithm Aversion
Castelo, N., Bos, M. W., Bos, M. W., Lehmann, D. R., & Lehmann, D. R. (2019) · Springer eBooks · doi:10.1007/978-3-031-88067-4_21 · Cited by 1,441
Forecasting: theory and practice
Petropoulos, F., Apiletti, D., Assimakopoulos, V., Babai, M. Z., Barrow, D. K., Ben Taieb, S., Bergmeir, C., Bessa, R. J., Bijak, J., Boylan, J. E., et al. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.11.001 · Cited by 921
Self-citation
Metadata
- Authors
- Önkal, D., Goodwin, P., Thomson, M., Gönül, S., & Pollock, A.
- Venue
- Journal of Behavioral Decision Making
- Publisher
- Wiley
- Published
- 2009-02-09
- Volume
- 22
- Issue
- 4
- Pages
- 390-409
- ISSN
- 0894-3257 (ISSN-L)
- 1099-0771
- OpenAlex
- W2158570360
- Cited by
- 341
- References
- 48
- FWCI
- 6.31
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.