The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning
Open accessAbstract
Demand forecasting is a crucial aspect of the planning process in supply-chain companies. The most common approach to forecasting demand in these companies involves the use of a computerized forecasting system to produce initial forecasts and the subsequent judgmental adjustment of these forecasts by the company's demand planners, ostensibly to take into account exceptional circumstances expected over the planning horizon. Making these adjustments can involve considerable management effort and time, but do they improve accuracy, and are some types of adjustment more effective than others? To investigate this, we collected data on more than 60,000 forecasts and outcomes from four supply-chain companies. In three of the companies, on average, judgmental adjustments increased accuracy. However, a detailed analysis revealed that, while the relatively larger adjustments tended to lead to greater average improvements in accuracy, the smaller adjustments often damaged accuracy. In addition, positive adjustments, which involved adjusting the forecast upwards, were much less likely to improve accuracy than negative adjustments. They were also made in the wrong direction more frequently, suggesting a general bias towards optimism. Models were then developed to eradicate such biases. Based on both this statistical analysis and organisational observation, the paper goes on to analyse strategies designed to enhance the effectiveness of judgmental adjustments directly.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
Langer, E. J. (1975) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.32.2.311 · Cited by 3,756
Megaprojects and Risk: An Anatomy of Ambition
Flyvbjerg, B., Bruzelius, N., & Rothengatter, W. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9781107050891 · Cited by 2,415
“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298
Knee-deep in the big muddy: a study of escalating commitment to a chosen course of action
Staw, B. M. (1976) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(76)90005-2 · Cited by 2,061
Error measures for generalizing about forecasting methods: Empirical comparisons
Armstrong, J. S., & Collopy, F. (1992) · International Journal of Forecasting · doi:10.1016/0169-2070(92)90008-w · Cited by 1,396
Ruist, E., & Theil, H. (1967) · The Swedish Journal of Economics · doi:10.2307/3439127 · Cited by 1,207
Principles of Forecasting: A Handbook for Researchers and Practitioners
(2001) · International Series in Operations Research & Management Science · doi:10.1007/978-0-306-47630-3 · Cited by 1,041
Bonaccio, S., & Dalal, R. S. (2006) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2006.07.001 · Cited by 1,011
Exponential smoothing: The state of the art—Part II
Gardner, E. S. (2006) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2006.03.005 · Cited by 948
Receiving other people’s advice: Influence and benefit
Yaniv, I. (2004) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2003.08.002 · Cited by 652
The Effect of Collaborative Forecasting on Supply Chain Performance
Aviv, Y. (2001) · Management Science · doi:10.1287/mnsc.47.10.1326.10260 · Cited by 535
Judgmental forecasting: A review of progress over the last 25years
Lawrence, M., Goodwin, P., O'Connor, M., & Önkal, D. (2006) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2006.03.007 · Cited by 534
Self-citationDatabase Models and Managerial Intuition: 50% Model + 50% Manager
Blattberg, R. C., & Hoch, S. J. (1990) · Management Science · doi:10.1287/mnsc.36.8.887 · Cited by 472
On the asymmetry of the symmetric MAPE
Goodwin, P., & Lawton, R. (1999) · International Journal of Forecasting · doi:10.1016/s0169-2070(99)00007-2 · Cited by 328
Self-citationFildes, R., & Goodwin, P. (2007) · Interfaces · doi:10.1287/inte.1070.0309 · Cited by 226
Self-citationForecasting Practices in US Corporations: Survey Results
Sanders, N. R., & Manrodt, K. B. (1994) · Interfaces · doi:10.1287/inte.24.2.92 · Cited by 218
Judgemental adjustment of initial forecasts: Its effectiveness and biases
Lim, J. S., & O'Connor, M. (1995) · Journal of Behavioral Decision Making · doi:10.1002/bdm.3960080302 · Cited by 171
Åstebro, T. B., & Elhedhli, S. (2006) · Management Science · doi:10.1287/mnsc.1050.0468 · Cited by 165
A field study of sales forecasting accuracy and processes
Lawrence, M. J., O’Connor, M. J., & Edmundson, B. (2000) · European Journal of Operational Research · doi:10.1016/s0377-2217(99)00085-5 · Cited by 141
Self-citationGoodwin, P. B., & Fildes, R. A. (1999) · Journal of Behavioral Decision Making · doi:10.1002/(sici)1099-0771(199903)12:1<37::aid-bdm319>3.0.co;2-8 · Cited by 140
Self-citationPlanning, personality, and prediction: The role of future focus in optimistic time predictions
Buehler, R., & Griffin, D. W. (2003) · Organizational Behavior and Human Decision Processes · doi:10.1016/s0749-5978(03)00089-x · Cited by 139
The Organization and Improvement of Market Forecasting
Fildes, R. A., & Hastings, R. (1994) · Journal of the Operational Research Society · doi:10.1057/jors.1994.1 · Cited by 137
Self-citationThe design features of forecasting support systems and their effectiveness
Fildes, R. A., Goodwin, P. B., & Lawrence, M. J. (2005) · Decision Support Systems · doi:10.1016/j.dss.2005.01.003 · Cited by 133
Self-citationConducting a sales forecasting audit
Moon, M. A., Mentzer, J. T., & Smith, C. D. (2003) · International Journal of Forecasting · doi:10.1016/s0169-2070(02)00032-8 · Cited by 117
Judgemental forecasting in times of change
O’Connor, M. J., Remus, W., & Griggs, K. (1993) · International Journal of Forecasting · doi:10.1016/0169-2070(93)90002-5 · Cited by 117
Forecasting collaboration in the European grocery sector: Observations from a case study
Småros, J. (2006) · Journal of Operations Management · doi:10.1016/j.jom.2006.06.005 · Cited by 107
The role of judgment in macroeconomic forecasting accuracy
McNees, S. K. (1990) · International Journal of Forecasting · doi:10.1016/0169-2070(90)90056-h · Cited by 107
Why Are Judgments Less Consistent in Less Predictable Task Situations?
Harvey, N. (1995) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1995.1077 · Cited by 99
Improving the voluntary integration of statistical forecasts and judgment
Goodwin, P. (2000) · International Journal of Forecasting · doi:10.1016/s0169-2070(99)00026-6 · Cited by 98
Self-citationComputer-Assisted Decision Making: Performance, Beliefs, and the Illusion of Control
Kottemann, J. E., Davis, F. D., & Remus, W. (1994) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1994.1002 · Cited by 91
Forecasting Systems for Production and Inventory Control
Fildes, R. A., & Beard, C. A. (1992) · International Journal of Operations & Production Management · doi:10.1108/01443579210011381 · Cited by 90
Self-citationCorrespondence on the selection of error measures for comparisons among forecasting methods
Armstrong, J. S., & Fildes, R. A. (1995) · Journal of Forecasting · doi:10.1002/for.3980140106 · Cited by 87
Self-citationThe role of judgement in macroeconomic forecasting
Turner, D. S. (1990) · Journal of Forecasting · doi:10.1002/for.3980090404 · Cited by 85
Managerial intervention in forecasting. An empirical investigation of forecast manipulation
Mathews, B. P., & Diamantopoulos, A. (1986) · International Journal of Research in Marketing · doi:10.1016/0167-8116(86)90038-8 · Cited by 84
Judgmental forecasting with time series and causal information
Lim, J. S., & O’Connor, M. J. (1996) · International Journal of Forecasting · doi:10.1016/0169-2070(95)00635-4 · Cited by 80
Providing support for the use of analogies in demand forecasting tasks
Lee, W. Y., Goodwin, P., Fildes, R. A., Nikolopoulos, K. I., & Lawrence, M. J. (2007) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2007.02.006 · Cited by 77
Self-citationPeople's perception of human and computer advice
Wærn, Y., & Ramberg, R. (1996) · Computers in Human Behavior · doi:10.1016/0747-5632(95)00016-x · Cited by 63
Remarks on the application of the analytic hierarchy process to judgmental forecasting
Belton, V., & Goodwin, P. B. (1996) · International Journal of Forecasting · doi:10.1016/0169-2070(95)00643-5 · Cited by 63
Self-citationJudgemental revision of sales forecasts: A longitudinal eetension
Mathews, B. P., & Diamantopoulos, A. (1989) · Journal of Forecasting · doi:10.1002/for.3980080206 · Cited by 60
Judgemental revision of sales forecasts: Effectiveness of forecast selection
Mathews, B. P., & Diamantopoulous, A. (1990) · Journal of Forecasting · doi:10.1002/for.3980090408 · Cited by 54
Evaluating the role judgment plays in forecast accuracy
Donihue, M. R. (1993) · Journal of Forecasting · doi:10.1002/for.3980120203 · Cited by 50
The effect of graphical adjustment on forecast accuracy
Willemain, T. R. (1991) · International Journal of Forecasting · doi:10.1016/0169-2070(91)90049-2 · Cited by 33
Researching Sales Forecasting Practice
Fildes, R. A., Bretschneider, S. I., Collopy, F., et al. (2003) · International Journal of Forecasting · doi:10.1016/s0169-2070(02)00033-x · Cited by 20
Self-citationDiffusion of Forecasting Principles through Software
Tashman, L. J., & Hoover, J. (2001) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/978-0-306-47630-3_30 · Cited by 19
Judgement or models: The importance of task differences
Lawrence, M. J., & O’Connor, M. J. (1996) · Omega · doi:10.1016/0305-0483(96)00006-0 · Cited by 19
Self-citationStable seasonal pattern models for forecast revision: A comparative study
Yelland, P. M. (2006) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2006.04.005 · Cited by 12
Understanding the use of forecasting software: an interpretive study in a supply-chain company
Goodwin, P. B., Lee, W. Y., Fildes, R. A., Nikolopoulos, K. I., & Lawrence, M. J. (2006) · Lancaster EPrints (Lancaster University) · Cited by 10
Self-citation
Cited by
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2018) · Management Science · doi:10.1287/mnsc.2016.2643 · Cited by 1,230
Forecasting: theory and practice
Petropoulos, F., Apiletti, D., Assimakopoulos, V., Babai, M. Z., Barrow, D. K., Ben Taieb, S., Bergmeir, C., Bessa, R. J., Bijak, J., Boylan, J. E., et al. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.11.001 · Cited by 921
Self-citation'It's Reducing a Human Being to a Percentage': Perceptions of Justice in Algorithmic Decisions
Binns, R., Van Kleek, M., Veale, M., Lyngs, U., Zhao, J., & Shadbolt, N. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173951 · Cited by 691
“Various research suggests that users—again, primarily experts— may in certain cases systematically over-rely on the outputs of intelligent systems [26, 19], while in others they may systematically distrust systems, despite reassurances as to their accuracy [57, 24].”
BackgroundM5 accuracy competition: Results, findings, and conclusions
Makridakis, S., Spiliotis, E., & Assimakopoulos, V. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.11.013 · Cited by 554
Arunachalam, D., Kumar, N., & Kawalek, J. P. (2018) · Transportation Research Part E: Logistics and Transportation Review · doi:10.1016/j.tre.2017.04.001 · Cited by 535
Metadata
- Authors
- Fildes, R., Goodwin, P., Lawrence, M., & Nikolopoulos, K.
- Venue
- International Journal of Forecasting
- Publisher
- Elsevier BV
- Published
- 2009-01
- Volume
- 25
- Issue
- 1
- Pages
- 3-23
- ISSN
- 0169-2070 (ISSN-L)
- OpenAlex
- W2040640338
- Cited by
- 446
- References
- 49
- FWCI
- 28.87
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.