The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning
Open accessAbstract
Demand forecasting is a crucial aspect of the planning process in supply-chain companies. The most common approach to forecasting demand in these companies involves the use of a computerized forecasting system to produce initial forecasts and the subsequent judgmental adjustment of these forecasts by the company's demand planners, ostensibly to take into account exceptional circumstances expected over the planning horizon. Making these adjustments can involve considerable management effort and time, but do they improve accuracy, and are some types of adjustment more effective than others? To investigate this, we collected data on more than 60,000 forecasts and outcomes from four supply-chain companies. In three of the companies, on average, judgmental adjustments increased accuracy. However, a detailed analysis revealed that, while the relatively larger adjustments tended to lead to greater average improvements in accuracy, the smaller adjustments often damaged accuracy. In addition, positive adjustments, which involved adjusting the forecast upwards, were much less likely to improve accuracy than negative adjustments. They were also made in the wrong direction more frequently, suggesting a general bias towards optimism. Models were then developed to eradicate such biases. Based on both this statistical analysis and organisational observation, the paper goes on to analyse strategies designed to enhance the effectiveness of judgmental adjustments directly.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
Langer, E. J. (1975) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.32.2.311 · Cited by 3,756
Megaprojects and Risk: An Anatomy of Ambition
Flyvbjerg, B., Bruzelius, N., & Rothengatter, W. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9781107050891 · Cited by 2,415
“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298
Knee-deep in the big muddy: a study of escalating commitment to a chosen course of action
Staw, B. M. (1976) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(76)90005-2 · Cited by 2,061
Error measures for generalizing about forecasting methods: Empirical comparisons
Armstrong, J. S., & Collopy, F. (1992) · International Journal of Forecasting · doi:10.1016/0169-2070(92)90008-w · Cited by 1,396
Ruist, E., & Theil, H. (1967) · The Swedish Journal of Economics · doi:10.2307/3439127 · Cited by 1,207
Principles of Forecasting: A Handbook for Researchers and Practitioners
(2001) · International Series in Operations Research & Management Science · doi:10.1007/978-0-306-47630-3 · Cited by 1,041
Bonaccio, S., & Dalal, R. S. (2006) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2006.07.001 · Cited by 1,011
Cited by
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2018) · Management Science · doi:10.1287/mnsc.2016.2643 · Cited by 1,230
Forecasting: theory and practice
Petropoulos, F., Apiletti, D., Assimakopoulos, V., Babai, M. Z., Barrow, D. K., Ben Taieb, S., Bergmeir, C., Bessa, R. J., Bijak, J., Boylan, J. E., et al. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.11.001 · Cited by 921
Self-citation'It's Reducing a Human Being to a Percentage': Perceptions of Justice in Algorithmic Decisions
Binns, R., Van Kleek, M., Veale, M., Lyngs, U., Zhao, J., & Shadbolt, N. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173951 · Cited by 691
“Various research suggests that users—again, primarily experts— may in certain cases systematically over-rely on the outputs of intelligent systems [26, 19], while in others they may systematically distrust systems, despite reassurances as to their accuracy [57, 24].”
BackgroundM5 accuracy competition: Results, findings, and conclusions
Makridakis, S., Spiliotis, E., & Assimakopoulos, V. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.11.013 · Cited by 554
Arunachalam, D., Kumar, N., & Kawalek, J. P. (2018) · Transportation Research Part E: Logistics and Transportation Review · doi:10.1016/j.tre.2017.04.001 · Cited by 535
Artificial intelligence applications in supply chain management
Pournader, M., Ghaderi, H., Hassanzadegan, A., & Fahimnia, B. (2021) · International Journal of Production Economics · doi:10.1016/j.ijpe.2021.108250 · Cited by 519
Retail forecasting: Research and practice
Fildes, R., Ma, S., & Kolassa, S. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2019.06.004 · Cited by 346
Self-citationSupply chain forecasting: Theory, practice, their gap and the future
Syntetos, A. A., Babai, Z., Boylan, J. E., Kolassa, S., & Nikolopoulos, K. (2016) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.11.010 · Cited by 328
Self-citationUnderstanding algorithm aversion: When is advice from automation discounted?
Prahl, A., & Van Swol, L. (2017) · Journal of Forecasting · doi:10.1002/for.2464 · Cited by 308
Forecasting and operational research: a review
Fildes, R., Nikolopoulos, K., Crone, S. F., & Syntetos, A. A. (2008) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2602597 · Cited by 287
Self-citationForecasting sales in the supply chain: Consumer analytics in the big data era
Boone, T., Ganeshan, R., Jain, A., & Sanders, N. R. (2019) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2018.09.003 · Cited by 271
Exploring the use of deep neural networks for sales forecasting in fashion retail
Loureiro, A. L. D., Miguéis, V. L., & da Silva, L. F. M. (2018) · Decision Support Systems · doi:10.1016/j.dss.2018.08.010 · Cited by 261
'It's Reducing a Human Being to a Percentage'; Perceptions of Justice in Algorithmic Decisions
(2018) · doi:10.31235/osf.io/9wqxr · Cited by 161
Algorithmic Decision-Making and the Control Problem
Zerilli, J., Knott, A., Maclaurin, J., & Gavaghan, C. (2019) · Minds and Machines · doi:10.1007/s11023-019-09513-7 · Cited by 145
Turn Digitalization and Automation to a Job Resource
Demerouti, E. (2022) · Applied Psychology · doi:10.1111/apps.12270 · Cited by 121
The risk of algorithm transparency: How algorithm complexity drives the effects on the use of advice
Lehmann, C. A., Haubitz, C. B., Fügener, A., & Thonemann, U. W. (2022) · Production and Operations Management · doi:10.1111/poms.13770 · Cited by 100
Do ‘big losses’ in judgmental adjustments to statistical forecasts affect experts’ behaviour?
Petropoulos, F., Fildes, R., & Goodwin, P. (2016) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.06.002 · Cited by 71
Self-citationAntecedents and effects of trust in forecasting advice
Goodwin, P., Sinan Gönül, M., & Önkal, D. (2013) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2012.08.001 · Cited by 46
“conditions may also apply in organizational contexts when forecasters feel an obligation to adjust forecasts merely to justify their role (Fildes et al., 2009; Önkal et al., 2011), and they would not account for differences in the size of adjustments between the experimental treatments.”
BackgroundResultInfluentialSelf-citationUsing judgment to select and adjust forecasts from statistical models
De Baets, S., & Harvey, N. (2020) · European Journal of Operational Research · doi:10.1016/j.ejor.2020.01.028 · Cited by 44
Metadata
- Authors
- Fildes, R., Goodwin, P., Lawrence, M., & Nikolopoulos, K.
- Venue
- International Journal of Forecasting
- Publisher
- Elsevier BV
- Published
- 2009-01
- Volume
- 25
- Issue
- 1
- Pages
- 3-23
- ISSN
- 0169-2070 (ISSN-L)
- OpenAlex
- W2040640338
- Cited by
- 446
- References
- 49
- FWCI
- 28.87
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.