The DOI matches its Crossref record.
Against Your Better Judgment? How Organizations Can Improve Their Use of Management Judgment in Forecasting
Open accessAbstract
Accurate forecasts are crucial to successful organizational planning. In 2001, 40 international experts published a set of principles to guide best practices in forecasting. Some of these principles relate to the use of management judgment. Most organizations use judgment at some stage in their forecasting process, but do they do so effectively? Although judgment can lead to significant improvements in forecasting accuracy, it can also be biased and inconsistent. The principles show how forecasters should use judgment and assess its effectiveness. We conducted a survey of 149 forecasters to examine the use of judgment based on these established principles and to investigate whether their forecasting procedures were consistent with the principles. In addition, we conducted four in-depth case studies. Although we found examples of good practice, we also discovered that many organizations would improve forecast accuracy if they followed basic principles such as limiting judgmental adjustments of quantitative forecasts, requiring managers to justify their adjustments in writing, and assessing the results of judgmental interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2018) · Management Science · doi:10.1287/mnsc.2016.2643 · Cited by 1,230
Making and Evaluating Point Forecasts
Gneiting, T. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.r10138 · Cited by 1,154
Forecasting: theory and practice
Petropoulos, F., Apiletti, D., Assimakopoulos, V., Babai, M. Z., Barrow, D. K., Ben Taieb, S., Bergmeir, C., Bessa, R. J., Bijak, J., Boylan, J. E., et al. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.11.001 · Cited by 921
Self-citationBotchkarev, A. (2019) · Interdisciplinary Journal of Information, Knowledge, and Management · doi:10.28945/4184 · Cited by 616
Fildes, R., Goodwin, P., Lawrence, M., & Nikolopoulos, K. (2009) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2008.11.010 · Cited by 446
Self-citationBotchkarev, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.03006 · Cited by 387
Retail forecasting: Research and practice
Fildes, R., Ma, S., & Kolassa, S. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2019.06.004 · Cited by 346
Self-citationSupply chain forecasting: Theory, practice, their gap and the future
Syntetos, A. A., Babai, Z., Boylan, J. E., Kolassa, S., & Nikolopoulos, K. (2016) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.11.010 · Cited by 328
Forecasting and operational research: a review
Fildes, R., Nikolopoulos, K., Crone, S. F., & Syntetos, A. A. (2008) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2602597 · Cited by 287
Self-citationThe tourism forecasting competition
Athanasopoulos, G., Hyndman, R. J., Song, H., & Wu, D. C. (2011) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2010.04.009 · Cited by 281
Human-machine collaboration in managerial decision making
Haesevoets, T., De Cremer, D., Dierckx, K., & Van Hiel, A. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106730 · Cited by 280
Dietvorst, B. J., & Bharti, S. (2020) · Psychological Science · doi:10.1177/0956797620948841 · Cited by 273
Forecasting sales in the supply chain: Consumer analytics in the big data era
Boone, T., Ganeshan, R., Jain, A., & Sanders, N. R. (2019) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2018.09.003 · Cited by 271
Banker, S., & Khetani, S. (2019) · Journal of Public Policy & Marketing · doi:10.1177/0743915619858057 · Cited by 120
“They are reluctant to use algorithms to assist in management decisions (Fildes and Goodwin 2007), avoid adopting software packages to improve their marketing forecasting performance (Sanders and Manrodt 2003), and fail to apply more accurate algorithmic diagnosis methods in psychiatric contexts…”
MethodThe risk of algorithm transparency: How algorithm complexity drives the effects on the use of advice
Lehmann, C. A., Haubitz, C. B., Fügener, A., & Thonemann, U. W. (2022) · Production and Operations Management · doi:10.1111/poms.13770 · Cited by 100
Do ‘big losses’ in judgmental adjustments to statistical forecasts affect experts’ behaviour?
Petropoulos, F., Fildes, R., & Goodwin, P. (2016) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.06.002 · Cited by 71
Self-citationUsing judgment to select and adjust forecasts from statistical models
De Baets, S., & Harvey, N. (2020) · European Journal of Operational Research · doi:10.1016/j.ejor.2020.01.028 · Cited by 44
Metadata
- Authors
- Fildes, R., & Goodwin, P.
- Venue
- Interfaces
- Published
- 2007-12
- Volume
- 37
- Issue
- 6
- Pages
- 570-576
- ISSN
- 0092-2102 (ISSN-L)
- 1526-551X
- OpenAlex
- W2107393893
- Cited by
- 226
- References
- 0
- FWCI
- 10.49
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.