The DOI matches its Crossref record; 66 of the 68 references it cites were found in a registry or an index.
Model calibration as a testing strategy for system dynamics models
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“If the full model is then estimated by matching the historical trajectories, the calibration processes varies the model parameters to match the observed patterns, even if those patterns have resulted from external noise that we cannot replicate within the model. As a result, the model parameters would be mis-specified even if the overall behavior appears to fit the empirical trends (40).”
From Modeling the hypothalamus-pituitary-adrenal axis: A review and extension (2015) · cites this paper as [40]
Citations
Cites
The fifth discipline, the art and practice of the learning organization
Senge, P. M. (1991) · Performance + Instruction · doi:10.1002/pfi.4170300510 · Cited by 20,060
(1979) · Medical Entomology and Zoology · Cited by 11,252
(2000) · University of Maribor digital library (University of Maribor) · Cited by 9,354
THE STRUCTURE OF SCIENTIFIC REVOLUTIONS
McGuire, J. E. (1963) · Philosophical Books · doi:10.1111/j.1468-0149.1963.tb00813.x · Cited by 8,547
Regression Models for Categorical and Limited Dependent Variables.
MTW, & Long, J. S. (1997) · Journal of the American Statistical Association · doi:10.2307/2965458 · Cited by 6,891
A Behavioral Theory of the FirmPreprint
Cyert, R. M., & March, J. G. (1963) · SSRN Electronic Journal · Cited by 6,490
Systems Thinking, Systems Practice
Checkland, P. B. (1981) · Cumulative Index of Computer Aided Architectural Design · Cited by 6,256
The Structure of Scientific Revolutions
Hedesan, J., & Tendler, J. (2017) · Macat Library eBooks · doi:10.4324/9781912281589 · Cited by 5,450
Regression Models for Categorical and Limited Dependent Variables
Calvin, J. A., & Long, J. S. (1998) · Technometrics · doi:10.2307/1271407 · Cited by 5,290
Johnsen, E. (1964) · Ledelse & erhvervsøkonomi · Cited by 4,996
Falsification and the Methodology of Scientific Research Programmes
Lakatos, I. (1970) · Criticism and the Growth of Knowledge · doi:10.1017/cbo9781139171434.009 · Cited by 4,649
Kennedy, P. (1979) · Cited by 4,340
Falsification and the Methodology of Scientific Research Programmes
Lakatos, I. (1976) · Can Theories be Refuted? · doi:10.1007/978-94-010-1863-0_14 · Cited by 3,915
Systems thinking, systems practice
(1982) · European Journal of Operational Research · doi:10.1016/0377-2217(82)90206-5 · Cited by 3,579
Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences
Орескес, Н., Shrader‐Frechette, K., & Belitz, K. (1994) · Science · doi:10.1126/science.263.5147.641 · Cited by 3,026
A Behavioral Theory of the Firm
Baumöl, W. J., Cyert, R. M., & March, J. G. (1964) · Journal of Marketing Research · doi:10.2307/3150326 · Cited by 3,009
Lehman, H. (1972) · Philosophy of Science · doi:10.1086/288419 · Cited by 3,008
Modeling Managerial Behavior: Misperceptions of Feedback in a Dynamic Decision Making Experiment
Sterman, J. D. (1989) · Management Science · doi:10.1287/mnsc.35.3.321 · Cited by 2,533
Applied Statistical Decision Theory
Lindley, D. V., Raiffa, H., & Schlaifer, R. (1962) · Econometrica · doi:10.2307/1909900 · Cited by 2,183
System Dynamics: Systems Thinking and Modeling for a Complex World
Sterman, J. D. (2002) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 1,734
Applied Statistical Decision Theory.
Roberts, H. V., Raiffa, H., & Schlaifer, R. (1962) · Journal of the American Statistical Association · doi:10.2307/2282452 · Cited by 1,466
A model of adaptive organizational search
Levinthal, D. A., & March, J. G. (1981) · Journal of Economic Behavior & Organization · doi:10.1016/0167-2681(81)90012-3 · Cited by 1,316
Learning in and about complex systems
Sterman, J. D. (1994) · System Dynamics Review · doi:10.1002/sdr.4260100214 · Cited by 1,279
Schweppe, F. C. (1973) · Medical Entomology and Zoology · Cited by 1,275
Ruist, E., & Theil, H. (1967) · Ekonomisk Tidskrift · doi:10.2307/3439127 · Cited by 1,224
Introduction to System Dynamics Modeling with DYNAMO
Richardson, G. P., & Pugh, A. L. (1997) · Journal of the Operational Research Society · doi:10.1038/sj.jors.2600961 · Cited by 681
Senge, P. M., & Sterman, J. D. (1992) · European Journal of Operational Research · doi:10.1016/0377-2217(92)90011-w · Cited by 549
Aspiration Level Adaptation: An Empirical Exploration
Lant, T. K. (1992) · Management Science · doi:10.1287/mnsc.38.5.623 · Cited by 521
PROCEEDINGS OF THE 1997 WINTER SIMULATION CONFERENCE
Healy, K. J. (1997) · Cited by 509
Kleijnen, J. P. C., & Sargent, R. G. (2000) · European Journal of Operational Research · doi:10.1016/s0377-2217(98)00392-0 · Cited by 502
Cutting Corners and Working Overtime: Quality Erosion in the Service Industry
Oliva, R., & Sterman, J. D. (2001) · Management Science · doi:10.1287/mnsc.47.7.894.9807 · Cited by 493
Decision science or decision-aid science?
Roy, B. (1993) · European Journal of Operational Research · doi:10.1016/0377-2217(93)90312-b · Cited by 484
Multiple tests for validation of system dynamics type of simulation models
Barlas, Y. (1989) · European Journal of Operational Research · doi:10.1016/0377-2217(89)90059-3 · Cited by 440
Introduction to System Dynamics Modeling with DYNAMO
Lane, D. (1997) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2600961 · Cited by 439
System Enquiry: A System Dynamics Approach
Peck, S., & Wolstenholme, E. (1991) · Journal of the Operational Research Society · doi:10.2307/2583422 · Cited by 347
Modeling For Learning Organizations
Senge, P. M., Forrester, J. W., Bodek, N., Morecroft, J., Asay, D., Sterman, J. D., & de Geus, A. P. (1994) · Cited by 295
Criticism and the growth of knowledge
Finocchiaro, M. A. (1973) · Studies in History and Philosophy of Science Part A · doi:10.1016/0039-3681(73)90016-2 · Cited by 290
Plessis, T. A. D. (1967) · South African Journal of Economics · doi:10.1111/j.1813-6982.1967.tb01938.x · Cited by 284
Philosophical roots of model validation: Two paradigms
Barlas, Y., & Carpenter, S. R. (1990) · System Dynamics Review · doi:10.1002/sdr.4260060203 · Cited by 273
Elements of the System Dynamics Method
Lane, D. (1997) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2600456 · Cited by 254
Gass, S. I. (1983) · Operations Research · doi:10.1287/opre.31.4.603 · Cited by 224
Best practices in system dynamics modeling
Martinez‐Moyano, I. J., & Richardson, G. P. (2013) · System Dynamics Review · doi:10.1002/sdr.1495 · Cited by 223
Rationality in the Analysis of Behavioral Simulation Models
Morecroft, J. (1985) · Management Science · doi:10.1287/mnsc.31.7.900 · Cited by 219
Executive knowledge, models and learning
Morecroft, J. (1992) · European Journal of Operational Research · doi:10.1016/0377-2217(92)90004-s · Cited by 214
Validation of Simulation Results
Horn, R. L. V. (1971) · Management Science · doi:10.1287/mnsc.17.5.247 · Cited by 191
System dynamics and microworlds for policymakers
Morecroft, J. (1988) · European Journal of Operational Research · doi:10.1016/0377-2217(88)90221-4 · Cited by 190
Active Nonlinear Tests (ANTs) of Complex Simulation Models
Miller, J. H. (1998) · Management Science · doi:10.1287/mnsc.44.6.820 · Cited by 180
Group model-building to facilitate organizational change: an exploratory study
Vennix, J. A. M., Akkermans, H. A., & Rouwette, E. A. J. A. (1996) · System Dynamics Review · doi:10.1002/(sici)1099-1727(199621)12:1 · Cited by 173
Modeling for Learning Organizations
Lane, D. C., Morecroft, J., & Sterman, J. D. (1995) · Journal of the Operational Research Society · doi:10.1057/jors.1995.111 · Cited by 166
Social theory and system dynamics practice
Lane, D. C. (1999) · European Journal of Operational Research · doi:10.1016/s0377-2217(98)00192-1 · Cited by 165
Introduction to System Dynamics Modeling
Pugh, A. L., & Richardson, G. P. (1981) · Cited by 165
“The” model versus a modeling “process”
Forrester, J. W. (1985) · System Dynamics Review · doi:10.1002/sdr.4260010112 · Cited by 158
System dynamics: Portraying bounded rationality
Morecroft, J. (1983) · Omega · doi:10.1016/0305-0483(83)90002-6 · Cited by 149
Kleijnen, J. P. C. (1995) · System Dynamics Review · doi:10.1002/sdr.4260110403 · Cited by 108
The Myth of Objectivity OR Why Science Needs a New Psychology of Science
Mitroff, I. I. (1972) · Management Science · doi:10.1287/mnsc.18.10.b613 · Cited by 105
Learning In and About Complex Systems
Sterman, J. D. (2000) · Reflections The SoL Journal · doi:10.1162/152417300570050 · Cited by 79
Tradeoffs in Responses to Work Pressure in the Service Industry
Oliva, R. (2001) · California Management Review · doi:10.2307/41166099 · Cited by 55
A foundational concept of science appropriate for validation in operational research
Miser, H. J. (1993) · European Journal of Operational Research · doi:10.1016/0377-2217(93)90313-c · Cited by 48
Tradeoffs in responses to work pressure in the service industry
Oliva, R. (2002) · IEEE Engineering Management Review · doi:10.1109/emr.2002.1022405 · Cited by 42
Structure, data, and compelling conclusions: notes from the field
Homer, J. B. (1997) · System Dynamics Review · doi:10.1002/(sici)1099-1727(199724)13:4 · Cited by 38
Economic Issues for the Eighties
(1980) · Indian Journal of Public Administration · doi:10.1177/0019556119800339 · Cited by 37
Statistical estimation of feedback models
Senge, P. M. (1977) · SIMULATION · doi:10.1177/003754977702800606 · Cited by 28
Modeling muddles: Validation beyond the numbers
Smith, J. H. (1993) · European Journal of Operational Research · doi:10.1016/0377-2217(93)90315-e · Cited by 13
Economic issues of the eighties
Day, R. H. (1981) · Journal of Macroeconomics · doi:10.1016/0164-0704(81)90027-6 · Cited by 10
Using fit-constrained Monte Carlo trials to quantify confidence in simulation model outcomes
Graham, A. K., Choi, C. Y., & Mullen, T. W. (2003) · Proceedings of the ... Annual Hawaii International Conference on System Sciences/Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.1109/hicss.2002.994028 · Cited by 8
Davidsen, P. I. (2002) · Medical Entomology and Zoology · Cited by 1
Research works printed but not linked: 4
- Bell, 1980, Methods for enhancing refutability in system dynamics modeling, TIMS Studies in the Management Sciences, 14, 61
- Forrester, 1980, Tests for building confidence in system dynamics models, TIMS Studies in the Management Sciences, 14, 209
- Senge, P.M., 1978. The system dynamics investment function: A comparison of the neoclassical investment function. PhD Thesis, Sloan School of Management, MIT, Cambridge, MA
- Sterman, 1984, Appropriate summary statistics for evaluating the historical fit of system dynamics models, Dynamica, 10, 51
Cited by
Sorted by citations
Qudrat‐Ullah, H., & Seong, B. S. (2009) · Energy Policy · doi:10.1016/j.enpol.2009.12.009 · Cited by 337
Elsawah, S., Pierce, S. A., Hamilton, S. H., van Delden, H., Haase, D., Elmahdi, A., & Jakeman, A. J. (2017) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2017.03.001 · Cited by 268
Vancouver, J. B., Weinhardt, J. M., & Schmidt, A. M. (2010) · Journal of Applied Psychology · doi:10.1037/a0020628 · Cited by 212
Reddy, T. A., Maor, I., & Panjapornpon, C. (2007) · Science and Technology for the Built Environment · doi:10.1080/10789669.2007.10390952 · Cited by 195
Durán-Encalada, J. A., Paucar‐Caceres, A., Bandala, E. R., & Wright, G. H. (2016) · European Journal of Operational Research · doi:10.1016/j.ejor.2016.06.016 · Cited by 177
Metadata
- Authors
- Oliva, R.
- Affiliations
- Harvard University (US)
- Corresponding author
- Oliva, Rogelio
- ORCID
- Oliva, Rogelio
- Venue
- European Journal of Operational Research
- Publisher
- Elsevier BV
- Published
- 2003-12
- Volume
- 151
- Issue
- 3
- Pages
- 552-568
- ISSN
- 0377-2217 (ISSN-L)
- OpenAlex
- W2150086489
- Cited by
- 314
- References
- 68
- Citations by year
- 2026: 17 · 2025: 18 · 2024: 20 · 2023: 12 · 2022: 14 · 2021: 14 · 2020: 23 · 2019: 16 · 2018: 21 · 2017: 19 · 2016: 27 · 2015: 19 · 2014: 14 · 2013: 13 · 2012: 12
- FWCI
- 7.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- European Journal of Operational Research (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Complex Systems and Decision Making
- Social Sciences › Decision Sciences › Management Science and Operations Research › Simulation Techniques and Applications
- Physical Sciences › Mathematics › Modeling and Simulation › Modeling and Simulation Systems
- Keywords
- system dynamics modeling, model calibration, model testing, hypothesis testing, structure-behavior relationship, parameter estimation, model validation, decision-making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review