The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Selectionism and Learning in Projects with Complexity and Unforeseeable Uncertainty
Abstract
Companies innovating in dynamic environments face the combined challenge of unforeseeable uncertainty (the inability to recognize the relevant influence variables and their functional relationships; thus, events and actions cannot be planned ahead of time) and high complexity (large number of variables and interactions; this leads to difficulty in assessing optimal actions beforehand). There are two fundamental strategies to manage innovation with unforeseeable uncertainty and complexity: trial and error learning and selectionism. Trial and error learning involves a flexible (unplanned) adjustment of the considered actions and targets to new information about the relevant environment as it emerges. Selectionism involves pursuing several approaches independently of one another and picking the best one ex post. Neither strategy nor project management literatures have compared the relative advantages of the two approaches in the presence of unforeseeable uncertainty and complexity. We build a model of a complex project with unforeseeable uncertainty, simulating problem solving as a local search on a rugged landscape. We compare the project payoff performance under trial and error learning and selectionism, based on a priori identifiable project characteristics: whether unforeseeable uncertainty is present, how high the complexity is, and how much trial and error learning and parallel trials cost. We find that if unforeseeable uncertainty is present and the team cannot run trials in a realistic user environment (indicating the project's true market performance), trial and error learning is preferred over selectionism. Moreover, the presence of unforeseeable uncertainty can reverse an established result from computational optimization: Without unforeseeable uncertainty, the optimal number of parallel trials increases in complexity. But with unforeseeable uncertainty, the optimal number of trials might decrease because the unforeseeable factors make the trials less and less informative as complexity grows.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Capitalism, Socialism and Democracy
Fukuyama, F., & Schumpeter, J. A. (1997) · Foreign Affairs · doi:10.2307/20048211 · Cited by 15,264
The Origins of Order: Self-Organization and Selection in Evolution
Kauffman, S. A. (1993) · doi:10.1093/oso/9780195079517.001.0001 · Cited by 7,855
Hamel, G., & Prahalad, C. K. (1994) · CERN Document Server (European Organization for Nuclear Research) · Cited by 5,747
Principles of mathematical analysis
Rudin, W. (1964) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 5,298
Principles of mathematical analysis
Hammer, C. (1953) · Journal of the Franklin Institute · doi:10.1016/0016-0032(53)90617-6 · Cited by 3,985
Capitalism, Socialism, and Democracy.
Robinson, J., & Schumpeter, J. A. (1951) · The Economic Journal · doi:10.2307/2226618 · Cited by 3,565
Building the Learning Organization
Marquardt, M. J. (1995) · Cited by 2,767
Introduction to linear optimization
Bertsimas, D., & Tsitsiklis, J. N. (1997) · Cited by 2,705
Adaptation on Rugged Landscapes
Levinthal, D. A. (1997) · Management Science · doi:10.1287/mnsc.43.7.934 · Cited by 2,254
Local Search in Combinatorial Optimization
(2003) · Princeton University Press eBooks · doi:10.1515/9780691187563 · Cited by 2,057
Looking Forward and Looking Backward: Cognitive and Experiential Search
Gavetti, G., & Levinthal, D. (2000) · Administrative Science Quarterly · doi:10.2307/2666981 · Cited by 2,050
Managing the Unexpected: Assuring High Performance in an Age of Complexity
(2002) · Work Study · doi:10.1108/ws.2002.07951dae.003 · Cited by 1,950
Recent developments in modeling preferences: Uncertainty and ambiguity
Camerer, C., & Weber, M. (1992) · Journal of Risk and Uncertainty · doi:10.1007/bf00122575 · Cited by 1,795
Towards a general theory of adaptive walks on rugged landscapes
Kauffman, S., & Levin, S. (1987) · Journal of Theoretical Biology · doi:10.1016/s0022-5193(87)80029-2 · Cited by 1,386
EXPLORATORY LEARNING, INNOVATIVE CAPACITY, AND MANAGERIAL OVERSIGHT.
McGrath, R. G. (2001) · Academy of Management Journal · doi:10.2307/3069340 · Cited by 1,310
Imitation of Complex Strategies
Rivkin, J. W. (2000) · Management Science · doi:10.1287/mnsc.46.6.824.11940 · Cited by 1,283
Optimal Search for the Best Alternative
Weitzman, M. L. (1979) · Econometrica · doi:10.2307/1910412 · Cited by 1,074
Where the really hard problems are
Cheeseman, P. C., Kanefsky, B., & Taylor, W. M. (1991) · Cited by 1,004
On Uncertainty, Ambiguity, and Complexity in Project Management
Pich, M. T., Loch, C. H., & Meyer, A. D. (2002) · Management Science · doi:10.1287/mnsc.48.8.1008.163 · Cited by 942
Self-citationMarketing and Discontinuous Innovation: The Probe and Learn Process
Lynn, G. S., Morone, J. G., & Paulson, A. S. (1996) · California Management Review · doi:10.2307/41165841 · Cited by 915
Balancing Search and Stability: Interdependencies Among Elements of Organizational Design
Rivkin, J. W., & Siggelkow, N. (2003) · Management Science · doi:10.1287/mnsc.49.3.290.12740 · Cited by 900
Local Search in Combinatorial Optimization
(2018) · Princeton University Press eBooks · doi:10.2307/j.ctv346t9c · Cited by 808
Tushman, M. L. (1997) · Strategy & Leadership · doi:10.1108/eb054591 · Cited by 797
Winning through innovation : a practical guide to leading organizational change and renewal
Tushman, M. L., & O’Reilly, C. A. (1997) · CERN Document Server (European Organization for Nuclear Research) · Cited by 794
Unforeseen Contingencies and Incomplete Contracts
Maskin, E., & Tirole, J. (1999) · Review of Economic Studies · doi:10.1111/1467-937x.00079 · Cited by 775
The second Toyota paradox: How delaying decisions can make better cars faster
(1995) · Long Range Planning · doi:10.1016/0024-6301(95)94310-u · Cited by 638
Toyota's Principles of Set-Based Concurrent Engineering
Sobek, D. K., Ward, A. C., & Liker, J. Κ. (1999) · Sloan management review · Cited by 632
Correlated and uncorrelated fitness landscapes and how to tell the difference
Weinberger, E. (1990) · Biological Cybernetics · doi:10.1007/bf00202749 · Cited by 561
Project Risk Management: Processes, Techniques and Insights
Smith, J. U. M. (1998) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2600022 · Cited by 555
Managing product families: The case of the Sony Walkman
Sanderson, S., & Uzumeri, M. (1995) · Research Policy · doi:10.1016/0048-7333(94)00797-b · Cited by 442
Isenberg, D. J. (1988) · Decision Making · doi:10.1017/cbo9780511598951.026 · Cited by 414
Agile Product Development: Managing Development Flexibility in Uncertain Environments
Thomke, S., & Reinertsen, D. (1998) · California Management Review · doi:10.2307/41165973 · Cited by 333
Representing Preferences with a Unique Subjective State Space
Dekel, E., Lipman, B. L., & Rustichini, A. (2001) · Econometrica · doi:10.1111/1468-0262.00224 · Cited by 328
Beinhocker, E. D. (1999) · Sloan management review · Cited by 309
The Strategic Management of Large Engineering Projects: Shaping Institutions, Risks, and Governance
Miller, R., Lessard, D. R., Michaud, P., & Floricel, S. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/6478.001.0001 · Cited by 269
Optimal search on a technology landscape
Kauffman, S., Lobo, J., & Macready, W. G. (2000) · Journal of Economic Behavior & Organization · doi:10.1016/s0167-2681(00)00114-1 · Cited by 253
Parallel and Sequential Testing of Design Alternatives
Loch, C. H., Terwiesch, C., & Thomke, S. (2001) · Management Science · doi:10.1287/mnsc.47.5.663.10480 · Cited by 252
Self-citationChoice over uncertainty and ambiguity in technical problem solving
Schrader, S., Riggs, W. M., & Smith, R. P. (1993) · Journal of Engineering and Technology Management · doi:10.1016/0923-4748(93)90059-r · Cited by 246
A complexity approach to innovation networks. The case of the aircraft industry (1909–1997)
Frenken, K. (2000) · Research Policy · doi:10.1016/s0048-7333(99)00064-5 · Cited by 221
Local properties of Kauffman’s N-k model: A tunably rugged energy landscape
Weinberger, E. D. (1991) · Physical Review A · doi:10.1103/physreva.44.6399 · Cited by 219
Integrated Product Design for Marketability and Manufacturing
Srinivasan, V., Lovejoy, W. S., & Beach, D. (1997) · Journal of Marketing Research · doi:10.2307/3152072 · Cited by 209
A Stochastic Model of Applied Research
Evenson, R. E., & Kislev, Y. (1976) · Journal of Political Economy · doi:10.1086/260431 · Cited by 201
Technological innovation and complexity theory
Frenken, K. (2006) · Economics of Innovation and New Technology · doi:10.1080/10438590500141453 · Cited by 194
Sanderson, S. W., & Uzumeri, M. V. (1996) · Cited by 188
Auerswald, P. E., Kauffman, S. A., Lobo, J., & Shell, K. (2000) · Journal of Economic Dynamics and Control · doi:10.1016/s0165-1889(98)00091-8 · Cited by 145
Simulation, learning and R&D performance: Evidence from automotive development
Thomke, S. H. (1998) · Research Policy · doi:10.1016/s0048-7333(98)00024-9 · Cited by 140
The landscape of the traveling salesman problem
Stadler, P. F., & Schnabl, W. (1992) · Physics Letters A · doi:10.1016/0375-9601(92)90557-3 · Cited by 127
The Strategic Management of Large Engineering Projects
Pohlmann, L. D. (2002) · Insight · doi:10.1002/inst.20024452a · Cited by 118
Recent developments in modeling unforeseen contingencies
Dekel, E., Lipman, B. L., & Rustichini, A. (1998) · European Economic Review · doi:10.1016/s0014-2921(97)00114-1 · Cited by 110
Economic analysis of markets and games : essays in honor of Frank Hahn
Hahn, F. H., & Dasgupta, P. (1992) · Cited by 95
Leonard‐Barton, D., Chew, W. B., & Bohn, R. (1991) · Cited by 83
Uncertainty, Difficulty, and Complexity
Page, S. E. (2008) · Journal of Theoretical Politics · doi:10.1177/0951629807085815 · Cited by 71
Cited by
Innovation Contests, Open Innovation, and Multiagent Problem Solving
Terwiesch, C., & Xu, Y. (2008) · Management Science · doi:10.1287/mnsc.1080.0884 · Cited by 923
Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis
Boudreau, K. J., Lacetera, N., & Lakhani, K. R. (2011) · Management Science · doi:10.1287/mnsc.1110.1322 · Cited by 830
Risk and risk management in software projects: A reassessment
Bannerman, P. L. (2008) · Journal of Systems and Software · doi:10.1016/j.jss.2008.03.059 · Cited by 358
Pluralism in Project Management: Navigating the Crossroads of Specialization and Fragmentation
Söderlund, J. (2011) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2010.00290.x · Cited by 352
A multi-level perspective on innovation ecosystems for path-breaking innovation
Walrave, B., Talmar, M., Podoynitsyna, K. S., Romme, A. G. L., & Verbong, G. P. J. (2018) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2017.04.011 · Cited by 327
Metadata
- Authors
- Sommer, S. C., & Loch, C. H.
- Venue
- Management Science
- Published
- 2004-10
- Volume
- 50
- Issue
- 10
- Pages
- 1334-1347
- ISSN
- 0025-1909 (ISSN-L)
- 1526-5501
- OpenAlex
- W2105407474
- Cited by
- 390
- References
- 52
- FWCI
- 14.51
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.