Search on Rugged Landscapes: An Experimental Study
Open accessAbstract
This paper presents findings from a laboratory experiment on human decision-making in a complex combinatorial task. We draw on the canonical NK model to depict tasks with varying complexity and find strong evidence for a behavioral model of adaptive search. Success narrows down search to the neighborhood of the status quo, while failure promotes gradually more explorative search. Task complexity does not have a direct effect on behavior, but systematically affects the feedback conditions that guide success-induced exploitation and failure-induced exploration. The analysis also shows that human participants were prone to over-exploration, since they broke off the search for local improvements too early. We derive stylized decision rules that generate the search behavior observed in the experiment and discuss the implications of our findings for individual decision-making and organizational search.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The NK model is suitable for depicting interdependent variables in managerial problems.
“The solution space is adapted from the NK model [24] which is deemed suitable because it depicts the interdependent variables in managerial problems [5, 9, 15, 17].”
From Closed-mindedness and insulation in groupthink: their effects and the devil’s advocacy as a preventive measure (2021) · cites this paper as [5]
The proposed model is based on the abstraction of group decision making as a search over the NK landscape, which is suitable because it captures the interdependent variables nature of managerial decision problems and is relevant to decision making in realistic situations.
“The proposed model is based on the abstraction of group decision making as a search over the NK landscape which is suitable because it captures the interdependent variables nature of managerial decision problems [5, 9, 15, 17] and relevant to decision making in the realistic situations [5, 17].”
From Closed-mindedness and insulation in groupthink: their effects and the devil’s advocacy as a preventive measure (2021) · cites this paper as [5]
The NK model has been proven to be empirically relevant and plausible in explaining and predicting decision making under realistic situations.
“Besides, the NK model also has been proven to be empirically relevant and plausible not only in explaining but also in predicting decision making under realistic situations [5, 17].”
From Closed-mindedness and insulation in groupthink: their effects and the devil’s advocacy as a preventive measure (2021) · cites this paper as [5]
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524 · see citing works
Exploration and Exploitation in Organizational Learning
March, J. G. (1991) · Organization Science · doi:10.1287/orsc.2.1.71 · Cited by 21,942 · cited 1× · see citing works
“The experimental design thereby captures the exploration-exploitation tradeoff (March 1991).”
BackgroundError Detecting and Error Correcting Codes
Hamming, R. W. (1950) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1950.tb00463.x · Cited by 5,377 · see citing works
Stigler, G. J. (1961) · Journal of Political Economy · doi:10.1086/258464 · Cited by 5,263 · see citing works
Towards a dynamic theory of strategy
Porter, M. E. (1991) · Strategic Management Journal · doi:10.1002/smj.4250121008 · Cited by 3,950 · see citing works
Bounded rationality and organizational learning
Simon, H. A. (1991) · Organization Science · doi:10.1287/orsc.2.1.125 · Cited by 3,028 · see citing works
Rational Decision-Making in Business OrganizationsPreprint
Simon, H. A. (1979) · RePEc: Research Papers in Economics · Cited by 2,912 · see citing works
Recombinant Uncertainty in Technological Search
Fleming, L. (2001) · Management Science · doi:10.1287/mnsc.47.1.117.10671 · Cited by 2,893 · see citing works
Adaptation on Rugged Landscapes
Levinthal, D. A. (1997) · Management Science · doi:10.1287/mnsc.43.7.934 · Cited by 2,254 · see citing works
Looking Forward and Looking Backward: Cognitive and Experiential Search
Gavetti, G., & Levinthal, D. A. (2000) · Administrative Science Quarterly · doi:10.2307/2666981 · Cited by 2,032 · see citing works
Bounded Rationality and Organizational Learning
Simon, H. A. (1999) · Reflections The SoL Journal · doi:10.1162/152417399570142 · Cited by 2,027 · see citing works
Markowitz, H. M. (1952) · Journal of Political Economy · doi:10.1086/257177 · Cited by 1,814 · see citing works
Science as a map in technological search
Fleming, L., & Sorenson, O. (2004) · Strategic Management Journal · doi:10.1002/smj.384 · Cited by 1,407 · see citing works
A model of adaptive organizational search
Levinthal, D. A., & March, J. G. (1981) · Journal of Economic Behavior & Organization · doi:10.1016/0167-2681(81)90012-3 · Cited by 1,337 · see citing works
Imitation of Complex Strategies
Rivkin, J. W. (2000) · Management Science · doi:10.1287/mnsc.46.6.824.11940 · Cited by 1,324 · see citing works
Organizational Learning from Performance Feedback
Greve, H. R. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511615139 · Cited by 1,029 · see citing works
Siggelkow, N., & Levinthal, D. A. (2003) · Organization Science · doi:10.1287/orsc.14.6.650.24870 · Cited by 953 · see citing works
New human resource management practices, complementarities and the impact on innovation performance
Laursen, K. (2003) · Cambridge Journal of Economics · doi:10.1093/cje/27.2.243 · Cited by 950 · see citing works
Balancing Search and Stability: Interdependencies Among Elements of Organizational Design
Rivkin, J. W., & Siggelkow, N. (2003) · Management Science · doi:10.1287/mnsc.49.3.290.12740 · Cited by 900 · see citing works
Modularity and Innovation in Complex Systems
Ethiraj, S. K., & Levinthal, D. A. (2004) · Management Science · doi:10.1287/mnsc.1030.0145 · Cited by 855 · see citing works
Variable risk preferences and the focus of attention.
March, J. G., & Shapira, Z. (1992) · Psychological Review · doi:10.1037/0033-295x.99.1.172 · Cited by 777 · see citing works
Cognition and Hierarchy: Rethinking the Microfoundations of Capabilities’ Development
Gavetti, G. (2005) · Organization Science · doi:10.1287/orsc.1050.0140 · Cited by 719 · see citing works
The NK model of rugged fitness landscapes and its application to maturation of the immune response
Kauffman, S. A., & Weinberger, E. D. (1989) · Journal of Theoretical Biology · doi:10.1016/s0022-5193(89)80019-0 · Cited by 674 · see citing works
CHANGE IN THE PRESENCE OF FIT: THE RISE, THE FALL, AND THE RENAISSANCE OF LIZ CLAIBORNE.
Siggelkow, N. (2001) · Academy of Management Journal · doi:10.2307/3069418 · Cited by 625 · see citing works
The economics of strategic opportunity
Denrell, J. C., Fang, C., & Winter, S. G. (2003) · Strategic Management Journal · doi:10.1002/smj.341 · Cited by 613 · see citing works
<i>A Behavioral Theory of the Firm</i>—40 Years and Counting: Introduction and Impact
Argote, L., & Greve, H. R. (2007) · Organization Science · doi:10.1287/orsc.1070.0280 · Cited by 606 · see citing works
OPEN VERSUS CLOSED INNOVATION: A MODEL OF DISCOVERY AND DIVERGENCE.
Almirall, E., & Casadesus‐Masanell, R. (2010) · Academy of Management Review · doi:10.5465/amr.2010.45577790 · Cited by 535 · see citing works
On the Origin of Strategy: Action and Cognition over Time
Gavetti, G., & Rivkin, J. W. (2007) · Organization Science · doi:10.1287/orsc.1070.0282 · Cited by 424 · see citing works
Two Faces of Search: Alternative Generation and Alternative Evaluation
Knudsen, T., & Levinthal, D. A. (2007) · Organization Science · doi:10.1287/orsc.1060.0216 · Cited by 411 · see citing works
Selectionism and Learning in Projects with Complexity and Unforeseeable Uncertainty
Sommer, S. C., & Loch, C. H. (2004) · Management Science · doi:10.1287/mnsc.1040.0274 · Cited by 391 · see citing works
Variable risk preferences and adaptive aspirations
March, J. G. (1988) · Journal of Economic Behavior & Organization · doi:10.1016/0167-2681(88)90004-2 · Cited by 344 · see citing works
When Exploration Backfires: Unintended Consequences of Multilevel Organizational Search
Siggelkow, N., & Rivkin, J. W. (2006) · Academy of Management Journal · doi:10.5465/amj.2006.22083053 · Cited by 297 · see citing works
Problem–Solving Oscillations in Complex Engineering Projects
Mihm, J., Loch, C. H., & Huchzermeier, A. (2003) · Management Science · doi:10.1287/mnsc.49.6.733.16021 · Cited by 296 · see citing works
A behavioral approach to strategy—what's the alternative?
Levinthal, D. A. (2011) · Strategic Management Journal · doi:10.1002/smj.963 · Cited by 295 · see citing works
Designing Economic Agents that Act Like Human Agents: A Behavioral Approach to Bounded Rationality
Arthur, W. B. (1991) · American Economic Review · Cited by 262 · see citing works
Optimal search on a technology landscape
Kauffman, S. A., Lobo, J., & Macready, W. G. (2000) · Journal of Economic Behavior & Organization · doi:10.1016/s0167-2681(00)00114-1 · Cited by 256 · see citing works
Interdependence and Adaptability: Organizational Learning and the Long–Term Effect of Integration
Sorenson, O. (2003) · Management Science · doi:10.1287/mnsc.49.4.446.14418 · Cited by 255 · see citing works
Job Search and Hyperbolic Discounting: Structural Estimation and Policy Evaluation
Paserman, M. D. (2008) · The Economic Journal · doi:10.1111/j.1468-0297.2008.02175.x · Cited by 250 · see citing works
Managing Complexity and Unforeseeable Uncertainty in Startup Companies: An Empirical Study
Sommer, S. C., Loch, C. H., & Dong, J. (2008) · Organization Science · doi:10.1287/orsc.1080.0369 · Cited by 239 · see citing works
Controlling uncertainty: A review of human behavior in complex dynamic environments.
Osman, M. (2010) · Psychological Bulletin · doi:10.1037/a0017815 · Cited by 234 · see citing works
R-Squared Measures for Count Data Regression Models with Applications to Health-Care Utilization
Cameron, A. C., & Windmeijer, F. A. G. (1996) · Journal of Business and Economic Statistics · doi:10.2307/1392433 · Cited by 223 · see citing works
Testing a Causal Model of Corporate Risk Taking and Performance
Bromiley, P. (1991) · Academy of Management Journal · doi:10.5465/256301 · Cited by 189 · see citing works
Testing Behavioral Simulation Models by Direct Experiment
Sterman, J. D. (1987) · Management Science · doi:10.1287/mnsc.33.12.1572 · Cited by 172 · see citing works
Myopia of Selection: Does Organizational Adaptation Limit the Efficacy of Population Selection?
Levinthal, D. A., & Posen, H. E. (2007) · Administrative Science Quarterly · doi:10.2189/asqu.52.4.586 · Cited by 160 · see citing works
Innovation, Evolution and Complexity Theory
Frenken, K. (2006) · Edward Elgar Publishing eBooks · doi:10.4337/9781781956410 · Cited by 158 · see citing works
Bromiley, P. (2010) · Strategic Management Journal · doi:10.1002/smj.885 · Cited by 130 · see citing works
Hey, J. D. (1982) · Journal of Economic Behavior & Organization · doi:10.1016/0167-2681(82)90004-x · Cited by 130 · see citing works
Interdependency, Competition, and Industry Dynamics
Lenox, M. J., Rockart, S. F., & Lewin, A. Y. (2007) · Management Science · doi:10.1287/mnsc.1060.0679 · Cited by 127 · see citing works
Schumpeter, Winter, and the sources of novelty
Becker, M. C., Knudsen, T., & March, J. G. (2006) · Industrial and Corporate Change · doi:10.1093/icc/dtl003 · Cited by 122 · see citing works
NK modeling methodology in the strategy literature: Bounded search on a rugged landscape
Ganco, M., & Hoetker, G. (2009) · Research methodology in strategy and management · doi:10.1108/s1479-8387(2009)0000005010 · Cited by 94 · see citing works
Choice Interactions and Business Strategy
Ghemawat, P., & Levinthal, D. A. (2008) · Management Science · doi:10.1287/mnsc.1080.0883 · Cited by 92 · see citing works
Does interdependency affect firm and industry profitability? an empirical test
Lenox, M. J., Rockart, S. F., & Lewin, A. Y. (2009) · Strategic Management Journal · doi:10.1002/smj.811 · Cited by 86 · see citing works
Hey, J. D. (1987) · Journal of Economic Behavior & Organization · doi:10.1016/0167-2681(87)90026-6 · Cited by 80 · see citing works
How Do People Learn to Allocate Resources? Comparing Two Learning Theories.
Rieskamp, J., Busemeyer, J. R., & Laine, T. (2003) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.29.6.1066 · Cited by 54 · see citing works
Behavioral heterogeneity in dynamic search situations: Theory and experimental evidence
Schunk, D. (2009) · Journal of Economic Dynamics and Control · doi:10.1016/j.jedc.2009.03.006 · Cited by 48 · see citing works
An adaptive approach to resource allocation
Busemeyer, J. R., Swenson, K. N., & Lazarte, A. A. (1986) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(86)90004-x · Cited by 38 · see citing works
Resource allocation decision making in an uncertain environment
Busemeyer, J. R., & Myung, I. J. (1987) · Acta Psychologica · doi:10.1016/0001-6918(87)90015-1 · Cited by 31 · see citing works
Complexity, Bounded Rationality and Heuristic Search
MacLeod, W. B. (2001) · Contributions in Economic Analysis & Policy · doi:10.2202/1538-0645.1059 · Cited by 26 · see citing works
What kind of assumptions need to be realistic and how to test them: A response to Tsang (2006)
Lam, S. Y. (2009) · Strategic Management Journal · doi:10.1002/smj.832 · Cited by 25 · see citing works
Aspiration uncertainty: its impact on decision performance and process
MacLeod, W. B., & Pingle, M. (2004) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2004.04.003 · Cited by 20 · see citing works
Binary choice and the supply of memory
Winter, S. G. (1982) · Journal of Economic Behavior & Organization · doi:10.1016/0167-2681(82)90007-5 · Cited by 8 · see citing works
Tailoring mutation to landscape properties
Macready, W. G. (1998) · Lecture notes in computer science · doi:10.1007/bfb0040788 · Cited by 5 · see citing works
Chapter 36 Laboratory Tests of Job Search Models
Cox, J. C., & Oaxaca, R. L. (2008) · Handbook of experimental economics results · doi:10.1016/s1574-0722(07)00036-4 · Cited by 5 · see citing works
Page, S. E. (1996) · Economic Theory · doi:10.1007/s001990050094 · Cited by 5 · see citing works
Towards a Descriptive Model of Agent Strategy SearchPreprint
Edmonds, B. (1999) · SSRN Electronic Journal · doi:10.2139/ssrn.185816 · Cited by 3 · see citing works
Eisenhardt, K. M., & Martin, J. A. (2000) · Strategic Management Journal · doi:10.1002/1097-0266(200010/11)21:10/11
Flagged first, then by citations
Cited by
Sorted by citations
Learning while (re)configuring: Business model innovation processes in established firms
Berends, H., Smits, A., Reymen, I., & Podoynitsyna, K. (2016) · Strategic Organization · doi:10.1177/1476127016632758 · Cited by 274 · see citing works
Akhmad, M., Chang, S., & Deguchi, H. (2021) · Journal of Computational Social Science · doi:10.1007/s42001-020-00083-8 · Cited by 18 · see citing works
“The proposed model is based on the abstraction of group decision making as a search over the NK landscape which is suitable because it captures the interdependent variables nature of managerial decision problems [5, 9, 15, 17] and relevant to decision making in the realistic situations [5, 17].”
BackgroundMethod
- Authors
- Billinger, S., Stieglitz, N., & Schumacher, T. R.
- Affiliations
- University of Southern Denmark (DK)
- Rose–Hulman Institute of Technology (US)
- Corresponding author
- Billinger, Stephan
- ORCID
- Billinger, Stephan
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2010
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W1480404284
- Cited by
- 54
- References
- 66
- Citations by year
- 2022: 1 · 2021: 9 · 2020: 11 · 2019: 5 · 2018: 10 · 2017: 7 · 2016: 3 · 2015: 2 · 2014: 5 · 2013: 1
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- SSRN Electronic Journal (acceptedVersion)
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Social Sciences › Safety Research › Experimental Behavioral Economics Studies
- Social Sciences › Decision Sciences › Management Science and Operations Research › Complex Systems and Decision Making
- Keywords
- adaptive search, NK model, combinatorial search, task complexity, exploration and exploitation, status quo, feedback effects, decision rules, organizational search, human decision-making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review