The DOI matches its Crossref record; 88 of the 88 references it cites were found in a registry or an index.
Complex Problem Solving: What It Is and What It Is Not
Open accessAbstract
Computer-simulated scenarios have been part of psychological research on problem solving for more than 40 years. The shift in emphasis from simple toy problems to complex, more real-life oriented problems has been accompanied by discussions about the best ways to assess the process of solving complex problems. Psychometric issues such as reliable assessments and addressing correlations with other instruments have been in the foreground of these discussions and have left the content validity of complex problem solving in the background. In this paper, we return the focus to content issues and address the important features that define complex problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Telling more than we can know: Verbal reports on mental processes.
Nisbett, R. E., & Wilson, T. D. (1977) · Psychological Review · doi:10.1037/0033-295x.84.3.231 · Cited by 11,317 · cited 1×
“There are interesting options to be explored (again): thinkaloud protocols, which have been discredited for many years (Nisbett and Wilson, 1977) and yet are a valuable source for theory testing (Ericsson and Simon, 1983); introspection (Jäkel and Schreiber, 2013), which seems to be banned from…”
BackgroundBeyond Big and Little: The Four C Model of Creativity
Kaufman, J. C., & Beghetto, R. A. (2009) · Review of General Psychology · doi:10.1037/a0013688 · Cited by 2,669
Formative assessment: a critical review
Bennett, R. E. (2011) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969594x.2010.513678 · Cited by 1,498
Mechanization in problem solving: The effect of Einstellung.
Luchins, A. S. (1942) · Psychological Monographs · doi:10.1037/h0093502 · Cited by 1,143
Administrative Behavior: A Study of Decision‐Making Processes in Administrative Organizations
Augier, M. (2002) · The Economic Journal · doi:10.1111/1468-0297.t01-17-00050 · Cited by 998
Toward a broader conception of creativity: A case for "mini-c" creativity.
Beghetto, R. A., & Kaufman, J. C. (2007) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/1931-3896.1.2.73 · Cited by 900
Dew, N., Read, S., Sarasvathy, S. D., & Wiltbank, R. (2009) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2008.02.002 · Cited by 829
On the Relationship between Task Performance and Associated Verbalizable Knowledge
Berry, D. C., & Broadbent, D. E. (1984) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640748408402156 · Cited by 759
The Logic Of Failure: Recognizing And Avoiding Error In Complex Situations
Dörner, D. (1997) · Virtual Defense Library (Ministerio de Defensa) · Cited by 654
Self-citationDynamic Decision Theory and Probabilistic Information Processings
Edwards, W. (1962) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872086200400201 · Cited by 410
Wiliam, D., & Black, P. (1996) · British Educational Research Journal · doi:10.1080/0141192960220502 · Cited by 394
Complex Problem Solving: The European Perspective
Frensch, P., & Funke, J. (1995) · heiDOK (Heidelberg University) · doi:10.11588/heidok.00008262 · Cited by 388
Self-citationThe March of Folly: From Troy to Vietnam
Tilly, C., & Tuchman, B. W. (1985) · The American Historical Review · doi:10.2307/1852671 · Cited by 352
Brehmer, B., & Dörner, D. (1993) · Computers in Human Behavior · doi:10.1016/0747-5632(93)90005-d · Cited by 340
Self-citationCognitive processes in well‐defined and ill‐defined problem solving
Schraw, G., Dunkle, M. E., & Bendixen, L. D. (1995) · Applied Cognitive Psychology · doi:10.1002/acp.2350090605 · Cited by 336
Complex problem solving: a case for complex cognition?
Funke, J. (2010) · Cognitive Processing · doi:10.1007/s10339-009-0345-0 · Cited by 329
Self-citationSensible Reasoning: A Hypothesis about Hypotheses
Tschirgi, J. E. (1980) · Child Development · doi:10.1111/j.1467-8624.1980.tb02502.x · Cited by 318
Complex Problem Solving: Principles and Mechanisms
Mayer, R. E., Sternberg, R. J., & Frensch, P. A. (1992) · The American Journal of Psychology · doi:10.2307/1423205 · Cited by 314
On the Difficulties People Have in Dealing With Complexity
Doerner, D. (1980) · Simulation & Games · doi:10.1177/104687818001100108 · Cited by 298
(2016) · Springer eBooks · doi:10.1007/978-3-319-16889-0 · Cited by 284
Clumsy Solutions for a Complex World
(2006) · Palgrave Macmillan UK eBooks · doi:10.1057/9780230624887 · Cited by 276
Controlling uncertainty: A review of human behavior in complex dynamic environments.
Osman, M. (2010) · Psychological Bulletin · doi:10.1037/a0017815 · Cited by 233
Complex problem solving — More than reasoning?
Wüstenberg, S., Greiff, S., & Funke, J. (2012) · Intelligence · doi:10.1016/j.intell.2011.11.003 · Cited by 219
Self-citationDILLON, J. T. (1982) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.1982.tb00326.x · Cited by 206
Dynamic Problem Solving: A New Assessment Perspective
Greiff, S., Wüstenberg, S., & Funke, J. (2012) · Applied Psychological Measurement · doi:10.1177/0146621612439620 · Cited by 175
Self-citationGreiff, S., Holt, D. V., & Funke, J. (2013) · The Journal of Problem Solving · doi:10.7771/1932-6246.1153 · Cited by 174
Self-citationGreiff, S., Wüstenberg, S., Molnár, G., Fischer, A., Funke, J., & Csapó, B. (2013) · Journal of Educational Psychology · doi:10.1037/a0031856 · Cited by 168
Self-citationGreiff, S., Niepel, C., Scherer, R., & Martin, R. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.02.095 · Cited by 165
Complex problem solving and intelligence: A meta-analysis
Stadler, M. J., Becker, N., Gödker, M., Leutner, D., & Greiff, S. (2015) · Intelligence · doi:10.1016/j.intell.2015.09.005 · Cited by 143
Funke, J. (2012) · Springer eBooks · doi:10.1007/978-1-4419-1428-6_685 · Cited by 136
Self-citationSpering, M., Wagener, D., & Funke, J. (2005) · Cognition & Emotion · doi:10.1080/02699930500304886 · Cited by 134
Self-citationDefinitions, traditions, and a general framework for understanding complex problem solving
Frensch, P. A., & Funke, J. (2008) · heiDOK (Heidelberg University) · doi:10.11588/heidok.00008205 · Cited by 121
Self-citationDanner, D., Hagemann, D., Schankin, A., Hager, M., & Funke, J. (2011) · Intelligence · doi:10.1016/j.intell.2011.06.004 · Cited by 112
Self-citation“Improving Intelligence Analysis with Decision Science.”
Dhami, M. K., Mandel, D. R., Mellers, B. A., & Tetlock, P. E. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615598511 · Cited by 104
PSI: A Computational Architecture of Cognition, Motivation, and Emotion
Dörner, D., & Güss, C. D. (2013) · Review of General Psychology · doi:10.1037/a0032947 · Cited by 101
Self-citationAssessing complex problem-solving skills with multiple complex systems
Greiff, S., Fischer, A., Stadler, M. J., & Wüstenberg, S. (2014) · Thinking & Reasoning · doi:10.1080/13546783.2014.989263 · Cited by 100
A multitrait–multimethod study of assessment instruments for complex problem solving
Greiff, S., Fischer, A., Wüstenberg, S., Sonnleitner, P., Brunner, M., & Martin, R. (2013) · Intelligence · doi:10.1016/j.intell.2013.07.012 · Cited by 91
Schweizer, F., Wüstenberg, S., & Greiff, S. (2013) · Learning and Individual Differences · doi:10.1016/j.lindif.2012.12.011 · Cited by 88
The Role of Strategy Knowledge for the Application of Strategies in Complex Problem Solving Tasks
Wüstenberg, S., Stadler, M. J., Hautamäki, J., & Greiff, S. (2014) · Technology Knowledge and Learning · doi:10.1007/s10758-014-9222-8 · Cited by 84
Exploring the Relation between Time on Task and Ability in Complex Problem Solving
Scherer, R., Greiff, S., & Hautamäki, J. (2014) · Intelligence · doi:10.1016/j.intell.2014.10.003 · Cited by 83
Complex cognition: the science of human reasoning, problem-solving, and decision-making
Knauff, M., & Wolf, A. G. (2010) · Cognitive Processing · doi:10.1007/s10339-010-0362-z · Cited by 83
Hotaling, J. M., Fakhari, P., & Busemeyer, J. R. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097086-8.43040-0 · Cited by 81
Kretzschmar, A., Neubert, J., Wüstenberg, S., & Greiff, S. (2015) · Intelligence · doi:10.1016/j.intell.2015.11.004 · Cited by 81
Griffin, P., & Care, E. (2014) · Springer eBooks · doi:10.1007/978-94-017-9395-7_1 · Cited by 79
Strohschneider, S., & Güss, D. (1998) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022198296002 · Cited by 79
Alison, L. J., van den Heuvel, C., Waring, S., Power, N., Long, A., O’Hara, T., & Crego, J. (2012) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343412468113 · Cited by 75
Gobert, J. D., Kim, Y. J., Pedro, M. S., Kennedy, M., & Betts, C. G. (2015) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2015.04.008 · Cited by 73
Funke, J. (1993) · Advances in psychology · doi:10.1016/s0166-4115(08)62663-1 · Cited by 70
Self-citationAssessment of Complex Problem Solving: What We Know and What We Don’t Know
Herde, C. N., Wüstenberg, S., & Greiff, S. (2016) · Applied Measurement in Education · doi:10.1080/08957347.2016.1209208 · Cited by 67
Sometimes less is more: Comparing the validity of complex problem solving measures
Greiff, S., Stadler, M. J., Sonnleitner, P., Wolff, C., & Martin, R. (2015) · Intelligence · doi:10.1016/j.intell.2015.02.007 · Cited by 66
Measuring Performance in Dynamic Decision Making
Danner, D., Hagemann, D., Holt, D. V., Hager, M., Schankin, A., Wüstenberg, S., & Funke, J. (2011) · Journal of Individual Differences · doi:10.1027/1614-0001/a000055 · Cited by 64
Self-citationMetacognition of Problem-Solving Strategies in Brazil, India, and the United States
Güss, C. D., & Wiley, B. D. (2007) · Journal of Cognition and Culture · doi:10.1163/156853707x171793 · Cited by 62
Finite-State Automata: Dynamic Task Environments in Problem-Solving Research
Buchner, A., & Funke, J. (1993) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640749308401068 · Cited by 58
Self-citationMeasuring complex problem solving: the MicroDYN approach
Scheuermann, F. [. ]., & Björnsson, J. [. ]. (2013) · heiDOK (Heidelberg University) · doi:10.11588/heidok.00015502 · Cited by 55
Funke, J. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00739 · Cited by 53
Self-citationNegative affective environments improve complex solving performance
Barth, C. M., & Funke, J. (2009) · Cognition & Emotion · doi:10.1080/02699930903223766 · Cited by 53
Self-citationFactors Affecting Problem Finding Depending on Degree of Structure of Problem Situation
Lee, H., & Cho, Y. (2007) · The Journal of Educational Research · doi:10.3200/joer.101.2.113-125 · Cited by 48
Selten, R., Pittnauer, S., & Hohnisch, M. (2011) · Journal of Behavioral Decision Making · doi:10.1002/bdm.738 · Cited by 39
Introspection in Problem Solving
Jäkel, F., & Schreiber, C. (2013) · The Journal of Problem Solving · doi:10.7771/1932-6246.1131 · Cited by 37
The development and assessment of problem solving in 21st-century schools
Csapó, B., & Funke, J. (2017) · Educational research and innovation · doi:10.1787/9789264273955-3-en · Cited by 36
Self-citationCultural differences in dynamic decision-making strategies in a non-linear, time-delayed task
Güss, C. D., & Dörner, D. (2010) · Cognitive Systems Research · doi:10.1016/j.cogsys.2010.12.003 · Cited by 35
Self-citationYou Cannot Have Your Cake and Eat It, too: How Induced Goal Conflicts Affect Complex Problem Solving
Blech, C., & Funke, J. (2010) · The Open Psychology Journal · doi:10.2174/1874350101003010042 · Cited by 34
Self-citationThe development of complex problem solving in adolescence: A latent growth curve analysis.
Frischkorn, G. T., Greiff, S., & Wüstenberg, S. (2014) · Journal of Educational Psychology · doi:10.1037/a0037114 · Cited by 33
Tracking problem solving by multivariate pattern analysis and Hidden Markov Model algorithms
Anderson, J. R. (2011) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2011.07.025 · Cited by 32
Complex problem solving—single ability or complex phenomenon?
Schoppek, W., & Fischer, A. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01669 · Cited by 29
Easily too difficult: Estimating item difficulty in computer simulated microworlds
Stadler, M. J., Niepel, C., & Greiff, S. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.08.025 · Cited by 29
Trappings of Expertise and the Pursuit of Failure
Ramnarayan, S., Strohschneider, S., & Schaub, H. (1997) · Simulation & Gaming · doi:10.1177/1046878197281004 · Cited by 28
Problem Solving: What Are The Important Questions?
Funke, J. (2014) · CogPrints (University of Southampton) · doi:10.5281/zenodo.268724 · Cited by 27
Self-citationMeasuring complex problem solving: an educational application of psychological theories
Greiff, S., & Fischer, A. (2013) · Open Repository and Bibliography (University of Luxembourg) · doi:10.25656/01:8019 · Cited by 26
Mainert, J., Kretzschmar, A., Neubert, J., & Greiff, S. (2015) · International Journal of Lifelong Education · doi:10.1080/02601370.2015.1060024 · Cited by 26
Assessment With Microworlds using MicroDYN: Measurement Invariance and Latent Mean Comparisons
Greiff, S., & Wüstenberg, S. (2014) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000194 · Cited by 25
The history of complex problem solving
Fischer, A., Greiff, S., & Funke, J. (2017) · Educational research and innovation · doi:10.1787/9789264273955-9-en · Cited by 25
Self-citationSonnleitner, P., Brunner, M., Keller, U., & Martin, R. (2014) · Journal of Educational Psychology · doi:10.1037/a0035506 · Cited by 24
Dynamic Problem Solving: Multiple-Item Testing Based on Minimally Complex Systems
Funke, J., & Greiff, S. (2017) · Methodology of educational measurement and assessment · doi:10.1007/978-3-319-50030-0_25 · Cited by 24
Self-citationBeckmann, J. F., & Goode, N. (2013) · Instructional Science · doi:10.1007/s11251-013-9280-7 · Cited by 23
Promoting the growing field of Dynamic Decision Making
Fischer, A., Holt, D. V., & Funke, J. (2015) · Journal of dynamic decision making · doi:10.11588/jddm.2015.1.23807 · Cited by 23
Self-citationThe Role of Reward in Dynamic Decision Making
Osman, M. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00035 · Cited by 21
Interactive problem solving: Exploring the potential of minimal complex systems
Greiff, S., & Funke, J. (2017) · Educational research and innovation · doi:10.1787/9789264273955-8-en · Cited by 18
Self-citationA cognitive prosthesis for complex decision-making
Tremblay, S., Gagnon, J.-F., Lafond, D., Hodgetts, H. M., Doiron, M., & Jeuniaux, P. P. J. M. H. (2016) · Applied Ergonomics · doi:10.1016/j.apergo.2016.07.009 · Cited by 17
Empirical study of computer-based assessment of domain-general complex problem-solving skills
Molnár, G., Greiff, S., Wüstenberg, S., & Fischer, A. (2017) · Educational research and innovation · doi:10.1787/9789264273955-10-en · Cited by 17
Predicting Complex Problem Solving and school grades with working memory and ability self-concept
Meißner, A., Greiff, S., Frischkorn, G. T., & Steinmayr, R. (2016) · Learning and Individual Differences · doi:10.1016/j.lindif.2016.04.006 · Cited by 16
Context Matters, but How Much? Latent state–trait analysis of cognitive ability assessments
Hermes, M., & Stelling, D. (2016) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12147 · Cited by 16
Dörner, D., & Güss, C. D. (2011) · Review of General Psychology · doi:10.1037/a0022375 · Cited by 13
Self-citationCognitive and Affective Aspects of Creative Option Generation in Everyday Life Situations
Schweizer, T. S., Schmalenberger, K. M., Eisenlohr-Moul, T. A., Mojzisch, A., Kaiser, S., & Funke, J. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01132 · Cited by 12
Self-citationRohe, M. S., Funke, J., Storch, M., & Weber, J. (2016) · Journal of dynamic decision making · doi:10.11588/jddm.2016.1.28510 · Cited by 9
Self-citationSometimes Less Is Not Enough: A Commentary on Greiff et al. (2015)
Kretzschmar, A. (2017) · Journal of Intelligence · doi:10.3390/jintelligence5010004 · Cited by 9
The Heidelberg Inventory of Geographic System Competency Model
Viehrig, K., Siegmund, A., Funke, J., Wüstenberg, S., & Greiff, S. (2017) · Methodology of educational measurement and assessment · doi:10.1007/978-3-319-50030-0_4 · Cited by 6
Self-citation
Cited by
Joksimovic, S., Ifenthaler, D., Marrone, R., De Laat, M., & Siemens, G. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100138 · Cited by 152
Mangaroska, K., Sharma, K., Gašević, D., & Giannakos, M. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12590 · Cited by 100
The Diversity Gap: When Diversity Matters for Knowledge
Sulik, J., Bahrami, B., & Deroy, O. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916211006070 · Cited by 80
Reducing loneliness among migrant and ethnic minority people: a participatory evidence synthesis
Salway, S., Such, E., Preston, L., Booth, A., Zubair, M., Victor, C., & Raghavan, R. (2020) · Public Health Research · doi:10.3310/phr08100 · Cited by 54
Metadata
- Authors
- Dörner, D., & Funke, J.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2017-07-11
- Volume
- 8
- Pages
- 1153-1153
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W2734896486
- Cited by
- 269
- References
- 88
- FWCI
- 29.31
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.