Can Traditional Divergent Thinking Tests Be Trusted in Measuring and Predicting Real-World Creativity?
The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
Abstract
Derived from the psychometric tradition of creativity research, divergent thinking (DT) tests are the major instrument for measuring people's creative potential. Although still prevalent, DT testing has received substantial criticism of its validity and practical value. This article focuses on the issue of how to reliably and validly assess and predict people's real-world creative potential. Based on reviews of the literatures on the concept of creativity, creative thinking process, the psychometric approach, and DT tests, we examine 6 major weaknesses of traditional DT instruments: lack of construct validity; not testing the integrated general creative process; neglect of domain specificity and expertise; and poor predictive, ecological, and discriminant validities. This evaluation calls for development of improved psychometric instruments to better capture people's creativity in specific professional domains of interest. Broadening the conceptions of creativity and assessment instruments should allow development of more realistic models and theories and enable the psychometric approach to studying creativity to thrive.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1994) · Journal of the American Dietetic Association · doi:10.1016/0002-8223(94)92216-0 · Cited by 45,910
The Nature of Human Intelligence
Carroll, J. B., & Guilford, J. P. (1968) · American Educational Research Journal · doi:10.2307/1161820 · Cited by 4,657
The associative basis of the creative process.
Mednick, S. (1962) · Psychological Review · doi:10.1037/h0048850 · Cited by 4,140 · cited 2×
“The development of the WKCT is based on the associative conception of creativity, “the forming of associative elements into new combinations which either meet specified requirements or are in some way useful” (Mednick, 1962 , p.”
MethodThe social psychology of creativity: A componential conceptualization.
Amabile, T. M. (1983) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.45.2.357 · Cited by 4,034
The nature of human intelligence
Fuilford, J. P. (1967) · McGraw-Hill eBooks · Cited by 3,864
Guilford, J. P. (1950) · American Psychologist · doi:10.1037/h0063487 · Cited by 3,588
The Cambridge Handbook of Expertise and Expert Performance
(2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511816796 · Cited by 3,158
Social psychology of creativity: A consensual assessment technique.
Amabile, T. M. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.43.5.997 · Cited by 2,278
(1998) · Handbook of Creativity · doi:10.1017/cbo9780511807916.002 · Cited by 2,212
Amabile, T. M. (1998) · PubMed · Cited by 2,004
The Creative Cognition Approach
(1995) · The MIT Press eBooks · doi:10.7551/mitpress/2205.001.0001 · Cited by 900
Sternberg, R. J., & Lubart, T. I. (1996) · American Psychologist · doi:10.1037/0003-066x.51.7.677 · Cited by 874
Models of the Creative Process: Past, Present and Future
Lubart, T. I. (2001) · Creativity Research Journal · doi:10.1207/s15326934crj1334_07 · Cited by 848
Can We Trust Creativity Tests? A Review of the Torrance Tests of Creative Thinking (TTCT)
Kim, K. H. (2006) · Creativity Research Journal · doi:10.1207/s15326934crj1801_2 · Cited by 830 · cited 6×
“80) that each of them does not provide meaningfully different information (Almeida et al., 2008; Clapham, 1998; Feldhusen & Goh, 1995; Kim, 2006; Mansfield et al., 1978).”
BackgroundMethodInfluentialThe ninth mental measurements yearbook
Mitchell, J. V. (1985) · Medical Entomology and Zoology · Cited by 824
Howard, T. J., Culley, S. J., & Dekoninck, E. (2008) · Design Studies · doi:10.1016/j.destud.2008.01.001 · Cited by 731
Torrance Tests of Creative Thinking
Torrance, E. P. (2012) · PsycTESTS Dataset · doi:10.1037/t05532-000 · Cited by 718
Lateral thinking: Creativity Step by Step
Bono, E. D. (1970) · Medical Entomology and Zoology · Cited by 689
International Journal of Business and Society
(2021) · International Journal of Business and Society · doi:10.33736/ijbs · Cited by 686
Modes of Thinking in Young Children
Shulman, L. S., Wallach, M. A., & Kogan, N. (1966) · American Educational Research Journal · doi:10.2307/1162039 · Cited by 680
Groups, Teams, and Creativity: The Creative Potential of Idea‐generating Groups
Paulus, P. (2000) · Applied Psychology · doi:10.1111/1464-0597.00013 · Cited by 672
Problem Finding, Problem Solving, and Creativity
Runco, M. A. (1994) · Cited by 662
Modes of Thinking in Young Children
Mackie, J. (1966) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-196604000-00018 · Cited by 506
Creativity and Intelligence: Explorations with Gifted Students.
Faris, R. E. L., Getzels, J. W., & Jackson, P. W. (1962) · American Sociological Review · doi:10.2307/2090046 · Cited by 478
Human Factors in Simple and Complex Systems
Proctor, R. W., & Zandt, T. V. (2008) · CRC Press eBooks · doi:10.1201/9781420063608 · Cited by 474
Self-citationHandbook of industrial engineering
(1992) · Choice Reviews Online · doi:10.5860/choice.29-6026 · Cited by 468
Fifty Years of Creativity Research
Mayer, R. E. (1998) · Handbook of Creativity · doi:10.1017/cbo9780511807916.024 · Cited by 443
From Guilford to Creative Synergy: Opening the Black Box of Team-Level Creativity
Kurtzberg, T. R., & Amabile, T. M. (2001) · Creativity Research Journal · doi:10.1207/s15326934crj1334_06 · Cited by 430
Psychometric Approaches to the Study of Human Creativity
Plucker, J. A., & Renzulli, J. S. (1998) · Handbook of Creativity · doi:10.1017/cbo9780511807916.005 · Cited by 423
Is the proof in the pudding? Reanalyses of Torrance׳s (1958 to present) longitudinal data
Plucker, J. A. (1999) · Creativity Research Journal · doi:10.1207/s15326934crj1202_3 · Cited by 390 · cited 6×
“A good many of studies demonstrated that the scoring factors of current DT tests are dependent on contents of subtests (i.e., task sensitive) rather than the claimed four scoring dimensions of creativity (i.e., fluency, flexibility, originality, and elaboration; Kilgour, 2006; Plucker, 1999).”
BackgroundInfluentialA Longitudinal Examination of the Fourth Grade Slump in Creativity
Torrance, E. P. (1968) · Gifted Child Quarterly · doi:10.1177/001698626801200401 · Cited by 381 · cited 2×
“Torrance ( 1968 ) reported discovery of a fourth-grade slump in creativity, as indicated by the measures of TTCT, and concluded that third-grade students are more creative than fourth graders.”
BackgroundMeasurement of Creativity: Review and Critique
Hocevar, D. (1981) · Journal of Personality Assessment · doi:10.1207/s15327752jpa4505_1 · Cited by 378
The Oxford Handbook of Cognitive Psychology
(2013) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780195376746.001.0001 · Cited by 372
(2020) · Encyclopedia of Creativity, Invention, Innovation and Entrepreneurship · doi:10.1007/978-3-319-15347-6_300284 · Cited by 367
Cramond, B., Matthews-Morgan, J., Bandalos, D., & Zuo, L. (2005) · Gifted Child Quarterly · doi:10.1177/001698620504900402 · Cited by 318
Judgments of originality and appropriateness as predictors of creativity
Runco, M. A., & Charles, R. E. (1993) · Personality and Individual Differences · doi:10.1016/0191-8869(93)90337-3 · Cited by 309 · cited 4×
“…of abstract tasks lacking meaningful contexts in conventional DT batteries, the evaluation of ideation quality=appropriateness remains at a surface level, e.g., a brick is judged to be an inappropriate instance of square things simply because bricks are usually rectangular (Runco & Charles, 1993).”
BackgroundInfluentialCreativity and the Finding and Solving of Real-World Problems
Okuda, S. M., Runco, M. A., & Berger, D. E. (1991) · Journal of Psychoeducational Assessment · doi:10.1177/073428299100900104 · Cited by 307
Assessing and Accessing Creativity: An Integrative Review of Theory, Research, and Development
Feldhusen, J., & Goh, B. E. (1995) · Creativity Research Journal · doi:10.1207/s15326934crj0803_3 · Cited by 296
Shneiderman, B. (2002) · Communications of the ACM · doi:10.1145/570907.570945 · Cited by 280
Ericsson, K. A. (1998) · High Ability Studies · doi:10.1080/1359813980090106 · Cited by 275 · cited 2×
“Deliberate practice, the basis for expertise, in turn, is responsible for consistent superior performance that can be considered as creative (Ericsson, 1998 , 1999 ; Weisberg, 2006 ).”
BackgroundCelebrating 50 years of Reflective Practice: Versions of Creative Problem Solving
ISAKSEN, S. G., & TREFFINGER, D. J. (2004) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.2004.tb01234.x · Cited by 257
Torrance Tests of Creative Thinking
(2007) · Encyclopedia of Measurement and Statistics · doi:10.4135/9781412952644.n460 · Cited by 244
Torrance Test of Creative Thinking: The question of its construct validity
Almeida, L. S., Prieto, L. P., Ferrando, M., Oliveira, E., & Ferrándiz, C. (2008) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2008.03.003 · Cited by 231
Analyzing Creative Products: Refinement and Test of a Judging Instrument
BESEMER, S., & O'QUIN, K. (1986) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.1986.tb00426.x · Cited by 230
(Un)Structured Creativity in Information Systems Organizations
Couger, J. D., Higgins, L. F., & McIntyre, S. C. (1993) · MIS Quarterly · doi:10.2307/249584 · Cited by 226
Discovery-oriented behavior and the originality of creative products: A study with artists.
Csikszentmihalyi, M., & Getzels, J. W. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0031106 · Cited by 217
Fostering Creativity in Engineering Undergraduates
Cropley, D. H., & Cropley, A. J. (2000) · High Ability Studies · doi:10.1080/13598130020001223 · Cited by 191
Understanding design as a social creative process
Warr, A., & O'Neill, E. (2005) · Proceedings of the 5th conference on Creativity & cognition - C&C '05 · doi:10.1145/1056224.1056242 · Cited by 189
Creativity: An interdisciplinary perspective
Gardner, H. (1988) · Creativity Research Journal · doi:10.1080/10400418809534284 · Cited by 185
The Effectiveness of Creativity Training
Mansfield, R. S., Busse, T. V., & Krepelka, E. J. (1978) · Review of Educational Research · doi:10.2307/1170047 · Cited by 184
RUNCO, M. A., ILLIES, J. J., & EISENMAN, R. (2005) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.2005.tb01255.x · Cited by 177
Problem finding skills as components in the creative process
O’Neal, I. C., & Runco, M. A. (1993) · Personality and Individual Differences · doi:10.1016/0191-8869(93)90185-6 · Cited by 176
Plucker, J. A., & Runco, M. A. (1998) · Roeper Review · doi:10.1080/02783199809553924 · Cited by 171
The Evaluative, Valuative, and Divergent Thinking of Children*
RUNCO, M. A. (1991) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.1991.tb01143.x · Cited by 168
Consumer-based assessment of product creativity: A review and reappraisal
Horn, D., & Salvendy, G. (2006) · Human Factors and Ergonomics in Manufacturing · doi:10.1002/hfm.20047 · Cited by 152
Self-citationStructure of the Torrance Tests of Creative Thinking
Heausler, N. L., & Thompson, B. (1988) · Educational and Psychological Measurement · doi:10.1177/0013164488482021 · Cited by 145
A review of creativity principles applied to engineering design
Thompson, G., & Lordan, M. (1999) · Proceedings of the Institution of Mechanical Engineers Part E Journal of Process Mechanical Engineering · doi:10.1243/0954408991529960 · Cited by 145
Measuring consumer perception of product creativity: Impact on satisfaction and purchasability
Horn, D. B., & Salvendy, G. (2009) · Human Factors and Ergonomics in Manufacturing & Service Industries · doi:10.1002/hfm.20150 · Cited by 139
Self-citationThe Creative Process: The Effects of Group Memory on Individual Idea Generation
Satzinger, J. W., Garfield, M. J., & Nagasundaram, M. (1999) · Journal of Management Information Systems · doi:10.1080/07421222.1999.11518225 · Cited by 134
Guilford's Structure of Intellect Model and Model of Creativity: Contributions and Limitations
Sternberg, R. J., & Grigorenko, E. L. (2001) · Creativity Research Journal · doi:10.1207/s15326934crj1334_08 · Cited by 134
Insights about creativity: Questioned, rejected, ridiculed, ignored
Torrance, E. P. (1995) · Educational Psychology Review · doi:10.1007/bf02213376 · Cited by 131
(1999) · Psychological Inquiry · doi:10.1207/s15327965pli1004_5 · Cited by 119
Long-term Predictive Validity of Divergent-thinking Tests: Some Negative Evidence.
Kogan, N., & Pankove, E. (1974) · Journal of Educational Psychology · doi:10.1037/h0021521 · Cited by 111
Evaluating the creativity of children's ideas.
Runco, M. A., & Vega, L. (1990) · Journal of social behavior and personality · Cited by 106
Modes of Expertise in Creative Thinking: Evidence from Case Studies
Weisberg, R. W. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511816796.042 · Cited by 105
Process-Based Measures of Creative Problem-Solving Skills: V. Overall Prediction
Mumford, M. D., Supinski, E. P., Baughman, W. A., Costanza, D. P., & Threlfall, K. V. (1997) · Creativity Research Journal · doi:10.1207/s15326934crj1001_8 · Cited by 104
Structure of Figural Forms A and B of the Torrance Tests of Creative Thinking
Clapham, M. M. (1998) · Educational and Psychological Measurement · doi:10.1177/0013164498058002010 · Cited by 80
Creativity Tests: A Boon or Boondoggle for Education?
Crockenberg, S. B. (1972) · Review of Educational Research · doi:10.3102/00346543042001027 · Cited by 74
The Outlook for Creativity Tests*
Wakefield, J. F. (1991) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.1991.tb01369.x · Cited by 71
Factor structure of web site creativity
Zeng, L., Salvendy, G., & Zhang, M. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2008.12.023 · Cited by 70
Self-citationWho is creative? Identifying children's creative abilities
Fishkin, A. S., & Johnson, A. S. (1998) · Roeper Review · doi:10.1080/02783199809553925 · Cited by 61
Measurement of creativity of IS products
Couger, J. D., & Dengate, G. (1992) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.1992.183347 · Cited by 51
Zeng, L., Proctor, R. W., & Salvendy, G. (2010) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376056 · Cited by 50
Self-citationKilgour, A. M. (2006) · Research Commons (University of Waikato) · Cited by 41
Creativity in MS/OR: Managing the Process of Formulating the Problem
Volkema, R. J. (1995) · INFORMS Journal on Applied Analytics · doi:10.1287/inte.25.3.81 · Cited by 30
Zeng, L., Proctor, R. W., & Salvendy, G. (2009) · Service Science · doi:10.1287/serv.1.3.142 · Cited by 29
Self-citationDoes Artistic Creativity Decline during Elementary School?
Baer, J. (1996) · Psychological Reports · doi:10.2466/pr0.1996.78.3.927 · Cited by 24
Creativity and Design: Creativity's New Definition and Its Relationship to Design
Brougher, S. J., & Rantanen, E. M. (2009) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120905301005 · Cited by 10
Cited by
Automating creativity assessment with SemDis: An open platform for computing semantic distance
Beaty, R. E., & Johnson, D. R. (2021) · Behavior Research Methods · doi:10.3758/s13428-020-01453-w · Cited by 341
Are creative ideas novel and useful?
Diedrich, J., Benedek, M., Jauk, E., & Neubauer, A. C. (2015) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/a0038688 · Cited by 314
Creative and critical thinking: Independent or overlapping components?
Wechsler, S. M., Saiz, C., Rivas, S. F., Vendramini, C. M. M., Almeida, L. S., Mundim, M. C., & Franco, A. (2018) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2017.12.003 · Cited by 266
Hwang, G.-J., Lai, C.-L., Liang, J.-C., Chu, H.-C., & Tsai, C.-C. (2018) · Educational Technology Research and Development · doi:10.1007/s11423-017-9540-3 · Cited by 186
de Rooij, A., & Vromans, R. D. (2020) · The Journal of Creative Behavior · doi:10.1002/jocb.379 · Cited by 31
“The cued versions of the AUT and RAT differ from the original versions, including more time pressure and interruptions in the thinking processes to accommodate for an experimental set-up suitable for eye-tracking experiments.”
BackgroundMethodInfluential
Metadata
- Authors
- Zeng, L., Proctor, R. W., & Salvendy, G.
- Venue
- Creativity Research Journal
- Publisher
- Informa UK Limited
- Published
- 2011-02-04
- Volume
- 23
- Issue
- 1
- Pages
- 24-37
- ISSN
- 1040-0419 (ISSN-L)
- 1532-6934
- OpenAlex
- W2119020671
- Cited by
- 319
- References
- 78
- FWCI
- 16.61
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.