Naming unrelated words predicts creativity
Open accessPublished version of a preprint
The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Abstract
Significance: Many traditional measures of creativity require time-intensive and subjective scoring procedures. Their scores are relative to the specific sample, which makes multicultural or international assessments difficult. Our results show that a shorter and simpler task with automatic and objective scoring may be at least as reliable at measuring verbal creativity. This finding enables assessments across larger and more diverse samples with less bias.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“First, having access to generative AI effectively equalizes the evaluations of stories, removing any disadvantage or advantage based on the writers’ inherent creativity (25).”
From Generative artificial intelligence enhances creativity but reduces the diversity of novel content (2023) · cites this paper as [25]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · cited 5×
“For simplicity, we chose a pretrained model that is freely available (35).”
MethodInfluentialThe associative basis of the creative process.
Mednick, S. (1962) · Psychological Review · doi:10.1037/h0048850 · Cited by 4,140 · cited 1×
“Although the precise mechanism underlying this link is unclear, the DAT may indirectly measure the extent or efficiency of the association network, as suggested by associative (3, 4, 6) and executive control theories (2, 20).”
BackgroundThe standard definition of creativity
Runco, M. A., & Jaeger, G. J. (2012) · Creativity Research Journal · doi:10.1080/10400419.2012.650092 · Cited by 3,895 · cited 1×
“• flexibility, the number of distinct categories of uses generated; • originality, how rare each use is relative to the rest of the sample, which is particularly important for creativity (17, 18); and • fluency, how many uses are generated in total.”
BackgroundGuilford, J. P. (1950) · American Psychologist · doi:10.1037/h0063487 · Cited by 3,588
Creativity In Context: Update To The Social Psychology Of Creativity
Amabile, T. M. (1996) · Cited by 3,218
Reliability, Validity, and Factor Structure of the Creative Achievement Questionnaire
Carson, S. H., Peterson, J. B., & Higgins, D. M. (2005) · Creativity Research Journal · doi:10.1207/s15326934crj1701_4 · Cited by 1,023 · cited 1×
“Related measures could include memory retrieval ability, fluid intelligence, or real-world creative achievement (1, 2, 51, 52).”
BackgroundSilvia, P. J., Winterstein, B. P., Willse, J. T., Barona, C. M., Cram, J. T., Hess, K. I., Martinez, J. L., & Richard, C. A. (2008) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/1931-3896.2.2.68 · Cited by 912 · cited 2×
“The scoring is laborious and time intensive (11), and multiple judges are required to assess reliability, which adds to the effort (25).”
BackgroundGender Differences in Creativity
BAER, J., & KAUFMAN, J. C. (2008) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.2008.tb01289.x · Cited by 665 · cited 1×
“For example, studies are inconclusive about the impact of gender differences (40, 41).”
BackgroundNormative data for 144 compound remote associate problems
Bowden, E. M., & Jung-Beeman, M. (2003) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195543 · Cited by 649
The roles of associative and executive processes in creative cognition
Beaty, R. E., Silvia, P. J., Nusbaum, E. C., Jauk, E., & Benedek, M. (2014) · Memory & Cognition · doi:10.3758/s13421-014-0428-8 · Cited by 448 · cited 5×
“Related measures could include memory retrieval ability, fluid intelligence, or real-world creative achievement (1, 2, 51, 52).”
BackgroundInfluentialLee, C. S., & Therriault, D. J. (2013) · Intelligence · doi:10.1016/j.intell.2013.04.008 · Cited by 402 · cited 1×
“Related measures could include memory retrieval ability, fluid intelligence, or real-world creative achievement (1, 2, 51, 52).”
BackgroundCreativity in Context: Update to The Social Psychology of Creativity
Amabile, T. M., Amabile, T. M., Collins, M. A., Conti, R., Phillips, E., Picariello, M., Ruscio, J., & Whitney, D. (2018) · doi:10.4324/9780429501234 · Cited by 399
Investigating the structure of semantic networks in low and high creative persons
Kenett, Y. N., Anaki, D., & Faust, M. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00407 · Cited by 392 · cited 1×
“Although the precise mechanism underlying this link is unclear, the DAT may indirectly measure the extent or efficiency of the association network, as suggested by associative (3, 4, 6) and executive control theories (2, 20).”
BackgroundScoring divergent thinking tests: A review and systematic framework.
Reiter-Palmon, R., Forthmann, B., & Barbot, B. (2019) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/aca0000227 · Cited by 391 · cited 1×
“Further, the scoring is sample dependent (23, 25); originality is scored in a relative, nonabsolute manner.”
BackgroundAssociative abilities underlying creativity.
Benedek, M., Könen, T., & Neubauer, A. C. (2012) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/a0027059 · Cited by 354 · cited 1×
“Researchers have successfully automated the scoring of a broad range of creativity measures that examine noun–verb pairs (28), synonyms (29), and chains of word associations (12, 30).”
BackgroundAutomating creativity assessment with SemDis: An open platform for computing semantic distance
Beaty, R. E., & Johnson, D. R. (2021) · Behavior Research Methods · doi:10.3758/s13428-020-01453-w · Cited by 341 · cited 3×
“Many of these computational methods can generate scores similar to human ratings, including on the Alternative Uses Task (11, 17, 26, 27).”
MethodCreating metaphors: the neural basis of figurative language production
Benedek, M., Beaty, R., Jauk, E., Koschutnig, K., Fink, A., Silvia, P. J., Dunst, B., & Neubauer, A. C. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.12.046 · Cited by 328 · cited 1×
“Researchers have successfully automated the scoring of a broad range of creativity measures that examine noun–verb pairs (28), synonyms (29), and chains of word associations (12, 30).”
BackgroundLandauer, T. K., Laham, D., Rehder, B., & Schreiner, M. (1997) · eScholarship (California Digital Library) · Cited by 323
Mental illness, suicide and creativity: 40-Year prospective total population study
Kyaga, S., Landén, M., Boman, M., Hultman, C. M., Långström, N., & Lichtenstein, P. (2013) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2012.09.010 · Cited by 303 · cited 1×
“DAT scores may thus partly reflect other constructs more related to divergence than creativity, such as overinclusive thinking or schizotypy (46).”
BackgroundA Semantic Network Cartography of the Creative Mind
Kenett, Y. N., & Faust, M. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.01.007 · Cited by 276 · cited 1×
“Although the precise mechanism underlying this link is unclear, the DAT may indirectly measure the extent or efficiency of the association network, as suggested by associative (3, 4, 6) and executive control theories (2, 20).”
BackgroundRelations of creative responses to working time and instructions
Christensen, P. R., Guilford, J. P., & Wilson, R. C. (1957) · Journal of Experimental Psychology · doi:10.1037/h0045461 · Cited by 263 · cited 2×
“85 89 94 98 90 95 Low (50) Average (78) High (95)”
BackgroundBenedek, M., & Neubauer, A. C. (2013) · The Journal of Creative Behavior · doi:10.1002/jocb.35 · Cited by 256 · cited 2×
“Higher scores would demonstrate a greater ability to draw upon more remote associations (3–5) or to inhibit overly related associations (2, 7).”
BackgroundDivergent thinking: New methods, recent research, and extended theory.
Acar, S., & Runco, M. A. (2019) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/aca0000231 · Cited by 245
Gender and creativity: an overview of psychological and neuroscientific literature
Abraham, A. (2016) · Brain Imaging and Behavior · doi:10.1007/s11682-015-9410-8 · Cited by 238 · cited 1×
“Abraham (42) reports highly mixed findings, with approximately half of studies reporting no differences in creativity by gender and the other half reporting mixed results, with possibly higher scores in women.”
ResultBenedek, M., Kenett, Y. N., Umdasch, K., Anaki, D., Faust, M., & Neubauer, A. C. (2017) · Thinking & Reasoning · doi:10.1080/13546783.2016.1278034 · Cited by 229 · cited 3×
“Choosing these words relies on generating remote associations while inhibiting common ones, according to two dominant theories of creativity (1, 2).”
BackgroundBenedek, M., Mühlmann, C., Jauk, E., & Neubauer, A. C. (2013) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/a0033644 · Cited by 222 · cited 1×
“Although the precise mechanism underlying this link is unclear, the DAT may indirectly measure the extent or efficiency of the association network, as suggested by associative (3, 4, 6) and executive control theories (2, 20).”
BackgroundAssessing Associative Distance Among Ideas Elicited by Tests of Divergent Thinking
Acar, S., & Runco, M. A. (2014) · Creativity Research Journal · doi:10.1080/10400419.2014.901095 · Cited by 195 · cited 4×
“Compared with manual scoring, computational methods may also clarify the theoretical grounding of the measures since the assumptions required to score the responses must be made explicit in the program code (11, 13).”
BackgroundMethodInfluentialExploring the effect of microdosing psychedelics on creativity in an open-label natural setting
Prochazkova, L., Lippelt, D. P., Colzato, L. S., Kuchar, M., Sjoerds, Z., & Hommel, B. (2018) · Psychopharmacology · doi:10.1007/s00213-018-5049-7 · Cited by 177 · cited 1×
“Its simplicity may also make it suitable for completion in altered states of consciousness conducive to divergent thinking, such as presleep states or when using psychedelic drugs (48, 49).”
BackgroundCognitive Abilities Involved in Insight Problem Solving: An Individual Differences Model
DeYoung, C. G., Flanders, J. L., & Peterson, J. B. (2008) · Creativity Research Journal · doi:10.1080/10400410802278719 · Cited by 175 · cited 1×
“Using a common method of scoring (16), raters then judge the responses based on three components:”
Method“Forward flow”: A new measure to quantify free thought and predict creativity.
Gray, K., Anderson, S., Chen, E. E., Kelly, J. M., Christian, M. S., Patrick, J., Huang, L., Kenett, Y. N., & Lewis, K. (2019) · American Psychologist · doi:10.1037/amp0000391 · Cited by 172 · cited 1×
“Researchers have successfully automated the scoring of a broad range of creativity measures that examine noun–verb pairs (28), synonyms (29), and chains of word associations (12, 30).”
BackgroundA new look at the creativity‐intelligence distinction1
Wallach, M. A., & Kogan, N. (1965) · Journal of Personality · doi:10.1111/j.1467-6494.1965.tb01391.x · Cited by 169 · cited 3×
“In the Alternative Uses Task, participants were presented with common objects in a random order: a brick, paper clip, newspaper, ice tray, and rubber band (15).”
BackgroundMethodSilvia, P. J. (2010) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2010.06.001 · Cited by 167
Tripping on nothing: placebo psychedelics and contextual factors
Olson, J. A., Suissa-Rocheleau, L., Lifshitz, M., Raz, A., & Veissière, S. P. L. (2020) · Psychopharmacology · doi:10.1007/s00213-020-05464-5 · Cited by 164 · cited 2×
“In our initial testing (54), this amount of time was sufficient to complete the task without much time pressure.”
BackgroundSelf-citationDo creative people use shorter associative pathways?
Rossmann, E., & Fink, A. (2010) · Personality and Individual Differences · doi:10.1016/j.paid.2010.07.025 · Cited by 161
Dumas, D., Organisciak, P., & Doherty, M. (2021) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/aca0000319 · Cited by 158 · cited 6×
“Many of these computational methods can generate scores similar to human ratings, including on the Alternative Uses Task (11, 17, 26, 27).”
BackgroundMethodInfluentialThin slices of creativity: Using single-word utterances to assess creative cognition
Prabhakaran, R., Green, A. E., & Gray, J. R. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0401-7 · Cited by 156 · cited 1×
“Researchers have successfully automated the scoring of a broad range of creativity measures that examine noun–verb pairs (28), synonyms (29), and chains of word associations (12, 30).”
BackgroundHypnagogia : the unique state of consciousness between wakefulness and sleep
Mavromatis, A. (1987) · Cited by 147
Semantic search during divergent thinking
Hass, R. W. (2017) · Cognition · doi:10.1016/j.cognition.2017.05.039 · Cited by 142 · cited 1×
“Compared with manual scoring, computational methods may also clarify the theoretical grounding of the measures since the assumptions required to score the responses must be made explicit in the program code (11, 13).”
MethodAssociative processing and paranormal belief
Gianotti, L. R. R., Mohr, C., Pizzagalli, D., Lehmann, D., & Brugger, P. (2001) · Psychiatry and Clinical Neurosciences · doi:10.1046/j.1440-1819.2001.00911.x · Cited by 130 · cited 8×
“Participants also completed the Bridge-the-Associative-Gap Task, a test of convergent thinking in which participants see two words (e.g., giraffe and scarf) and need to find a third one that relates to both (e.g., neck).”
MethodInfluentialScoring divergent thinking tests by computer with a semantics-based algorithm
Beketayev, K., & Runco, M. A. (2016) · Europe’s Journal of Psychology · doi:10.5964/ejop.v12i2.1127 · Cited by 107 · cited 3×
“• flexibility, the number of distinct categories of uses generated; • originality, how rare each use is relative to the rest of the sample, which is particularly important for creativity (17, 18); and • fluency, how many uses are generated in total.”
BackgroundMethodOnce more with feeling: Normative data for the aha experience in insight and noninsight problems
Webb, M. E., Little, D. R., & Cropper, S. J. (2017) · Behavior Research Methods · doi:10.3758/s13428-017-0972-9 · Cited by 106 · cited 1×
“In Study 2, we tested how these scores vary by demographics and whether they correlate with other measures related to divergent thinking in a larger dataset (9, 37).”
BackgroundSelf-citationPlucker, J. A., Qian, M., & Schmalensee, S. (2014) · Creativity Research Journal · doi:10.1080/10400419.2014.901023 · Cited by 101
Effects of intellectual variables, age, and gender on divergent thinking in adulthood
Reese, H. W., Lee, L.-J., Cohen, S. H., & Puckett, J. M. (2001) · International Journal of Behavioral Development · doi:10.1080/01650250042000483 · Cited by 99 · cited 2×
“Generally, however, studies find that creativity declines in late adulthood (41).”
BackgroundDo tests of divergent thinking have an experiential bias?
Runco, M. A., & Acar, S. (2010) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/a0018969 · Cited by 92 · cited 1×
“Experiential bias occurs when one’s past experience influences the diversity of responses (45).”
BackgroundA Nudge-Based Intervention to Reduce Problematic Smartphone Use: Randomised Controlled Trial
Olson, J. A., Sandra, D. A., Chmoulevitch, D., Raz, A., & Veissière, S. P. L. (2023) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-022-00826-w · Cited by 91
Self-citationApplication of Latent Semantic Analysis to Divergent Thinking is Biased by Elaboration
Forthmann, B., Oyebade, O., Ojo, A., Günther, F., & Holling, H. (2019) · The Journal of Creative Behavior · doi:10.1002/jocb.240 · Cited by 88
Adnan, A., Beaty, R. E., Silvia, P. J., Spreng, R. N., & Turner, G. R. (2018) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2018.11.004 · Cited by 84 · cited 1×
“There are also inconsistent findings regarding age; some studies indicate that performance on creativity tasks increases as domain-specific knowledge and vocabulary increase (43), while others find the opposite (44).”
ResultDivergent Thinking and Age-Related Changes
Palmiero, M., Giacomo, D. D., & Passafiume, D. (2014) · Creativity Research Journal · doi:10.1080/10400419.2014.961786 · Cited by 80
Normative data for Chinese compound remote associate problems
Wu, C., & Chen, H. (2017) · Behavior Research Methods · doi:10.3758/s13428-016-0849-3 · Cited by 45
On the Dependability and Feasibility of Layperson Ratings of Divergent Thinking
Hass, R. W., Rivera, M., & Silvia, P. J. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01343 · Cited by 41
Human and Artificial Intelligence
Klix, F. (1979) · Medical Entomology and Zoology · Cited by 39
Becker, M., Wiedemann, G., & Kühn, S. (2018) · Psychological Research · doi:10.1007/s00426-018-1042-3 · Cited by 33
Human and Artificial Intelligence
Anderson, J. T. (1980) · Medical Informatics · doi:10.3109/14639238009016070 · Cited by 20
Research works printed but not linked: 2
- 38. Olson J. A., Sandra D. A., Chmoulevitch D., Raz A., Veissière S. P. L., A ten-step behavioural intervention to reduce screen time and problematic smartphone use. https://psyarxiv.com/tjynk/ (4 January 2021).
- 47. Grave E., Bojanowski P., Gupta P., Joulin A., Mikolov T., Learning word vectors for 157 languages. https://arxiv.org/pdf/1802.06893.pdf (28 March 2018). · arXiv
Cited by
Generative artificial intelligence enhances creativity but reduces the diversity of novel content
Doshi, A., & Hauser, O. (2023) · doi:10.2139/ssrn.4535536 · Cited by 1,350
“First, having access to generative AI effectively equalizes the evaluations of stories, removing any disadvantage or advantage based on the writers’ inherent creativity ( 25 ).”
InfluentialHubert, K. F., Awa, K. N., & Zabelina, D. L. (2024) · Scientific Reports · doi:10.1038/s41598-024-53303-w · Cited by 221
“For example, when scores were compared between humans and GPT-4 on a Divergent Associations Task (DAT 35 ), the researcher found that GPT-4 was more creative than human counterparts 36 .”
BackgroundAssociative thinking at the core of creativity
Beaty, R. E., & Kenett, Y. N. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.04.004 · Cited by 224
Creativity and artificial intelligence—a student perspective
Marrone, R., Taddeo, V., & Hill, G. (2022) · Journal of Intelligence · doi:10.3390/jintelligence10030065 · Cited by 208
“Education systems report the importance of creativity (Patston et al. 2021).”
BackgroundLarge Language Model in Creative Work: The Role of Collaboration Modality and User Expertise
Chen, Z., & Chan, J. (2024) · Management Science · doi:10.1287/mnsc.2023.03014 · Cited by 204
Metadata
- Authors
- Olson, J. A., Nahas, J., Chmoulevitch, D., Cropper, S. J., & Webb, M. E.
- Affiliations
- Harvard University (US)
- McGill University (CA)
- The University of Melbourne (AU)
- Corresponding author
- Olson, Jay A.
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2021-06-17
- Volume
- 118
- Issue
- 25
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC8237676
- OpenAlex
- W3166509103
- Cited by
- 182
- References
- 54
- Citations by year
- 2026: 39 · 2025: 34 · 2024: 53 · 2023: 29 · 2022: 22 · 2021: 3
- FWCI
- 25.85
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by-nc-nd)
- PsyArXiv (OSF Preprints) (submittedVersion)
- Funders
- McGill University
- Canada First Research Excellence Fund (#3c-KM-10)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Creativity in Education and Neuroscience
- Physical Sciences › Engineering › Mechanical Engineering › Design Education and Practice
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Keywords
- creativity, divergent thinking, semantic distance, word naming, alternative uses task, creativity assessment, cross-cultural comparison
- MeSH terms
- Adult, Aged, Child, Creativity, Female, Humans, Male, Middle Aged, Semantics, Task Performance and Analysis, Thinking, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.