Beyond semantic distance: Automated scoring of divergent thinking greatly improves with large language models
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Originality of each AUT idea was measured with an existing fine-tuned GPT-3 classifier.
“We measure the originality of each AUT idea with an existing fine-tuned GPT-3 classifier [44].”
From Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking (2025) · cites this paper as [44]
The five objects (tire, pants, shoe, table, bottle) were chosen because the originality scoring measure had the highest correlation with human judgements for these five objects.
“We chose these five particular objects as the originality scoring measure had the highest correlation with human judgements for these five objects [44].”
From Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking (2025) · cites this paper as [44]
The fine-tuned GPT-3 classifier achieved an r = 0.81 overall correlation with human judgments.
“The model was fine-tuned with human judgments of AUT originality (where human raters judged, on a scale of 1 to 5, the originality of an idea given the object) and achieved an 𝑟 = 0.81 overall correlation with human judgments.”
From Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking (2025) · cites this paper as [44]
The Alternate Uses Task (AUT) is an established measurement for divergent thinking, which possesses a validated and fully automated evaluation pipeline.
“we employ the Alternate Uses Task (AUT; Organisciak et al. (2023)), an established measurement for divergent (as in free-associative) thinking, which possesses a validated and fully automated evaluation pipeline (Organisciak et al., 2025).”
From Within-Model vs Between-Prompt Variability in Large Language Models for Creative Tasks (2026) · cites this paper as Organisciak et al., 2023
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648 · see citing works
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · see citing works
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337 · see citing works
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568 · see citing works
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · see citing works
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · see citing works
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · see citing works
Learning the parts of objects by non-negative matrix factorization
Lee, D. D., & Seung, H. S. (1999) · Nature · doi:10.1038/44565 · Cited by 13,898 · see citing works
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,695 · see citing works
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778 · see citing works
Indexing by latent semantic analysis
Deerwester, S. C., Dumais, S., Furnas, G. W., Landauer, T. K., & Harshman, R. A. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6 · Cited by 12,758 · see citing works
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653 · see citing works
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,649 · see citing works
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · see citing works
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · see citing works
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423 · see citing works
Enriching Word Vectors with Subword Information
Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00051 · Cited by 9,645 · see citing works
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · see citing works
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687 · see citing works
Landauer, T. K., & Dumais, S. T. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.211 · Cited by 6,282 · see citing works
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · see citing works
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361 · see citing works
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352 · see citing works
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222 · see citing works
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208 · see citing works
Guilford, J. P. (1950) · American Psychologist · doi:10.1037/h0063487 · Cited by 3,588 · see citing works
Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks
Gururangan, S., Marasović, A., Swayamdipta, S., Lo, K., Beltagy, I., Downey, D., & Smith, N. A. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.740 · Cited by 2,103 · see citing works
XAI—Explainable artificial intelligence
Gunning, D., Stefik, M., Choi, J., Miller, T., Stumpf, S., & Yang, G.-Z. (2019) · Science Robotics · doi:10.1126/scirobotics.aay7120 · Cited by 2,053 · see citing works
Large Language Models are Zero-Shot Reasoners
Kojima, T., Gu, S. S., Reid, M., Matsuo, Y., & Iwasawa, Y. (2022) · arXiv · doi:10.48550/arxiv.2205.11916 · Cited by 2,013 · see citing works
Large language models are zero-shot reasoners
Kojima, T., Gu, S. (., Reid, M., Matsuo, Y., & Iwasawa, Y. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1613 · Cited by 2,013 · see citing works
Scaling Laws for Neural Language Models
Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · Cited by 1,749 · see citing works
Divergent Thinking as an Indicator of Creative Potential
Runco, M. A., & Acar, S. (2012) · Creativity Research Journal · doi:10.1080/10400419.2012.652929 · Cited by 1,533 · see citing works
Self-citationSuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems
Wang, A., Pruksachatkun, Y., Nangia, N., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. R. (2019) · arXiv · doi:10.48550/arxiv.1905.00537 · Cited by 1,051 · see citing works
Training Compute-Optimal Large Language Models
Hoffmann, J., Borgeaud, S., Mensch, A., Buchatskaya, E., Cai, T., Rutherford, E., Casas, D. D. L., Hendricks, L. A., Welbl, J., Clark, A., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2176 · Cited by 932 · see citing works
Training Compute-Optimal Large Language Models
Hoffmann, J., Borgeaud, S., Mensch, A., Buchatskaya, E., Cai, T., Rutherford, E., Casas, D. D. L., Hendricks, L. A., Welbl, J., Clark, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.15556 · Cited by 929 · see citing works
Silvia, P. J., Winterstein, B. P., Willse, J. T., Barona, C. M., Cram, J. T., Hess, K. I., Martinez, J. L., & Richard, C. A. (2008) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/1931-3896.2.2.68 · Cited by 912 · see citing works
Robust prediction of individual creative ability from brain functional connectivity
Beaty, R. E., Kenett, Y. N., Christensen, A. P., Rosenberg, M. D., Benedek, M., Chen, Q., Fink, A., Qiu, J., Kwapil, T. R., Kane, M. J., et al. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1713532115 · Cited by 835 · see citing works
Can We Trust Creativity Tests? A Review of the Torrance Tests of Creative Thinking (TTCT)
Kim, K. H. (2006) · Creativity Research Journal · doi:10.1207/s15326934crj1801_2 · Cited by 830 · see citing works
Veale, M., & Zuiderveen Borgesius, F. (2021) · Computer Law Review International · doi:10.9785/cri-2021-220402 · Cited by 805 · see citing works
Text and Code Embeddings by Contrastive Pre-TrainingPreprint
Neelakantan, A., Xu, T., Puri, R., Radford, A., Han, J. M., Tworek, J., Yuan, Q.-M., Tezak, N., Kim, J. W., Hallacy, C., et al. (2022) · arXiv.org · doi:10.48550/arxiv.2201.10005 · Cited by 657 · see citing works
Beaty, R. E., & Silvia, P. J. (2012) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/a0029171 · Cited by 551 · see citing works
Modes of Thinking in Young Children
Mackie, J. (1966) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-196604000-00018 · Cited by 516 · see citing works
Predictive Validity of the Torrance Tests of Creative Thinking*
TORRANCE, E. P. (1972) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.1972.tb00936.x · Cited by 516 · see citing works
Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models
Ni, J., Ábrego, G. H., Constant, N., Ma, J., Hall, K., Cer, D. M., & Yang, Y. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.146 · Cited by 449 · see citing works
Silvia, P. J., Nusbaum, E. C., Berg, C., Martin, C. L., & O’Connor, A. (2009) · Journal of Research in Personality · doi:10.1016/j.jrp.2009.04.015 · Cited by 407 · see citing works
Runco, M. A., Millar, G. W., Acar, S., & Cramond, B. L. (2010) · Creativity Research Journal · doi:10.1080/10400419.2010.523393 · Cited by 397 · see citing works
Self-citationKim, K. H. (2008) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.2008.tb01290.x · Cited by 378 · see citing works
Automating creativity assessment with SemDis: An open platform for computing semantic distance
Beaty, R. E., & Johnson, D. R. (2021) · Behavior Research Methods · doi:10.3758/s13428-020-01453-w · Cited by 341 · see citing works
Choice of Plausible Alternatives: An Evaluation of Commonsense Causal Reasoning
Roemmele, M., Bejan, C. A., & Gordon, A. S. (2011) · Cited by 334 · see citing works
Cramond, B., Matthews-Morgan, J., Bandalos, D., & Zuo, L. (2005) · Gifted Child Quarterly · doi:10.1177/001698620504900402 · Cited by 318 · see citing works
Downie, J. S. (2008) · Nippon Onkyo Gakkaishi/Acoustical science and technology/Nihon Onkyo Gakkaishi · doi:10.1250/ast.29.247 · Cited by 297 · see citing works
Benedek, M., Mühlmann, C., Jauk, E., & Neubauer, A. C. (2013) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/a0033644 · Cited by 223 · see citing works
Scoring Divergent Thinking Tests Using Total Ideational Output and a Creativity Index
Runco, M. A., & Mraz, W. (1992) · Educational and Psychological Measurement · doi:10.1177/001316449205200126 · Cited by 194 · see citing works
Understanding Fluency and Originality: A latent variable perspective
Dumas, D., & Dunbar, K. N. (2014) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2014.09.003 · Cited by 176 · see citing works
Self-citationDumas, D., Organisciak, P., & Doherty, M. (2021) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/aca0000319 · Cited by 158 · see citing works
Self-citationSilvia, P. J. (2010) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2010.06.001 · Cited by 142 · see citing works
Which Test of Divergent Thinking Is Best?
Runco, M. A., Alabbasi, A. M. A., Paek, S. H., AL-Jasim, F. A., & Alsuwaidi, H. N. (2016) · Creativity Theories – Research – Applications · doi:10.1515/ctra-2016-0001 · Cited by 142 · see citing works
Leakage and the Reproducibility Crisis in ML-based SciencePreprint
Kapoor, S., & Narayanan, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.07048 · Cited by 140 · see citing works
Johnson, D. R., Kaufman, J. C., Baker, B. S., Patterson, J. D., Barbot, B., Green, A. E., van Hell, J. G., Kennedy, E., Sullivan, G., Taylor, C. L., et al. (2022) · Behavior Research Methods · doi:10.3758/s13428-022-01986-2 · Cited by 99 · see citing works
Creativity measurement in undergraduate students from 1984–2013: A systematic review.
Snyder, H. T., Hammond, J. A., Grohman, M. G., & Katz-Buonincontro, J. L. (2019) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000228 · Cited by 98 · see citing works
Divergent thinking and creative achievement—How strong is the link? An updated meta-analysis.
Said‐Metwaly, S., Taylor, C. L., Camarda, A., & Barbot, B. (2022) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000507 · Cited by 89 · see citing works
Application of Latent Semantic Analysis to Divergent Thinking is Biased by Elaboration
Forthmann, B., Oyebade, O., Ojo, A., Günther, F., & Holling, H. (2018) · The Journal of Creative Behavior · doi:10.1002/jocb.240 · Cited by 88 · see citing works
Runco, M. A. (2008) · Cited by 83 · see citing works
Applying Automated Originality Scoring to the Verbal Form of Torrance Tests of Creative Thinking
Acar, S., Berthiaume, K., Grajzel, K., Dumas, D., Flemister, C. “., & Organisciak, P. (2021) · Gifted Child Quarterly · doi:10.1177/00169862211061874 · Cited by 69 · see citing works
Self-citationOld or New? Evaluating the Old/New Scoring Method for Divergent Thinking Tasks
Silvia, P. J., Nusbaum, E. C., & Beaty, R. E. (2015) · The Journal of Creative Behavior · doi:10.1002/jocb.101 · Cited by 68 · see citing works
Buczak, P., Huang, H., Forthmann, B., & Doebler, P. (2022) · The Journal of Creative Behavior · doi:10.1002/jocb.559 · Cited by 46 · see citing works
On the Dependability and Feasibility of Layperson Ratings of Divergent Thinking
Hass, R. W., Rivera, M., & Silvia, P. J. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01343 · Cited by 41 · see citing works
Zaccaro, S. J., Connelly, S., Repchick, K. M., Daza, A. I., Young, M. C., Kilcullen, R. N., Gilrane, V. L., Robbins, J. M., & Bartholomew, L. (2015) · The Leadership Quarterly · doi:10.1016/j.leaqua.2015.03.007 · Cited by 38 · see citing works
Acar, S. (2022) · Creativity Research Journal · doi:10.1080/10400419.2022.2044656 · Cited by 31 · see citing works
Self-citationForthmann, B., & Doebler, P. (2022) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000518 · Cited by 29 · see citing works
Mohr, A. H., Sell, A., & Lindsay, T. A. (2015) · Social Science Computer Review · doi:10.1177/0894439315588736 · Cited by 23 · see citing works
Handbook of Creativity Assessment
(2024) · Edward Elgar Publishing eBooks · doi:10.4337/9781839102158 · Cited by 22 · see citing works
Shaw, A. (2021) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2021.100789 · Cited by 18 · see citing works
What Makes Children's Responses to Creativity Assessments Difficult to Judge Reliably?
Dumas, D., Acar, S., Berthiaume, K., Organisciak, P., Eby, D., Grajzel, K., Vlaamster, T., Newman, M., & Carrera, M. (2023) · The Journal of Creative Behavior · doi:10.1002/jocb.588 · Cited by 16 · see citing works
Self-citationHow do the kids speak? Improving educational use of text mining with child-directed language models
Organisciak, P., Newman, M., Eby, D., Acar, S., & Dumas, D. (2023) · Information and Learning Sciences · doi:10.1108/ils-06-2022-0082 · Cited by 12 · see citing works
Self-citationScoring Creativity Tests By Computer
Paulus, D. H., & Renzuli, J. S. (1968) · Gifted Child Quarterly · doi:10.1177/001698626801200202 · Cited by 11 · see citing works
Stevenson, C. S., Smal, I., Baas, M., Dahrendorf, M., Grasman, R. P. P. P., Tanis, C. C., Scheurs, E., Sleiffer, D., & van der Maas, H. L. J. (2020) · Data Archiving and Networked Services (DANS) · Cited by 8 · see citing works
Forthmann, B., & Doebler, P. (2022) · doi:10.31234/osf.io/byj8c · Cited by 5 · see citing works
Divergent thinking: early views
Plucker, J. A., Meyer, M. S., & Liu, P. (2024) · Edward Elgar Publishing eBooks · doi:10.4337/9781839102158.00015 · Cited by 5 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805
Flagged first, then by citations
Cited by
Sorted by citations
Artificial Intelligence & Creativity: A Manifesto for Collaboration
Vinchon, F., Lubart, T., Bartolotta, S., Gironnay, V., Botella, M., Bourgeois-Bougrine, S., Burkhardt, J., Bonnardel, N., Corazza, G. E., Glăveanu, V., et al. (2023) · The Journal of Creative Behavior · doi:10.1002/jocb.597 · Cited by 273 · see citing works
Artificial muses: Generative artificial intelligence chatbots have risen to human-level creativity
Haase, J., & Hanel, P. H. P. (2023) · Journal of Creativity · doi:10.1016/j.yjoc.2023.100066 · Cited by 233 · see citing works
Applying large language models and chain-of-thought for automatic scoring
Lee, G.-G., Latif, E., Wu, X., Liu, N., & Zhai, X. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100213 · Cited by 186 · see citing works
Fine-tuning ChatGPT for automatic scoring
Latif, E., & Zhaı, X. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100210 · Cited by 186 · see citing works
The originality of machines: AI takes the Torrance test
Guzik, E. E., Byrge, C., & Gilde, C. (2023) · Journal of Creativity · doi:10.1016/j.yjoc.2023.100065 · Cited by 165 · see citing works
Creativity in the age of generative AI
Rafner, J., Beaty, R. E., Kaufman, J. C., Lubart, T., & Sherson, J. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01751-1 · Cited by 156 · see citing works
Li, T., Ji, Y., & Zhan, Z. (2024) · Asia Pacific Journal of Education · doi:10.1080/02188791.2024.2305163 · Cited by 133 · see citing works
Li, H.-F. (2023) · Australasian Journal of Educational Technology · doi:10.14742/ajet.8923 · Cited by 125 · see citing works
Large Language Model-Powered Automated Assessment: A Systematic Review
Emirtekin, E. (2025) · Applied Sciences · doi:10.3390/app15105683 · Cited by 87 · see citing works
Beyond Traditional Assessment: Exploring the Impact of Large Language Models on Grading Practices
Fagbohun, O., Iduwe, N. P., Abdullahi, M., Ifaturoti, A., & Nwanna, O. (2024) · Journal of Artificial Intelligence, Machine Learning and Data Science · doi:10.51219/jaimld/oluwole-fagbohun/19 · Cited by 68 · see citing works
The Art of Creative Inquiry—From Question Asking to Prompt Engineering
Sasson-Lazovsky, G., Raz, T., & Kenett, Y. N. (2024) · The Journal of Creative Behavior · doi:10.1002/jocb.671 · Cited by 69 · see citing works
AuDrA: An automated drawing assessment platform for evaluating creativity
Patterson, J. D., Barbot, B., Lloyd-Cox, J., & Beaty, R. E. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02258-3 · Cited by 58 · see citing works
The language of creativity: Evidence from humans and large language models
Orwig, W., Edenbaum, E. R., Greene, J. D., & Schacter, D. L. (2024) · The Journal of Creative Behavior · doi:10.1002/jocb.636 · Cited by 56 · see citing works
Automatic Scoring of Metaphor Creativity with Large Language Models
DiStefano, P. V., Patterson, J. D., & Beaty, R. E. (2024) · Creativity Research Journal · doi:10.1080/10400419.2024.2326343 · Cited by 53 · see citing works
Divergent creativity in humans and large language models
Bellemare-Pepin, A., Lespinasse, F., Thölke, P., Harel, Y., Mathewson, K. W., Olson, J. A., Bengio, Y., & Jerbi, K. (2026) · Scientific Reports · doi:10.1038/s41598-025-25157-3 · Cited by 52 · see citing works
Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking
Kumar, H., Vincentius, J., Jordan, E., & Anderson, A. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714198 · Cited by 51 · see citing works
Driving Factors of Generative AI Adoption in New Product Development Teams from a UTAUT Perspective
Xia, Y., & Chen, Y. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2375686 · Cited by 49 · see citing works
Wu, X., Saraf, P. P., Lee, G., Latif, E., Liu, N., & Zhaı, X. (2025) · Technology Knowledge and Learning · doi:10.1007/s10758-025-09836-8 · Cited by 43 · see citing works
Ashkinaze, J., Mendelsohn, J., Qiwei, L., Budak, C., & Gilbert, E. (2025) · Proceedings of the ACM Collective Intelligence Conference · doi:10.1145/3715928.3737481 · Cited by 33 · see citing works
AI vs humans in the AUT: Simulations to LLMs
Gilhooly, K. J. (2023) · Journal of Creativity · doi:10.1016/j.yjoc.2023.100071 · Cited by 32 · see citing works
GenAI Creativity in Narrative Tasks: Exploring New Forms of Creativity
Vinchon, F., Gironnay, V., & Lubart, T. (2024) · Journal of Intelligence · doi:10.3390/jintelligence12120125 · Cited by 38 · see citing works
Exploring the Role of Generative AI in Collaborative Lesson Planning for Pre‐Service Teachers
Sun, Y., & Huang, Y. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.70098 · Cited by 46 · see citing works
Tang, M., Hofreiter, S., Werner, C. H., Zielińska, A., & Karwowski, M. (2025) · The Journal of Creative Behavior · doi:10.1002/jocb.1519 · Cited by 32 · see citing works
Creativity Assessment, Research, and Practice in the Age of Artificial Intelligence
Acar, S. (2023) · Creativity Research Journal · doi:10.1080/10400419.2023.2271749 · Cited by 29 · see citing works
Self-citationOpen and closed-ended problem solving in humans and AI: The influence of question asking complexity
Raz, T., Reiter‐Palmon, R., & Kenett, Y. N. (2024) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2024.101598 · Cited by 32 · see citing works
Zielińska, A., Organisciak, P., Dumas, D., & Karwowski, M. (2023) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2023.101414 · Cited by 29 · see citing works
Self-citationAI as a creative partner: a PRISMA review of AI’s role in supporting creativity in education
Urmeneta, A., & Roméro, M. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1602151 · Cited by 27 · see citing works
Automated Scoring of Figural Tests of Creativity with Computer Vision
Acar, S., Organisciak, P., & Dumas, D. (2024) · The Journal of Creative Behavior · doi:10.1002/jocb.677 · Cited by 26 · see citing works
Self-citationYang, T., Zhang, Q., Sun, Z., & Hou, Y. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02313-z · Cited by 23 · see citing works
Automated Scoring of Scientific Creativity in German
Goecke, B., DiStefano, P. V., Aschauer, W., Haim, K., Beaty, R. E., & Forthmann, B. (2024) · The Journal of Creative Behavior · doi:10.1002/jocb.658 · Cited by 20 · see citing works
Natural language processing in educational research: The evolution of research topics
Wu, H., Li, S., Gao, Y., Weng, J., & Ding, G. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12764-2 · Cited by 20 · see citing works
Evaluation is Creation: Self and Social Judgments of Creativity Across the Four-C Model
Dumas, D., & Kaufman, J. C. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09947-1 · Cited by 23 · see citing works
Self-citationAssessing novelty, feasibility and value of creative ideas with an unsupervised approach using GPT‐4
Kern, F. B., Wu, C., & Chao, Z. C. (2024) · British Journal of Psychology · doi:10.1111/bjop.12720 · Cited by 20 · see citing works
Li, H., Liu, Y., Guo, Q., Shi, M., Zhang, P., & Kim, S. B. (2025) · Systems · doi:10.3390/systems13040275 · Cited by 17 · see citing works
Possibility Thinking Scale: An initial psychometric exploration
Glăveanu, V. P., Karwowski, M., Ross, W., & Beghetto, R. A. (2024) · Possibility Studies & Society · doi:10.1177/27538699241241827 · Cited by 17 · see citing works
Investigation of Response Aggregation Methods in Divergent Thinking Assessments
Saretzki, J., Andrae, R., Forthmann, B., & Benedek, M. (2024) · The Journal of Creative Behavior · doi:10.1002/jocb.1527 · Cited by 17 · see citing works
What Makes Children's Responses to Creativity Assessments Difficult to Judge Reliably?
Dumas, D., Acar, S., Berthiaume, K., Organisciak, P., Eby, D., Grajzel, K., Vlaamster, T., Newman, M., & Carrera, M. (2023) · The Journal of Creative Behavior · doi:10.1002/jocb.588 · Cited by 16 · see citing works
Self-citationWise, T., & Kenett, Y. N. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02463-8 · Cited by 15 · see citing works
Cyber-Creativity: A Decalogue of Research Challenges
Corazza, G. E., Agnoli, S., Jorge Artigau, A., Beghetto, R. A., Bonnardel, N., Coletto, I., Faiella, A., Gerardini, K., Gilhooly, K., Glăveanu, V. P., et al. (2025) · Journal of Intelligence · doi:10.3390/jintelligence13080103 · Cited by 14 · see citing works
Scherbakova, A., Dumas, D., Acar, S., Berthiaume, K., & Organisciak, P. (2024) · The Journal of Creative Behavior · doi:10.1002/jocb.646 · Cited by 18 · see citing works
Self-citationCAP: The creativity assessment platform for online testing and automated scoring
Patterson, J. D., Pronchick, J., Panchanadikar, R., Fuge, M., van Hell, J. G., Miller, S. R., Johnson, D. R., & Beaty, R. E. (2025) · Behavior Research Methods · doi:10.3758/s13428-025-02761-9 · Cited by 13 · see citing works
Using large language models to evaluate alternative uses task flexibility score
Hadas, E., & Hershkovitz, A. (2024) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2024.101549 · Cited by 13 · see citing works
Kranzle, T., & Sharratt, K. (2025) · Creativity and Innovation Management · doi:10.1111/caim.70007 · Cited by 12 · see citing works
Large language models are homogeneously creative
Wenger, E., & Kenett, Y. N. (2026) · PNAS Nexus · doi:10.1093/pnasnexus/pgag042 · Cited by 44 · see citing works
Envisioning the Future of Creative Thinking Assessment
Benedek, M., & Beaty, R. E. (2025) · The Journal of Creative Behavior · doi:10.1002/jocb.70036 · Cited by 16 · see citing works
How Much Retrieval Ability Is in Originality?
Weiss, S., Goecke, B., & Wilhelm, O. (2024) · The Journal of Creative Behavior · doi:10.1002/jocb.659 · Cited by 11 · see citing works
Wahbeh, H., Cannard, C., Yount, G. L., Arnaud Delorme, A., & Radin, D. I. (2024) · Journal of Creativity · doi:10.1016/j.yjoc.2024.100088 · Cited by 11 · see citing works
The role of alpha oscillations in free‐ and goal‐directed semantic associations
Ζιώγα, Ι., Kenett, Y. N., Giannopoulos, A., & Luft, C. D. B. (2024) · Human Brain Mapping · doi:10.1002/hbm.26770 · Cited by 12 · see citing works
Scoring German Alternate Uses Items Applying Large Language Models
Saretzki, J., Knopf, T., Forthmann, B., Goecke, B., Jaggy, A., Benedek, M., & Weiss, S. (2025) · Journal of Intelligence · doi:10.3390/jintelligence13060064 · Cited by 11 · see citing works
Subjective valuation as a domain-general process in creative thinking
Battistello, G., Moreno-Rodriguez, S., Volle, E., & Lopez‐Persem, A. (2025) · Communications Psychology · doi:10.1038/s44271-025-00285-8 · Cited by 12 · see citing works
van Broekhoven, K. (2023) · Creativity Research Journal · doi:10.1080/10400419.2023.2253403 · Cited by 11 · see citing works
On semantic structures and processes in creative thinking
Kenett, Y. N., & Beaty, R. E. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.07.011 · Cited by 11 · see citing works
Zhang, K., Cai, S., Yang, W., Wu, W., & Shen, H. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661501 · Cited by 10 · see citing works
Chen, S., & Lin, Y. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1619489 · Cited by 10 · see citing works
Has the creativity of large-language models peaked?
Haase, J., Hanel, P. H. P., & Pokutta, S. (2025) · Journal of Creativity · doi:10.1016/j.yjoc.2025.100113 · Cited by 13 · see citing works
Neural dynamics during the generation and evaluation of creative and non-creative ideas
Kenett, Y. N., Chrysikou, E. G., Bassett, D. S., & Thompson‐Schill, S. L. (2025) · Communications Biology · doi:10.1038/s42003-025-09018-3 · Cited by 10 · see citing works
Large Language Models are Catalyzing Chemistry EducationPreprint
Du, Y., Duan, C., Bran, A. M., Sotnikova, A., Qu, Y., Kulik, H. J., Bosselut, A., Xu, J., & Schwaller, P. (2024) · ChemRxiv · doi:10.26434/chemrxiv-2024-h722v · Cited by 10 · see citing works
McNeish, D., & Dumas, D. (2025) · Behavior Research Methods · doi:10.3758/s13428-025-02611-8 · Cited by 13 · see citing works
Self-citationTen Guidelines for Scoring Psychological Assessments Using Artificial Intelligence
Dumas, D., Greiff, S., & Wetzel, E. (2025) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000904 · Cited by 9 · see citing works
Self-citationZha, S., Qiao, Y., Hu, Q., Li, Z., Gong, J., & Xu, Y. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103602 · Cited by 9 · see citing works
Arora, V., Thabane, A., Parpia, S., Calic, G., & Bhandari, M. (2025) · Scientific Reports · doi:10.1038/s41598-025-21398-4 · Cited by 12 · see citing works
Recognizing, evaluating, and selecting new ideas: the problematic journey of novelty
Deichmann, D., Cattani, G., & Ferriani, S. (2024) · Innovation · doi:10.1080/14479338.2024.2359383 · Cited by 8 · see citing works
Fuzzy Linkography: Automatic Graphical Summarization of Creative Activity Traces
Smith, A., Anderson, B. R., Otto, J., Karth, I., Sun, Y., Chung, J. J. Y., Roemmele, M., & Kreminski, M. (2025) · Creativity and Cognition · doi:10.1145/3698061.3726915 · Cited by 8 · see citing works
Zhang, L., Fang, C., Lin, H., Liang, G., & Luo, S. (2025) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2025.102020 · Cited by 8 · see citing works
Investigating the Validity Evidence of Automated Scoring Methods for Divergent Thinking Assessments
Saretzki, J., & Benedek, M. (2026) · Creativity Research Journal · doi:10.1080/10400419.2025.2607669 · Cited by 8 · see citing works
The Scientific Creative Thinking Test (SCTT): Reliability, Validity, and Automated Scoring
Beaty, R. E., Cortes, R. A., Luchini, S. A., Patterson, J. D., Forthmann, B., Baker, B. S., Barbot, B., Hardiman, M. M., & Green, A. E. (2026) · Creativity Research Journal · doi:10.1080/10400419.2026.2639038 · Cited by 10 · see citing works
Reis, M., & Kunde, W. (2024) · Cognition · doi:10.1016/j.cognition.2024.105741 · Cited by 8 · see citing works
Dumas, D., Dong, Y., Kagan, S., & Campbell, W. K. (2024) · Creativity Research Journal · doi:10.1080/10400419.2024.2371725 · Cited by 7 · see citing works
Self-citationInvestigating Lasting Effects of Real-Time Feedback on Originality and Evaluation Accuracy
de Chantal, P., Houde-Labrecque, C., Leblanc, M., & Organisciak, P. (2024) · Creativity Research Journal · doi:10.1080/10400419.2024.2441014 · Cited by 10 · see citing works
Self-citationRunco, M. A., Türkman, B., Acar, S., & Alabbasi, A. M. A. (2024) · The Journal of Creative Behavior · doi:10.1002/jocb.1528 · Cited by 7 · see citing works
Self-citationThe Effect of Aging on Question-Asking, Divergent Thinking, and Problem-Solving Abilities
Raz, T., Diaz, M. T., & Kenett, Y. N. (2025) · Creativity Research Journal · doi:10.1080/10400419.2025.2498916 · Cited by 7 · see citing works
Campidelli, L., Domanti, U., Fusi, G., Kenett, Y. N., & Agnoli, S. (2025) · Cognition · doi:10.1016/j.cognition.2025.106318 · Cited by 7 · see citing works
Creativeable: Leveraging AI for Personalized Creativity Enhancement
Nitzav, A. K., & Kenett, Y. N. (2025) · AI · doi:10.3390/ai6100247 · Cited by 8 · see citing works
Memmert, L., Cvetković, I., Tavanapour, N., & Bittner, E. A. C. (2025) · Business & Information Systems Engineering · doi:10.1007/s12599-025-00974-y · Cited by 7 · see citing works
On the Consistency of Automatic Scoring with Large Language Models
Xue, M., Xiao, X., Liu, Y., & Wilson, M. (2026) · Educational and Psychological Measurement · doi:10.1177/00131644261418138 · Cited by 7 · see citing works
Luchini, S. A., Zhang, X., White, R. T., Lührs, M., Ramot, M., & Beaty, R. E. (2025) · Cerebral Cortex · doi:10.1093/cercor/bhaf065 · Cited by 7 · see citing works
Automated Genre-Aware Article Scoring and Feedback Using Large Language Models
Wang, C., Dong, Y., Zhang, Z., Wang, R., Wang, S., & Chen, J. (2024) · International Conference on Big Data, Artificial Intelligence and Internet of Things Engineering (ICBAIE) · doi:10.1109/icbaie63306.2024.11116923 · Cited by 10 · see citing works
Seiler, J. P.-H., Elpelt, J., Ghobadi, A., Kaschube, M., & Rumpel, S. (2025) · Communications Psychology · doi:10.1038/s44271-025-00214-9 · Cited by 6 · see citing works
Grammenos, D., & Lubart, T. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11288-6 · Cited by 6 · see citing works
Automated Scoring of Question Complexity with Transformer Language Models
Raz, T., Luchini, S. A., Beaty, R. E., & Kenett, Y. N. (2025) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2025.102090 · Cited by 19 · see citing works
Can elementary school teachers assess students’ creative problem solving abilities?
van Hooijdonk, M., Mainhard, T., Kroesbergen, E. H., & van Tartwijk, J. (2024) · Teaching and Teacher Education · doi:10.1016/j.tate.2024.104644 · Cited by 6 · see citing works
Semantic memory and creative evaluation
Skurnik, A., Ackerman, R., & Kenett, Y. N. (2025) · BMC Psychology · doi:10.1186/s40359-025-03124-x · Cited by 7 · see citing works
AI‐Powered Scoring for Creative Thinking: Methods and Challenges in PISA Assessment
Primi, R., Beaty, R. E., Benedek, M., Dumas, D., Organisciak, P., Patterson, J. D., Caliço, T., & Piacentíni, M. (2025) · The Journal of Creative Behavior · doi:10.1002/jocb.70082 · Cited by 5 · see citing works
Self-citationHow Creative is This Child?: Student Demographics Affect How Teachers Rate Creativity
Kagan, S., Dumas, D., Acar, S., Organisciak, P., & Berthiaume, K. (2025) · The Journal of Experimental Education · doi:10.1080/00220973.2025.2466161 · Cited by 6 · see citing works
Self-citationDevelopment of the Japanese version of the inventory of creative activities and achievements
Ishiguro, C., Matsumoto, K., Agata, T., & Okada, T. (2024) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2024.101648 · Cited by 5 · see citing works
The effect of nature on creativity through mental imagery
Drake, A. C., Hasan, F., Gibson, A., & Kam, J. W. Y. (2025) · PLoS ONE · doi:10.1371/journal.pone.0315141 · Cited by 5 · see citing works
Odle, E., Hsueh, Y.-J., & Lin, P. (2023) · Electronics · doi:10.3390/electronics12194185 · Cited by 5 · see citing works
How Do Hackathons Foster Creativity? Towards Automated Evaluation of Creativity at Scale
Falk, J., Chen, Y., Rafner, J. F., Zhang, M., Bjerva, J., & Nolte, A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713447 · Cited by 4 · see citing works
Validating LLM-based alternative uses test scoring across ages
Hadas, E., Avital-Lev, B., & Hershkovitz, A. (2025) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2025.102066 · Cited by 4 · see citing works
Exploring the impact of AI features on collaborative creativity
Frich, J., Grønbæk, J. E. S., Borowski, M., & Dalsgaard, P. (2024) · Australian Conference on Human-Computer Interaction (OzCHI) · doi:10.1145/3726986.3727015 · Cited by 4 · see citing works
An integrated benchmark for verbal creativity testing of LLMs and humans
Dinu, A., & Florescu, A. M. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.09.380 · Cited by 4 · see citing works
Dynamic cycles between brain states during creative storytelling
Liang, X., Cai, M., Jing, G., Zhang, C., Nichols, E. S., & Liu, L. (2025) · NeuroImage · doi:10.1016/j.neuroimage.2025.121053 · Cited by 4 · see citing works
Zhou, Z., Xiao, L., Wang, J., Tong, S., Zhang, W., & Hao, N. (2026) · Journal of Computer Assisted Learning · doi:10.1002/jcal.70223 · Cited by 5 · see citing works
Sequence Generation and Evaluation: A Novel Assessment of Musical Creativity
Loui, P., Parrish, C., Wu, X., Lee, J., & Margulis, E. H. (2024) · Creativity Research Journal · doi:10.1080/10400419.2024.2425494 · Cited by 4 · see citing works
DiStefano, P. V., Patterson, J. D., & Beaty, R. E. (2024) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2024.101726 · Cited by 4 · see citing works
Automated Graphic Divergent Thinking Assessment: A Multimodal Machine Learning Approach
Zhang, H. Q., Dong, H., Wang, Y., Zhang, X., Fan, Y., Ren, B., & Xu, J. (2025) · Journal of Intelligence · doi:10.3390/jintelligence13040045 · Cited by 4 · see citing works
Haase, J., & Hanel, P. H. P. (2024) · Creativity Research Journal · doi:10.1080/10400419.2024.2347778 · Cited by 3 · see citing works
Kandemirci, B., Beaty, R. E., Johnson, D. R., Oliver, B. R., Kovas, Y. V., & Toivainen, T. (2025) · Learning and Individual Differences · doi:10.1016/j.lindif.2025.102626 · Cited by 4 · see citing works
Predication of Writing Originality Based on Computational Linguistics
Yang, L., Xin, T., Zhang, S., & Yu, Y. (2022) · Journal of Intelligence · doi:10.3390/jintelligence10040124 · Cited by 3 · see citing works
Automated essay scoring to assess digital literacy competence
Anistyasari, Y., Ekohariadi, Rijanto, T., & Hidayati, S. C. (2024) · AIP conference proceedings · doi:10.1063/5.0210437 · Cited by 3 · see citing works
- Authors
- Organisciak, P., Acar, S., Dumas, D., & Berthiaume, K.
- Affiliations
- University of Denver (US)
- University of Georgia (US)
- University of North Texas (US)
- Corresponding author
- Organisciak, Peter
- Venue
- Thinking Skills and Creativity
- Publisher
- Elsevier BV
- Published
- 2023-09
- Volume
- 49
- Pages
- 101356
- ISSN
- 1871-1871 (ISSN-L)
- OpenAlex
- W4381487157
- Cited by
- 202
- References
- 80
- Citations by year
- 2026: 65 · 2025: 64 · 2024: 56 · 2023: 16 · 2022: 1
- FWCI
- 52.22
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Thinking Skills and Creativity (publishedVersion)
- Funders
- Institute of Education Sciences (305A200199)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Creativity in Education and Neuroscience
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Engineering › Mechanical Engineering › Design Education and Practice
- Keywords
- divergent thinking, automated grading, alternative uses task, large language models, creativity assessment, semantic distance, fine-tuning, transfer learning, few-shot prompting, zero-shot prompting, human judgment correlation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
