Scoring divergent thinking tests by computer with a semantics-based algorithm
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Divergent thinking (DT) tests are useful for the assessment of creative potentials. This article reports the semantics-based algorithmic (SBA) method for assessing DT. This algorithm is fully automated: Examinees receive DT questions on a computer or mobile device and their ideas are immediately compared with norms and semantic networks. This investigation compared the scores generated by the SBA method with the traditional methods of scoring DT (i.e., fluency, originality, and flexibility). Data were collected from 250 examinees using the “Many Uses Test” of DT. The most important finding involved the flexibility scores from both scoring methods. This was critical because semantic networks are based on conceptual structures, and thus a high SBA score should be highly correlated with the traditional flexibility score from DT tests. Results confirmed this correlation (r = .74). This supports the use of algorithmic scoring of DT. The nearly-immediate computation time required by SBA method may make it the method of choice, especially when it comes to moderate- and large-scale DT assessment investigations. Correlations between SBA scores and GPA were insignificant, providing evidence of the discriminant and construct validity of SBA scores. Limitations of the present study and directions for future research are offered.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The standard definition of creativity
Runco, M. A., & Jaeger, G. J. (2012) · Creativity Research Journal · doi:10.1080/10400419.2012.650092 · Cited by 3,895 · cited 2×
“This is not a limitation, however, even though it is originality that is always included in definitions of creativity (for a review, see Runco & Jaeger, 2012).”
BackgroundSelf-citationThe Effects of Scoring Formulas on the Discriminant Validity of Tests of Divergent Thinking
Hocevar, D., & Michael, W. B. (1979) · Educational and Psychological Measurement · doi:10.1177/001316447903900427 · Cited by 113 · cited 1×
“There are different ways to score divergent thinking tests (Acar & Runco, 2014; Hocevar, 1979; Hocevar & Bachelor, 1989; Hocevar & Michael, 1979; Milgram, 1990; Runco, Okuda, & Thurston, 1987; Torrance, 1995).”
Cited by
Automating creativity assessment with SemDis: An open platform for computing semantic distance
Beaty, R. E., & Johnson, D. R. (2021) · Behavior Research Methods · doi:10.3758/s13428-020-01453-w · Cited by 341
Naming unrelated words predicts creativity
Olson, J. A., Nahas, J., Chmoulevitch, D., Cropper, S. J., & Webb, M. E. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2022340118 · Cited by 182
“• flexibility, the number of distinct categories of uses generated; • originality, how rare each use is relative to the rest of the sample, which is particularly important for creativity (17, 18); and • fluency, how many uses are generated in total.”
BackgroundMethodStable Diffusion Models Reveal a Persisting Human–AI Gap in Visual Creativity
Rondini, S., Alvarez‐Martin, C., Angermair‐Barkai, P., Penacchio, O., Paz, M., Pelowski, M., Dediu, D., Rodriguez‐Fornells, A., & Cerda‐Company, X. (2026) · Advanced Science · doi:10.1002/advs.202524142 · Cited by 2
Metadata
- Authors
- Beketayev, K., & Runco, M. A.
- Venue
- Europe’s Journal of Psychology
- Published
- 2016-05-31
- Volume
- 12
- Issue
- 2
- Pages
- 210-220
- ISSN
- 1841-0413 (ISSN-L)
- OpenAlex
- W2416205403
- Cited by
- 107
- References
- 2
- FWCI
- 10.30
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.