Semantic Distance and the Alternate Uses Task: Recommendations for Reliable Automated Assessment of Originality
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Semantic distance is increasingly used for automated scoring of originality on divergent thinking tasks, such as the Alternate Uses Task (AUT). Despite some psychometric support for semantic distance – including positive correlations with human creativity ratings – additional work is needed to optimize its reliability and validity, including identifying maximally reliable items (objects) for AUT administration. We identify a set of 13 AUT items based on a systematic item-selection strategy (belt, brick, broom, bucket, candle, clock, comb, knife, lamp, pencil, pillow, purse, sock). This item-set resulted in acceptable reliability estimates and was found to be moderately related to both human creativity ratings and a creative personality factor (Study 1). These results replicated in a new sample of Participants (Study 2). We conclude with the following recommendations for reliable and valid assessment of AUT originality using semantic distance: 1) make choices based on theoretical/practical considerations, 2) administer (some or all of) the 13 items from this study; 3) if other items must be used, avoid compound words as AUT items (e.g., guitar string); 4) include as many AUT items as time permits; 5) instruct participants to “be creative”; and 6) address fluency confounds that conflate idea quantity and quality (e.g., via max scoring).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
lavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955
Landauer, T. K., & Dumais, S. T. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.211 · Cited by 6,282
An introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880 · cited 1×
“Early applications of semantic distance in creativity studies used a method called latent semantic analysis (LSA; Landauer & Dumais, 1997; Landauer, Foltz, & Laham, 1998) to compute the semantic distance between words on verbal creativity tasks (e.g., the AUT; Guilford, 1967; Wallach & Kogan, 1965).”
MethodThe associative basis of the creative process.
Mednick, S. (1962) · Psychological Review · doi:10.1037/h0048850 · Cited by 4,140 · cited 1×
“The use of semantic distance in creativity research is based on the classic associative theory (Mednick, 1962), the notion that creative thinking involves making connections between remotely associated concepts.”
BackgroundMultiple imputation by chained equations: what is it and how does it work?
Azur, M. J., Stuart, E. A., Frangakis, C., & Leaf, P. J. (2011) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.329 · Cited by 3,542
Social psychology of creativity: A consensual assessment technique.
Amabile, T. M. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.43.5.997 · Cited by 2,278
Between facets and domains: 10 aspects of the Big Five.
DeYoung, C. G., Quilty, L. C., & Peterson, J. B. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.93.5.880 · Cited by 1,920
Missing Data: Five Practical Guidelines
Newman, D. A. (2014) · Organizational Research Methods · doi:10.1177/1094428114548590 · Cited by 1,411 · cited 3×
“The missing data pattern was Missing Completely at Random (MCAR) because of the random assignment of objects to persons.”
BackgroundInfluentialSilvia, P. J., Winterstein, B. P., Willse, J. T., Barona, C. M., Cram, J. T., Hess, K. I., Martinez, J. L., & Richard, C. A. (2008) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/1931-3896.2.2.68 · Cited by 912 · cited 5×
“The instructions were similar to those used in Study 1, and they were consistent with our past work on divergent thinking that emphasize creativity (Silvia et al., 2008): participants were asked to “think creatively” and “to come up with creative ideas, which are ideas that strike people as clever, unusual, interestin…”
BackgroundMethodResultInfluentialDefault and executive network coupling supports creative idea production
Beaty, R. E., Benedek, M., Barry Kaufman, S., & Silvia, P. J. (2015) · Scientific Reports · doi:10.1038/srep10964 · Cited by 705 · cited 1×
“The OCT is a common semantic con-trol task in fMRI studies of divergent thinking (Beaty, Benedek, Barry Kaufman, & Silvia, 2015; Fink et al., 2009), and it requires participants to think of the defining physical features of a series of objects (23 trials); OCT responses were not analyzed in the…”
MethodSelf-citation
Cited by
Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking
Kumar, H., Vincentius, J., Jordan, E., & Anderson, A. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714198 · Cited by 129
“We follow a long tradition of scoring responses to the AUT computationally [6, 7].”
Ashkinaze, J., Mendelsohn, J., Qiwei, L., Budak, C., & Gilbert, E. (2025) · Proceedings of the ACM Collective Intelligence Conference · doi:10.1145/3715928.3737481 · Cited by 33
Human‐AI Co‐Creativity: Does ChatGPT Make Us More Creative?
Medeiros, K., Cropley, D. H., Marrone, R. L., & Reiter‐Palmon, R. (2025) · The Journal of Creative Behavior · doi:10.1002/jocb.70022 · Cited by 30
Metadata
- Authors
- Beaty, R. E., Johnson, D. R., Zeitlen, D. C., & Forthmann, B.
- Venue
- Creativity Research Journal
- Publisher
- Informa UK Limited
- Published
- 2022-01-24
- Volume
- 34
- Issue
- 3
- Pages
- 245-260
- ISSN
- 1040-0419 (ISSN-L)
- 1532-6934
- OpenAlex
- W4207050572
- Cited by
- 103
- References
- 17
- FWCI
- 17.73
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Semantic Distance and the Alternate Uses Task: Recommendations for Reliable Automated Assessment of Originality. https://app.cochat.ai/papers/10.1080/10400419.2022.2025720
- The paper
- Beaty, R. E., Johnson, D. R., Zeitlen, D. C., & Forthmann, B. (2022). Semantic Distance and the Alternate Uses Task: Recommendations for Reliable Automated Assessment of Originality. Creativity Research Journal. https://doi.org/10.1080/10400419.2022.2025720
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.