Application of Latent Semantic Analysis to Divergent Thinking is Biased by Elaboration
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Scoring divergent‐thinking response sets has always been challenging because such responses are not only open‐ended in terms of number of ideas, but each idea may also be expressed by a varying number of concepts and, thus, by a varying number of words (elaboration). While many current studies have attempted to score the semantic distance in divergent‐thinking responses by applying latent semantic analysis (LSA), it is known from other areas of research that LSA‐based approaches are biased according to the number of words in a response. Thus, the current article aimed to identify and demonstrate this elaboration bias in LSA‐based divergent‐thinking scores by means of a simulation. In addition, we show that this elaboration bias can be reduced by removing the stop words (for example, and, or, for and so forth) prior to analysis. Furthermore, the residual bias after stop word removal can be reduced by simulation‐based corrections. Finally, we give an empirical illustration for alternate uses and consequences tasks. Results suggest that when both stop word removal and simulation‐based bias correction are applied, convergent validity should be expected to be highest.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Landauer, T. K., & Dumais, S. T. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.211 · Cited by 6,282
An introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
The associative basis of the creative process.
Mednick, S. (1962) · Psychological Review · doi:10.1037/h0048850 · Cited by 4,140
The standard definition of creativity
Runco, M. A., & Jaeger, G. J. (2012) · Creativity Research Journal · doi:10.1080/10400419.2012.650092 · Cited by 3,895
Guilford, J. P. (1950) · American Psychologist · doi:10.1037/h0063487 · Cited by 3,588
Silvia, P. J., Winterstein, B. P., Willse, J. T., Barona, C. M., Cram, J. T., Hess, K. I., Martinez, J. L., & Richard, C. A. (2008) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/1931-3896.2.2.68 · Cited by 912
The roles of associative and executive processes in creative cognition
Beaty, R. E., Silvia, P. J., Nusbaum, E. C., Jauk, E., & Benedek, M. (2014) · Memory & Cognition · doi:10.3758/s13421-014-0428-8 · Cited by 448
Investigating the structure of semantic networks in low and high creative persons
Kenett, Y. N., Anaki, D., & Faust, M. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00407 · Cited by 392
Relations of creative responses to working time and instructions
Christensen, P. R., Guilford, J. P., & Wilson, R. C. (1957) · Journal of Experimental Psychology · doi:10.1037/h0045461 · Cited by 263
Language Encodes Geographical Information
Louwerse, M. M., & Zwaan, R. A. (2009) · Cognitive Science · doi:10.1111/j.1551-6709.2008.01003.x · Cited by 113
Scope of semantic activation and innovative thinking in college students with ADHD
White, H. A., & Shah, P. (2016) · Creativity Research Journal · doi:10.1080/10400419.2016.1195655 · Cited by 63
Cited by
Automating creativity assessment with SemDis: An open platform for computing semantic distance
Beaty, R. E., & Johnson, D. R. (2021) · Behavior Research Methods · doi:10.3758/s13428-020-01453-w · Cited by 341
Benedek, M., & Fink, A. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.11.002 · Cited by 284
Organisciak, P., Acar, S., Dumas, D., & Berthiaume, K. (2023) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2023.101356 · Cited by 202
Naming unrelated words predicts creativity
Olson, J. A., Nahas, J., Chmoulevitch, D., Cropper, S. J., & Webb, M. E. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2022340118 · Cited by 182
Beaty, R. E., Zeitlen, D. C., Baker, B. S., & Kenett, Y. N. (2021) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2021.100859 · Cited by 86
Metadata
- Authors
- Forthmann, B., Oyebade, O., Ojo, A., Günther, F., & Holling, H.
- Venue
- The Journal of Creative Behavior
- Publisher
- Wiley
- Published
- 2018-03-25
- Volume
- 53
- Issue
- 4
- Pages
- 559-575
- ISSN
- 0022-0175 (ISSN-L)
- 2162-6057
- OpenAlex
- W2790855378
- Cited by
- 88
- References
- 14
- FWCI
- 9.56
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.