The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
A scattered CAT: A critical evaluation of the consensual assessment technique for creativity research.
Abstract
Amabile's Consensual Assessment Technique (CAT) – taking the consensus opinions of domain experts – is considered a 'gold standard' of creativity assessment for research purposes. While several studies have identified how specific procedural choices impact on the CAT's reliability as a measure, researchers’ depth of knowledge about procedures and their effects still remains incomplete. This paper explores gaps in the research by reviewing CAT and creativity literature, and aims to explore to what extent the creativity research community needs to revisit and reflect on the CAT and solidify protocols for its implementation. The conclusion highlights the need for new debate and a program of research to clarify, evidence, and harmonize CAT methodology, while simultaneously preserving the CAT’s flexibility. This would enable the development and sophistication of the CAT, including possible new assistive technologies, to further strengthen its use within the science of creativity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 31,709
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
The standard definition of creativity
Runco, M. A., & Jaeger, G. J. (2012) · Creativity Research Journal · doi:10.1080/10400419.2012.650092 · Cited by 3,895
Social psychology of creativity: A consensual assessment technique.
Amabile, T. M. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.43.5.997 · Cited by 2,278
Can There Ever Be Too Many Options? A Meta-Analytic Review of Choice Overload
Scheibehenne, B., Greifeneder, R., & Todd, P. M. (2010) · Journal of Consumer Research · doi:10.1086/651235 · Cited by 1,070
Silvia, P. J., Winterstein, B. P., Willse, J. T., Barona, C. M., Cram, J. T., Hess, K. I., Martinez, J. L., & Richard, C. A. (2008) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/1931-3896.2.2.68 · Cited by 912
Jauk, E., Benedek, M., Dunst, B., & Neubauer, A. C. (2013) · Intelligence · doi:10.1016/j.intell.2013.03.003 · Cited by 476
A Comparison of Expert and Nonexpert Raters Using the Consensual Assessment Technique
Kaufman, J. C., Baer, J., Cole, J. C., & Sexton∗, J. D. (2008) · Creativity Research Journal · doi:10.1080/10400410802059929 · Cited by 374
Expertise, Domains, and the Consensual Assessment Technique
KAUFMAN, J. C., BAER, J., & COLE, J. C. (2009) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.2009.tb01316.x · Cited by 210
Cited by
Scoring divergent thinking tests: A review and systematic framework.
Reiter-Palmon, R., Forthmann, B., & Barbot, B. (2019) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/aca0000227 · Cited by 391
Automating creativity assessment with SemDis: An open platform for computing semantic distance
Beaty, R. E., & Johnson, D. R. (2021) · Behavior Research Methods · doi:10.3758/s13428-020-01453-w · Cited by 341
Humans versus AI: whether and why we prefer human-created compared to AI-created artwork
Bellaiche, L., Shahi, R., Turpin, M. H., Ragnhildstveit, A., Sprockett, S., Barr, N., Christensen, A., & Seli, P. (2023) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-023-00499-6 · Cited by 233
“…considers creativity to be not an absolute construct, but a consequence of changing interactions between subjective criteria and socio-cultural factors like technology (i.e., “in the eye of the beholder”; Amabile, 1982; Cseh & Jeffries, 2019; Hennessey et al., 2011; Kaufman & Sternberg, 2010).”
BackgroundLloyd-Cox, J., Pickering, A., & Bhattacharya, J. (2022) · Creativity Research Journal · doi:10.1080/10400419.2022.2125721 · Cited by 59
Assessing and understanding creativity in large language models
Zhao, Y., Zhang, R., Li, W., & Li, L. (2025) · Machine Intelligence Research · doi:10.1007/s11633-025-1546-4 · Cited by 57
Metadata
- Authors
- Cseh, G. M., & Jeffries, K. K.
- Venue
- Psychology of Aesthetics, Creativity, and the Arts
- Published
- 2019-05
- Volume
- 13
- Issue
- 2
- Pages
- 159-166
- ISSN
- 1931-3896 (ISSN-L)
- 1931-390X
- OpenAlex
- W2938716636
- Cited by
- 171
- References
- 9
- FWCI
- 15.67
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A scattered CAT: A critical evaluation of the consensual assessment technique for creativity research. https://app.cochat.ai/papers/10.1037/aca0000220
- The paper
- Cseh, G. M., & Jeffries, K. K. (2019). A scattered CAT: A critical evaluation of the consensual assessment technique for creativity research. Psychology of Aesthetics, Creativity, and the Arts. https://doi.org/10.1037/aca0000220
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.