The DOI matches its Crossref record; 30 of the 31 references it cites were found in a registry or an index.
Expertise, Domains, and the Consensual Assessment Technique
Abstract
The Consensual Assessment Technique (CAT) argues that the most valid judgments of the creativity are those of the combined opinions of experts in the field. Yet who exactly qualifies as an expert to evaluate a creative product such as a short story? This study examines both novice and expert judgments of student short fiction. Results indicate a need for caution in using non‐expert raters. Although there was only a small (but statistically significant) difference between experts' and novices' mean ratings, the correlation between the two sets of ratings was just .71. Experts were also far more consistent in their ratings compared to novices, whose level of inter‐rater reliability was potentially problematic.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In line with creativity research that utilizes the CAT35–37, poets were given the poems in different, randomly generated orders and asked to rate the creativity of each poem on a 1 (lowest creativity score) to 40 (highest creativity score) scale.”
From Establishing the importance of co-creation and self-efficacy in creative collaboration with artificial intelligence (2024) · cites this paper as [37]
Citations
Cites
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,417
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,421
Creativity In Context: Update To The Social Psychology Of Creativity
Amabile, T. M. (1996) · Cited by 3,218
The Social Psychology of Creativity
Amabile, T. M. (1983) · Springer eBooks · doi:10.1007/978-1-4612-5533-8 · Cited by 3,183
Sternberg, R. J. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511807916.002 · Cited by 2,413
Social psychology of creativity: A consensual assessment technique.
Amabile, T. M. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.43.5.997 · Cited by 2,278
Implications of a Systems Perspective for the Study of Creativity
Csíkszentmihályi, M. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511807916.018 · Cited by 1,462
Creativity in science: chance, logic, genius, and zeitgeist
(2005) · Choice Reviews Online · doi:10.5860/choice.42-2773 · Cited by 447
Simonton, D. K. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9781139165358 · Cited by 445
A Comparison of Expert and Nonexpert Raters Using the Consensual Assessment Technique
Kaufman, J. C., Baer, J., Cole, J. C., & Sexton∗, J. D. (2008) · Creativity Research Journal · doi:10.1080/10400410802059929 · Cited by 374
Self-citation
Research works printed but not linked: 3
- Anastasi A., 1998, Psychological testing (7th ed.).
- Baer J., Handbook of assessment technologies, methods, and applications in higher education.
- Elbow P., 1999, A community of writers: A workshop course in writing (3rd ed.).
Cited by
Sorted by citations
Plucker, J. A., & Makel, M. C. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511763205.005 · Cited by 503
Beyond New and Appropriate: Who Decides What Is Creative?
Kaufman, J. C., & Baer, J. (2012) · Creativity Research Journal · doi:10.1080/10400419.2012.649237 · Cited by 337
Self-citationIs Creativity Domain Specific?
Baer, J. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511763205.021 · Cited by 221
Self-citationFurious activity vs. understanding: How much expertise is needed to evaluate creative work?
Kaufman, J. C., Baer, J., Cropley, D. H., Reiter‐Palmon, R., & Sinnett, S. (2013) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/a0034809 · Cited by 210
Self-citationAssessing Creativity Using the Consensual Assessment Technique
Baer, J., & McKool, S. S. (2009) · IGI Global eBooks · doi:10.4018/978-1-60566-667-9.ch004 · Cited by 204
Self-citation
Metadata
- Authors
- KAUFMAN, J. C., BAER, J., & COLE, J. C.
- Affiliations
- California State University, San Bernardino (US)
- Venue
- The Journal of Creative Behavior
- Publisher
- Wiley
- Published
- 2009-12
- Volume
- 43
- Issue
- 4
- Pages
- 223-233
- ISSN
- 0022-0175 (ISSN-L)
- 2162-6057
- OpenAlex
- W2044474488
- Cited by
- 210
- References
- 31
- Citations by year
- 2026: 7 · 2025: 10 · 2024: 14 · 2023: 43 · 2022: 11 · 2021: 14 · 2020: 20 · 2019: 12 · 2018: 13 · 2017: 9 · 2016: 10 · 2015: 13 · 2014: 13 · 2013: 6 · 2012: 7
- FWCI
- 6.34
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Journal of Creative Behavior (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Creativity in Education and Neuroscience
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Artistic and Creative Research
- Keywords
- Consensual Assessment Technique, creativity assessment, expert opinion, inter-rater reliability, rater expertise, rater consistency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
