Cited by 210Creativity in Education and NeuroscienceReliability and Agreement in MeasurementArtistic and Creative Research

The DOI matches its Crossref record; 30 of the 31 references it cites were found in a registry or an index.

Expertise, Domains, and the Consensual Assessment Technique

KAUFMAN, JAMES C., BAER, JOHN, COLE, JASON C.·2009·The Journal of Creative Behavior

DOI 10.1002/j.2162-6057.2009.tb01316.x

Open this paper in CoChat — free account

Abstract

The Consensual Assessment Technique (CAT) argues that the most valid judgments of the creativity are those of the combined opinions of experts in the field. Yet who exactly qualifies as an expert to evaluate a creative product such as a short story? This study examines both novice and expert judgments of student short fiction. Results indicate a need for caution in using non‐expert raters. Although there was only a small (but statistically significant) difference between experts' and novices' mean ratings, the correlation between the two sets of ratings was just .71. Experts were also far more consistent in their ratings compared to novices, whose level of inter‐rater reliability was potentially problematic.

Integrity signals

Registry

Crossref · 10.1002/j.2162-6057.2009.tb01316.x

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,417
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,421
Creativity In Context: Update To The Social Psychology Of Creativity
Amabile, T. M. (1996) · Cited by 3,218
The Social Psychology of Creativity
Amabile, T. M. (1983) · Springer eBooks · doi:10.1007/978-1-4612-5533-8 · Cited by 3,183
Handbook of Creativity
Sternberg, R. J. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511807916.002 · Cited by 2,413
Social psychology of creativity: A consensual assessment technique.
Amabile, T. M. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.43.5.997 · Cited by 2,278
Implications of a Systems Perspective for the Study of Creativity
Csíkszentmihályi, M. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511807916.018 · Cited by 1,462
Creativity in science: chance, logic, genius, and zeitgeist
(2005) · Choice Reviews Online · doi:10.5860/choice.42-2773 · Cited by 447
Creativity in Science
Simonton, D. K. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9781139165358 · Cited by 445
A Comparison of Expert and Nonexpert Raters Using the Consensual Assessment Technique
Kaufman, J. C., Baer, J., Cole, J. C., & Sexton∗, J. D. (2008) · Creativity Research Journal · doi:10.1080/10400410802059929 · Cited by 374
Self-citation

Show all 31 references

Research works printed but not linked: 3

Anastasi A., 1998, Psychological testing (7th ed.).
Baer J., Handbook of assessment technologies, methods, and applications in higher education.
Elbow P., 1999, A community of writers: A workshop course in writing (3rd ed.).

Sorted by citations

Items 101–200 of 210

Consensual assessment in the new domain of e-textiles: Comparing insights from expert, quasi-expert, and novice judges.
Phonethibsavads, A., Dahn, M., Peppler, K., Fields, D. A., & Kafai, Y. B. (2020) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000370 · Cited by 7
Cultural differences of scientific creativity : a relation with tolerance of ambiguity/uncertainty : an empirical study with children in Luxembourg, France, Thailand, India, and Russia
de Vries, H. (2018) · theses.fr (ABES) · doi:10.70675/26960750z2155z488dza6e2zc1620ff3c292 · Cited by 7
Detecting Fixation Bias in Creative Idea Generation: Evidence from Design Novices and Experts
Camarda, A., Neys, W. D., Ozkalp-Poincloux, B., Hooge, S., Masson, P. L., Weil, B., & Cassotti, M. (2024) · Creativity Research Journal · doi:10.1080/10400419.2024.2424620 · Cited by 10
Augmented Learning for Joint Creativity in Human-GenAI Co-Creation
Luan, Y. L., Kim, Y. J., & Zhou, J. (2025) · Information Systems Research · doi:10.1287/isre.2024.0984 · Cited by 12
Augmentation or limitation? Generative AI’s influence on college students’ creative problem-solving
Wang, H., Da, T., Wang, Y., Luo, F., Zhang, Y., Tlili, A., Yang, D., Wang, Y., Xu, J., Zhu, X., et al. (2025) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2025.102116 · Cited by 7
CAEMSI : A Cross-Domain Analytic Evaluation Methodology for Style Imitation.
Ens, J., & Pasquier, P. (2018) · ICCC · Cited by 6
Evaluating digital poetry: Insights from the CAT.
Lamb, C., Brown, D. G., & Clarke, C. L. A. (2016) · ICCC · Cited by 6
Theory in Creativity Research: The Pernicious Impact of Domain Generality
Baer, J. (2018) · Creativity theory and action in education · doi:10.1007/978-3-319-90272-2_7 · Cited by 6
Self-citation
The effort heuristic in little-c evaluations: An effort-derogation effect
Zhang, A. Q., Zhang, Y., Pei, Y., & Pang, W. (2024) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2024.101715 · Cited by 6
Impacts of Media Literacy on Perceived Learning Outcomes and the Creative Achievement of Art Students in Digital Learning Environments
Xu, R., Hsu, Y., & Wang, X. (2025) · Psychology in the Schools · doi:10.1002/pits.23486 · Cited by 7
Structured diary introspection training: A kind of critical thinking training method can enhance the Pro-C creativity of interior designers
Li, H., Liu, Y., Wang, T., Xiao, R., Song, L., Xie, W., Wang, Z., Wu, Y., Su, R., Ma, H., et al. (2024) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2024.101530 · Cited by 5
Idea evaluation: Combining openness and expertise
Rietzschel, E. F., Baas, M., & Nijstad, B. A. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-91840-4.00016-5 · Cited by 6
Domain Specificity of Creativity: Conception and Measurement
涂, 翠. (2015) · Advances in Psychology · doi:10.12677/ap.2015.511084 · Cited by 5
97Avaliação Psicológica, 2020, 19(1), pp. 97-105Métodos Atuais paraAvaliação da Criatividade: Vantagens e Questionamentos
Nakano, T. D. C. (2020) · Revista Avaliação Psicológica · doi:10.15689/ap.2020.1901.14269.11 · Cited by 5
Journal Special Issues
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.005.0004 · Cited by 5
Understanding scientific creativity criteria: Biologists’ assessments of PhD students’ creative products using the CAT
Pontis, S., & Salerno, G. L. (2025) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2025.101861 · Cited by 4
Critiquing the Critics: Statistical Analysis of Music Critics' Rating Distributions as a Measure of Individual Refinement
Lundy, D. E. (2013) · Empirical Studies of the Arts · doi:10.2190/em.31.1.d · Cited by 4
Intelligence and Creativity: Epistemological Connections and Operational Implications in Educational Contexts
Vestena, C. L. B., Berg, J., Silva, W. K., & Costa-Lobo, C. (2020) · Creative Education · doi:10.4236/ce.2020.117088 · Cited by 4
A quantitative analysis of two improvisation assessment instruments
Hickey, M., Healy, D., & Schmidt, C. (2021) · Psychology of Music · doi:10.1177/0305735620988788 · Cited by 4
Measuring Creativity at Work
Caroff, X., Massu, J., & Lubart, T. (2018) · Springer eBooks · doi:10.1007/978-3-319-77350-6_1 · Cited by 4
Perceived Interpersonal Dimensions and Its Effect on Rating Bias: How Neuroticism as a Trait Matters in Rating Creative Works
Cheng, K. H. C. (2016) · The Journal of Creative Behavior · doi:10.1002/jocb.156 · Cited by 4
A Wandering Mind is Not Always a Creative Mind: How Thought Dynamics Explain the Relationship between Mind Wandering and Creativity
de Rooij, A., Atef, A., & Faber, M. (2024) · The Journal of Creative Behavior · doi:10.1002/jocb.640 · Cited by 3
A Review on Evaluation Methods of Creative Thinking
姜, 竹. (2019) · Advances in Psychology · doi:10.12677/ap.2019.91021 · Cited by 3
The Black Box of the Consensual Assessment Technique: Some Questions and Doubts on the Subjective Rating of Creativity
Caroff, X., & Massu, J. (2022) · Creativity in the twenty first century · doi:10.1007/978-3-030-99674-1_11 · Cited by 3
An investigation into technology and motivational influences on creativity and product output in apparel design students
Freeman, C. E. (2012) · Louisiana State University · doi:10.31390/gradschool_dissertations.3257 · Cited by 3
Technology: Networks and Maps in Creativity Research, 1999–2018
Zhang, W., & Jiang, Y. Y. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.23857-1 · Cited by 4
A Review of Approaches to the Assessment of Product CreativityPreprint
Cropley, D. H. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/7d4av · Cited by 4
Expanding Creativity Evaluation: Mapping Cognitive Flexibility and Fixation in PISA Assessments
Cassotti, M., Besançon, M., Lubart, T., & Camarda, A. (2026) · The Journal of Creative Behavior · doi:10.1002/jocb.70110 · Cited by 2
A kreativitás fejlesztése digitális eszközökkel támogatott tanulási környezetben: Mit üzennek a kutatások az osztályterem számára és mikor hallgatnak?
Bereczki, E. O. (2019) · Iskolakultúra · doi:10.14232/iskkult.2019.4-5.50 · Cited by 2
Technology and Creativity
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0015 · Cited by 2
Multifactor models of creativity: structural and dynamic approaches in psychological assessment
Gryazeva-Dobshinskaya, V. G., Koltunov, E. I., Korobova, S. Y., Глухова, В. А., & Naboychenko, E. S. (2024) · The Education and science journal · doi:10.17853/1994-5639-2024-9-129-150 · Cited by 2
Self-Reported Drug Use and Creativity: (Re)Establishing Layperson Myths
Humphrey, D. E., McKay, A. S., Primi, R., & Kaufman, J. C. (2014) · Imagination Cognition and Personality · doi:10.2190/ic.34.2.f · Cited by 2
Self-citation
Mature Cinematic Content for Immature Minds: “Pushing the Envelope” versus “Toning it Down” in Family Films
Simonton, D. K., Skidmore, L. E., & Kaufman, J. C. (2012) · Empirical Studies of the Arts · doi:10.2190/em.30.2.c · Cited by 2
Self-citation
Creativity and Sociality
Glăveanu, V. P. (2014) · SpringerBriefs in psychology · doi:10.1007/978-3-319-05434-6_3 · Cited by 2
Assessing Creative Products by Experts
Tsai, K. C. (2013) · RePEc: Research Papers in Economics · Cited by 2
Creating Creative Animals11Pryor (2015).
Pryor, K. W. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-800648-1.00017-6 · Cited by 2
Measuring the Aesthetic Success of Books: Can User-driven Databases Fill the Gap?
Form, S. (2017) · Creativity Theories – Research – Applications · doi:10.1515/ctra-2017-0016 · Cited by 2
Do We Have Creative Differences? How We Construe Creativity Influences the Salience of Novelty and Usefulness
Berry, J. W. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/zd8t-sg30 · Cited by 2
Creativity and Mental Health
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0010 · Cited by 2
Defining Creativity Through Assessment
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0003 · Cited by 3
Data-driven and machine learning based design creativity
Chen, L. (2020) · Spiral (Imperial College London) · doi:10.25560/82639 · Cited by 2
The Sociology of Creativity
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0011 · Cited by 1
Performance management system in the higher learning institutions in Tanzania: horses for courses?
Komungemwe, T., & Marijani, R. (2025) · Cogent Education · doi:10.1080/2331186x.2025.2453277 · Cited by 1
Random Forest Predicts Human Ratings of Creative Stories Using Very Small Training Samples
Barbot, B., & Kiekens, T. C. (2026) · Behavioral Sciences · doi:10.3390/bs16040576 · Cited by 1
Measuring design innovation for project-based design assessment: considerations of robustness and efficiency
Schunn, C. D., Chan, J., & Goncher, A. (2017) · Bitácora Urbano Territorial · doi:10.15446/bitacora.v27n4esp.68959 · Cited by 1
Creativity
Baer, J. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199841332.013.12 · Cited by 1
Self-citation
The Creative Personality
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0004 · Cited by 1
The Creative Process, Part 1
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0005 · Cited by 1
Conceptions of Creativity
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0002 · Cited by 3
Assessing Creativity in the Language Classroom with the Consensual Assessment Technique
Hlas, A. C., Julson, J., & Hlas, C. S. (2024) · Creativity Research Journal · doi:10.1080/10400419.2024.2311482 · Cited by 1
Stability of Assessment Using Creativity‐Related Indices
Terai, H., Miwa, K., & Mizuno, S. (2024) · Japanese Psychological Research · doi:10.1111/jpr.12519 · Cited by 1
An assessment framework for creative production in computing and engineering disciplines
Che, X., & Ip, B. (2024) · Computers and Education Open · doi:10.1016/j.caeo.2024.100220 · Cited by 1
The Impact of Positive Versus Negative Exemplar‐Based Instructions on a Creative Writing Task
Stemler, S. E., & Kaufman, J. C. (2025) · The Journal of Creative Behavior · doi:10.1002/jocb.70008 · Cited by 1
Self-citation
Creativity in Engineering Education
Cropley, D. H. (2025) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197698181.013.0028 · Cited by 2
Categorización de creatividad en diseños generados por estudiantes de secundaria
Rodríguez, F. P. (2025) · Enseñanza de las Ciencias Revista de investigación y experiencias didácticas · doi:10.5565/rev/ensciencias.6368 · Cited by 1
De (on)mogelijkheid van een valide meting van creatief potentieel voor selectiedoeleinden
Baas, M., & van der Maas, H. L. J. (2015) · Gedrag & Organisatie · doi:10.5117/2015.028.002.002 · Cited by 1
Matrix representation of ideas: stimulating creativity using matrix Algebra
Tang, V. (2019) · International Journal of Innovation Science · doi:10.1108/ijis-06-2018-0062 · Cited by 1
Creativity Ratings of Fashion Outfits Presented on Instagram: Does Gender Matter?
Barth, P., & Stadtmann, G. (2022) · Creativity Theories – Research – Applications · doi:10.2478/ctra-2022-0002 · Cited by 1
A Review of the Influencing Factors of Creativity Evaluation
张, 俊. (2021) · Advances in Social Sciences · doi:10.12677/ass.2021.102057 · Cited by 1
User involvement in service design teams : Investigating the effect of involving users in ideation of library services
Trischler, J. (2014) · Cross Connect (Southern Cross University) · Cited by 1
The Role of Chosen Creativity Measurements in Observed Relationships to Personality
Puryear, J. S. (2016) · doi:10.12794/metadc849658 · Cited by 1
VALIDACIJA KOEFICIJENTA IZUZETNOSTI U PROCENI LIKOVNIH PRODUKATA
Ristić, I., & Milošević, M. (2018) · Primenjena psihologija · doi:10.19090/pp.2018.2.227-246 · Cited by 1
Measurement: Creative Products
Baer, J. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.23716-4 · Cited by 1
Self-citation
Culture and Creativity
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0014 · Cited by 1
Domain Specificity of Creativity: Conception and Measurement
Tu, C., & Fan, F. (2015)
Creative Minds Abroad: How Design Students Make Meaning of Their International Education Experiences
Johnson, R. (2016) · University of Minnesota Digital Conservancy (University of Minnesota)
Assessing the Impact of Study Abroad Experience on the Creative Abilities of Design Students.
Fu, J. (2017) · NCSU Libraries Repository (North Carolina State University Libraries)
How Experts Judge Creativity: A Field Study of the Assessment of Creative Output
Seyle, M. R. (2022) · Digital Archive @ GSU · doi:10.57709/12254400
Innovation in Marine Mammals
Kaufman, A. B. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108564113.039
An Investigation of California Classroom Teachers' Beliefs and Ratings of Creativity in Dance
Reedy, P. (2020) · USF Scholarship Repository (University of San Francisco)
Innovation and Problem-Solving
(2021) · Cambridge University Press eBooks · doi:10.1017/9781108564113.034
References
(2016) · Elsevier eBooks · doi:10.1016/b978-0-12-799962-3.00008-2
Forwarding fashion: developing an app to contemporize fashion design assessment and feedback in higher education
Dupuis, G. (2021) · doi:10.32920/ryerson.14657268
Forwarding fashion: developing an app to contemporize fashion design assessment and feedback in higher education
Dupuis, G. (2021) · doi:10.32920/ryerson.14657268.v1
De (on)mogelijkheid van een valide meting van creatief potentieel voor selectiedoeleinden
Baas, M., & van der Maas, H. L. J. (2015) · Gedrag & Organisatie · doi:10.5553/geno/092150772015028002002
Creativity, Consensual Assessment of
Baer, J. (2014) · Encyclopedia of Special Education · doi:10.1002/9781118660584.ese0612
Self-citation
Excellence bias related to rating scales with summative jury assessment
Corradi, D. (2022) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2022.2112653
Overview of Creative Thinking Assessment Research
袁, 丽. (2022) · Advances in Social Sciences · doi:10.12677/ass.2022.118483
การพฒนารปแบบการประเมนความคดสรางสรรคผานการทำโครงงานนวตกรรมของนกเรยนชนมธยมศกษาตอนตน
ถาวรรัตนวณิช, ส. (2020) · doi:10.58837/chula.the.2020.600
The Creative Process, Part 2
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0006
Conclusion
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0021
Science
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0020 · Cited by 2
Copyright Page
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.002.0003
Creative Self-Beliefs
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0009 · Cited by 1
Visual Arts
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0016 · Cited by 1
Writing
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0017 · Cited by 1
Third Edition Literature Review Methodology
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.005.0001
Preface to the Third Edition
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.002.0005
Journals That Publish Creativity Research
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.005.0005
Group Creativity
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0012
Influential Creativity Researchers, 1800–1990
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.005.0008
Theater
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0019
Music
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0018
Biology and Creativity
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0008
A Timeline of Creativity Research
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.005.0002
Influential Books in Creativity Research
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.005.0006
Colleges and Universities with a Degree or Certificate in Creativity
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.005.0007
Organizational Creativity
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0013
Creativity Research Overviews
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.005.0003
The Creative Process, Part 3
Sawyer, R. K., & Henriksen, D. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197747537.003.0007

Authors: KAUFMAN, J. C., BAER, J., & COLE, J. C.
Affiliations: California State University, San Bernardino (US)
ORCID: KAUFMAN, JAMES C.
BAER, JOHN
Venue: The Journal of Creative Behavior
Publisher: Wiley
Published: 2009-12
Volume: 43
Issue: 4
Pages: 223-233
ISSN: 0022-0175 (ISSN-L)
2162-6057
DOI: 10.1002/j.2162-6057.2009.tb01316.x
OpenAlex: W2044474488
Cited by: 210
References: 31
Citations by year: 2026: 7 · 2025: 10 · 2024: 14 · 2023: 43 · 2022: 11 · 2021: 14 · 2020: 20 · 2019: 12 · 2018: 13 · 2017: 9 · 2016: 10 · 2015: 13 · 2014: 13 · 2013: 6 · 2012: 7
FWCI: 6.34
Type: journal article
Language: en
Open access: closed
Licence: onlinelibrary.wiley.com/termsAndConditions#vor (vor, 751 d)
Locations: The Journal of Creative Behavior (publishedVersion)
Topics: Social Sciences › Psychology › Experimental and Cognitive Psychology › Creativity in Education and Neuroscience
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Artistic and Creative Research
Keywords: Consensual Assessment Technique, creativity assessment, expert opinion, inter-rater reliability, rater expertise, rater consistency

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Expertise, Domains, and the Consensual Assessment Technique

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks