Quantifying the Creativity Support of Digital Tools through the Creativity Support Index
The DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index.
Abstract
Creativity support tools help people engage creatively with the world, but measuring how well a tool supports creativity is challenging since creativity is ill-defined. To this end, we developed the Creativity Support Index (CSI), which is a psychometric survey designed for evaluating the ability of a creativity support tool to assist a user engaged in creative work. The CSI measures six dimensions of creativity support: Exploration, Expressiveness, Immersion, Enjoyment, Results Worth Effort, and Collaboration. The CSI allows researchers to understand not just how well a tool supports creative work overall, but what aspects of creativity support may need attention. In this article, we present the CSI, along with scenarios for how it can be deployed in a variety of HCI research settings and how the CSI scores can help target design improvements. We also present the iterative, rigorous development and validation process used to create the CSI.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, the citations to researcher's inspirations in the first-person accounts are not captured by the RiCE questionnaire [44], nor other questionnaire measures typically used in creative HCI research [25,59].”
From Reflection Across AI-based Music Composition (2024) · cites this paper as [25]
In the citing paper
“The Creativity Support Index (CSI) [17] is a widely used and psychometrically validated survey instrument that attempts to standardize some aspects of this experience reporting process across different CSTs.”
From Homogenization Effects of Large Language Models on Human Creative Ideation (2024) · cites this paper as [17]
In the citing paper
“They also found Luminate provided creativity support, scoring CSI at 82.16 (SD = 5.14) - a high score for creativity support index [17].”
From Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation (2024) · cites this paper as [17]
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
The application of electronic computers to factor analysis
Kaiser, H. F. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000116 · Cited by 12,459
NASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297
Creativity In Context: Update To The Social Psychology Of Creativity
Amabile, T. M. (1996) · Cited by 3,218
Boden, M. A. (2004) · doi:10.4324/9780203508527 · Cited by 2,775
Beyond Big and Little: The Four C Model of Creativity
Kaufman, J. C., & Beghetto, R. A. (2009) · Review of General Psychology · doi:10.1037/a0013688 · Cited by 2,669
Toward a broader conception of creativity: A case for "mini-c" creativity.
Beghetto, R. A., & Kaufman, J. C. (2007) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/1931-3896.1.2.73 · Cited by 900
Creativity support tools: accelerating discovery and innovation
Shneiderman, B. (2007) · Communications of the ACM · doi:10.1145/1323688.1323689 · Cited by 765
Creative Mind: Myths and Mechanisms
Boden, M. A. (2003) · Figshare · Cited by 679
A Taxonomy and Critique of Measurements Used in the Study of Creativity
Hocevar, D., & Bachelor, P. (1989) · Handbook of Creativity · doi:10.1007/978-1-4757-5356-1_3 · Cited by 274
Creativity Support Tools: Report From a U.S. National Science Foundation Sponsored Workshop
Shneiderman, B., Fischer, G., Czerwinski, M., Resnick, M., Myers, B., Candy, L., Edmonds, E., Eisenberg, M., Giaccardi, E., Hewett, T., et al. (2006) · International Journal of Human-Computer Interaction · doi:10.1207/s15327590ijhc2002_1 · Cited by 274
Ideational fluency as a confounding factor in the measurement of originality.
Hocevar, D. (1979) · Journal of Educational Psychology · doi:10.1037//0022-0663.71.2.191 · Cited by 233
A History of Research on Creativity
Albert, R. S., & Runco, M. A. (1998) · Handbook of Creativity · doi:10.1017/cbo9780511807916.004 · Cited by 200
Proceedings of Graphics Interface 2013
Samavati, F. F., & Hawkey, K. (2013) · Graphics Interface · Cited by 167
Creativity factor evaluation: towards a standardized survey metric for creativity support
Carroll, E. A., Latulipe, C., Fung, R., & Terry, M. A. (2009) · Creativity and Cognition · doi:10.1145/1640233.1640255 · Cited by 146
Self-citationCarroll, E. A., & Latulipe, C. (2009) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1520340.1520609 · Cited by 74
Self-citationTriangulating the personal creative experience: self-report, external judgments, and physiology
Carroll, E. A., & Latulipe, C. (2012) · Graphics Interface · Cited by 39
Self-citationAn Experimental Method for Measuring the Emergence of New Ideas in Information Discovery
Kerne, A., Smith, S. M., Koh, E., Choi, H. J., & Graeber, R. (2008) · International Journal of Human-Computer Interaction · doi:10.1080/10447310802142243 · Cited by 38
Creativity and Rationale: Enhancing Human Experience by Design
Carroll, J. M. (2012) · Human-computer interaction series · doi:10.1007/978-1-4471-4111-2 · Cited by 34
Creative projects with LEGO mindstorms
Erwin, B. (2001) · Cited by 18
Fung, R., Lank, E., Terry, M. A., et al. (2008) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1449715.1449725 · Cited by 17
Self-citationBiCEP: bimanual color exploration plugin
Gonzalez, B., & Latulipe, C. (2011) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1979742.1979795 · Cited by 17
Self-citationThe value of research in creativity and the arts
Latulipe, C. (2013) · Creativity and Cognition · doi:10.1145/2466627.2485921 · Cited by 16
Self-citationsymTone: two-handed manipulation of tone reproduction curves
Latulipe, C., Bell, I. E., Clarke, C. L. A., & Kaplan, C. S. (2006) · Cited by 16
Self-citation
Research works printed but not linked: 6
- Csikszentmihalyi Mihaly, 1997, Creativity: Flow and the Psychology of Discovery and Invention
- Hewett Tom, 2005, NSF Workshop Report on Creativity Support Tools.
- 10.1037/0022-0663.71.2.191 · doi:10.1037/0022-0663.71.2.191 · Paper page
- Hocevar Dennis, Handbook of Creativity
- Michael J. A. Howe. 2000. Genius Explained. Cambridge University Press. Michael J. A. Howe. 2000. Genius Explained. Cambridge University Press.
- Latulipe Celine, Proceedings of GI’06
Cited by
Mapping the Landscape of Creativity Support Tools in HCI
Frich, J., MacDonald Vermeulen, L., Remy, C., Biskjaer, M. M., & Dalsgaard, P. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300619 · Cited by 410
“Even so, there is now a conference dedicated to this special research interest (the Creativity & Cognition symposia were established as an ACM SIGCHI conference in 1999), the number of creativitydirected publications by the CHI community has increased dramatically since the late 1990s [52], and even HCI-specific metho…”
BackgroundHomogenization Effects of Large Language Models on Human Creative Ideation
Anderson, B. R., Shah, J. H., & Kreminski, M. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656204 · Cited by 188
“The Creativity Support Index (CSI) [17] is a widely used and psychome-trically validated survey instrument that attempts to standardize some aspects of this experience reporting process across different CSTs.”
BackgroundMethodSparks: Inspiration for Science Writing using Language Models
Gero, K. I., Liu, V., & Chilton, L. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533533 · Cited by 161
“After this, the participant flled out a short survey, which included the Creativity Support Index [13], and partook in a semistructured interview with the facilitator.”
MethodSuh, S., Chen, M., Min, B., Li, T. J.-J., & Xia, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642400 · Cited by 148
Using text-to-image generation for architectural design ideation
Paananen, V., Oppenlaender, J., & Visuri, A. (2023) · International Journal of Architectural Computing · doi:10.1177/14780771231222783 · Cited by 222
“A Kruskal – Wallis test found no signi fi cant differences in the CSI scores between the three generative tools ( χ 2 (2) = 1.04, p = .”
Influential
Metadata
- Authors
- Cherry, E., & Latulipe, C.
- Affiliations
- University of North Carolina at Charlotte (US)
- ORCID
- Latulipe, Celine
- Venue
- ACM Transactions on Computer-Human Interaction
- Published
- 2014-06
- Volume
- 21
- Issue
- 4
- Pages
- 1-25
- ISSN
- 1073-0516 (ISSN-L)
- 1557-7325
- OpenAlex
- W2087641817
- Semantic Scholar
- d32c3b85a853c3b315fbc31c3267f5dd6d20f067
- Cited by
- 498
- References
- 25
- Citations by year
- 2026: 118 · 2025: 99 · 2024: 67 · 2023: 47 · 2022: 38 · 2021: 33 · 2020: 25 · 2019: 22 · 2018: 22 · 2017: 13 · 2016: 7 · 2015: 7
- FWCI
- 17.45
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Computer-Human Interaction (publishedVersion)
- Funders
- Division of Information and Intelligent Systems (IIS-0855882)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Creativity in Education and Neuroscience
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- creativity support tools, creativity assessment, creative work, exploration, expressiveness, immersion, enjoyment, collaboration, tool evaluation, design improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.