Quantifying the Creativity Support of Digital Tools through the Creativity Support Index
The DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index.
Abstract
Creativity support tools help people engage creatively with the world, but measuring how well a tool supports creativity is challenging since creativity is ill-defined. To this end, we developed the Creativity Support Index (CSI), which is a psychometric survey designed for evaluating the ability of a creativity support tool to assist a user engaged in creative work. The CSI measures six dimensions of creativity support: Exploration, Expressiveness, Immersion, Enjoyment, Results Worth Effort, and Collaboration. The CSI allows researchers to understand not just how well a tool supports creative work overall, but what aspects of creativity support may need attention. In this article, we present the CSI, along with scenarios for how it can be deployed in a variety of HCI research settings and how the CSI scores can help target design improvements. We also present the iterative, rigorous development and validation process used to create the CSI.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, the citations to researcher's inspirations in the first-person accounts are not captured by the RiCE questionnaire [44], nor other questionnaire measures typically used in creative HCI research [25,59].”
From Reflection Across AI-based Music Composition (2024) · cites this paper as [25]
In the citing paper
“The Creativity Support Index (CSI) [17] is a widely used and psychometrically validated survey instrument that attempts to standardize some aspects of this experience reporting process across different CSTs.”
From Homogenization Effects of Large Language Models on Human Creative Ideation (2024) · cites this paper as [17]
In the citing paper
“They also found Luminate provided creativity support, scoring CSI at 82.16 (SD = 5.14) - a high score for creativity support index [17].”
From Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation (2024) · cites this paper as [17]
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
The application of electronic computers to factor analysis
Kaiser, H. F. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000116 · Cited by 12,459
NASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297
Creativity In Context: Update To The Social Psychology Of Creativity
Amabile, T. M. (1996) · Cited by 3,218
Boden, M. A. (2004) · doi:10.4324/9780203508527 · Cited by 2,775
Beyond Big and Little: The Four C Model of Creativity
Kaufman, J. C., & Beghetto, R. A. (2009) · Review of General Psychology · doi:10.1037/a0013688 · Cited by 2,669
Toward a broader conception of creativity: A case for "mini-c" creativity.
Beghetto, R. A., & Kaufman, J. C. (2007) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/1931-3896.1.2.73 · Cited by 900
Creativity support tools: accelerating discovery and innovation
Shneiderman, B. (2007) · Communications of the ACM · doi:10.1145/1323688.1323689 · Cited by 765
Creative Mind: Myths and Mechanisms
Boden, M. A. (2003) · Figshare · Cited by 679
A Taxonomy and Critique of Measurements Used in the Study of Creativity
Hocevar, D., & Bachelor, P. (1989) · Handbook of Creativity · doi:10.1007/978-1-4757-5356-1_3 · Cited by 274
Research works printed but not linked: 6
- Csikszentmihalyi Mihaly, 1997, Creativity: Flow and the Psychology of Discovery and Invention
- Hewett Tom, 2005, NSF Workshop Report on Creativity Support Tools.
- 10.1037/0022-0663.71.2.191 · doi:10.1037/0022-0663.71.2.191 · Paper page
- Hocevar Dennis, Handbook of Creativity
- Michael J. A. Howe. 2000. Genius Explained. Cambridge University Press. Michael J. A. Howe. 2000. Genius Explained. Cambridge University Press.
- Latulipe Celine, Proceedings of GI’06
Cited by
Mapping the Landscape of Creativity Support Tools in HCI
Frich, J., MacDonald Vermeulen, L., Remy, C., Biskjaer, M. M., & Dalsgaard, P. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300619 · Cited by 410
“Even so, there is now a conference dedicated to this special research interest (the Creativity & Cognition symposia were established as an ACM SIGCHI conference in 1999), the number of creativitydirected publications by the CHI community has increased dramatically since the late 1990s [52], and even HCI-specific metho…”
BackgroundHomogenization Effects of Large Language Models on Human Creative Ideation
Anderson, B. R., Shah, J. H., & Kreminski, M. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656204 · Cited by 188
“The Creativity Support Index (CSI) [17] is a widely used and psychome-trically validated survey instrument that attempts to standardize some aspects of this experience reporting process across different CSTs.”
BackgroundMethodSparks: Inspiration for Science Writing using Language Models
Gero, K. I., Liu, V., & Chilton, L. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533533 · Cited by 161
“After this, the participant flled out a short survey, which included the Creativity Support Index [13], and partook in a semistructured interview with the facilitator.”
MethodSuh, S., Chen, M., Min, B., Li, T. J.-J., & Xia, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642400 · Cited by 148
Using text-to-image generation for architectural design ideation
Paananen, V., Oppenlaender, J., & Visuri, A. (2023) · International Journal of Architectural Computing · doi:10.1177/14780771231222783 · Cited by 222
“A Kruskal – Wallis test found no signi fi cant differences in the CSI scores between the three generative tools ( χ 2 (2) = 1.04, p = .”
InfluentialArtificial intelligence as a tool for creativity
Ivčević, Z., & Grandinetti, M. (2024) · Journal of Creativity · doi:10.1016/j.yjoc.2024.100079 · Cited by 224
FashionQ: An AI-Driven Creativity Support Tool for Facilitating Ideation in Fashion Design
Jeon, Y., Jin, S., Shih, P. C., & Han, K. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445093 · Cited by 145
“In addition, we will consider applying the CSI (Creativity Support Index) [13] to assess the overall creativity outcomes and usability of FashionQ in future studies.”
MethodPromptMagician: Interactive Prompt Engineering for Text-to-Image Creation
Feng, Y., Wang, X., Wong, K. K., Wang, S., Lu, Y., Zhu, M., Wang, B., & Chen, W. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3327168 · Cited by 124
“To compare our system with two baselines in facilitating creation tasks, we asked the participants to rate three systems based on the Creativity Support Index [9].”
MethodA literature review on individual creativity support systems
Wang, K., & Nickerson, J. V. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.04.035 · Cited by 166
“6 Cherry and Latulipe (2014) proposed a creativity support index to cover six dimensions: Exploration, Expressiveness, Immersion, Enjoyment, Results Worth Effort, and Collaboration.”
BackgroundCreativeConnect: Supporting Reference Recombination for Graphic Design Ideation with Generative AI
Choi, D., Hong, S., Park, J., Chung, J. J. Y., & Kim, J. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642794 · Cited by 124
“Also, the survey included the Creativity Support Index [11] and NASA-TLX questionnaire [30].”
MethodThe effect of AI-based inspiration on human design ideation
Kim, J., & Maher, M. L. (2023) · International Journal of Design Creativity and Innovation · doi:10.1080/21650349.2023.2167124 · Cited by 114
“To evaluate the usability and the user experience of co-creative systems, the studies often used qualitative approaches and a few studies have used a quantitative approach to evaluate the user experience of co-creative systems relying on questionnaires (Kantosalo & Riihiaho, 2019) such as the System Usability Scale (S…”
MethodMay AI? Design Ideation with Cooperative Contextual Bandits
Koch, J., Lucero, A., Hegemann, L., & Oulasvirta, A. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300863 · Cited by 174
“CSI [7] is a standardized psychometric tool for assessing the perceived creativity support of a tool, looking at 1) collaboration, 2) enjoyment, 3) exploration, 4) expressiveness, 5) immersion, and 6) worthiness of effort.”
Frich, J., Biskjær, M. M., & Dalsgaard, P. (2018) · Designing Interactive Systems Conference · doi:10.1145/3196709.3196732 · Cited by 150
PromptPaint: Steering Text-to-Image Generation Through Paint Medium-like Interactions
Chung, J. J. Y., & Adar, E. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606777 · Cited by 152
“This survey asked questions in the creativity support index [14], except those that questioned whether the tool helped collaboration.”
Chan, L., Liao, Y.-C., Mo, G. B., Dudley, J. J., Cheng, C.-L., Kristensson, P. O., & Oulasvirta, A. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501850 · Cited by 109
“Table 2 summarizes the CSI scores and the statistics analysis between the groups.”
MethodInfluentialEvaluating Creativity Support Tools in HCI Research
Remy, C., MacDonald Vermeulen, L., Frich, J., Biskjaer, M. M., & Dalsgaard, P. (2020) · Proceedings of the 2020 ACM Designing Interactive Systems Conference · doi:10.1145/3357236.3395474 · Cited by 96
“A bid for this might be the already available and thoroughly tested CSI [27], as some of the creativity metrics surveyed in this paper [139, 82, 45, 123] could be at least partly covered using the CSI.”
BackgroundInfluentialQin, H. X., Jin, S., Gao, Z., Fan, M., & Hui, P. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642105 · Cited by 82
“Instead, we compare the different factors of the CSI, which is the suggested method for comparing two different creativity support tools [19].”
BackgroundMethodExploring the use of AR technology for co-creative product and packaging design
Cascini, G., O'Hare, J. A., Dekoninck, E. A., Becattini, N., Boujut, J.-F., Guefrache, F. B., Carli, I., Caruso, G., Giunta, L., & Morosi, F. (2020) · Computers in Industry · doi:10.1016/j.compind.2020.103308 · Cited by 95
“E. Cherry, C. Latulipe, Quantifying the Creativity Support of Digital Tools through the Creativity Support Index, ACM Transactions on Computer-Human Interaction, 21(4), (2014) 1–25. doi.org/10.1145/2617588 S. H. Choi, M. Kim, J. Y. Lee, Situation-dependent remote AR collaborations: Image-based collaboration using a 3D…”
MethodInfluentialThe Intersection of Users, Roles, Interactions, and Technologies in Creativity Support Tools
Chung, J. J. Y., He, S., & Adar, E. (2021) · Designing Interactive Systems Conference · doi:10.1145/3461778.3462050 · Cited by 117
“[21] introduced Creativity Support Index (CSI), evaluating CSTs in six criteria: exploration, collaboration, engagement, effort, tool transparency, and expressiveness.”
MethodRezwana, J., & Maher, M. L. (2022) · Creativity and Cognition · doi:10.1145/3527927.3532789 · Cited by 85
“A single CSI score is produced out of 100 for each prototype from the surveys.”
BackgroundMethodInfluentialXAIR: A Framework of Explainable AI in Augmented Reality
Xu, X., Yu, A., Jonker, T. R., Todi, K., Lu, F., Qian, X., Belo, J. M. E., Wang, T., Li, M., Mun, A., et al. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581500 · Cited by 108
“To quantify the utility of XAIR, we employed the Creativity Support Index (CSI, 1-10 Likert scale) [55] and System Usability Scale (SUS) [24].”
MethodBeyond the Artifact: Power as a Lens for Creativity Support Tools
Li, J., Rawn, E., Ritchie, J., O'Leary, J. T., & Follmer, S. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606831 · Cited by 114
“…to get started include treating CSTs as a form of research through design [45], and reporting not only results from the Creativity Support Index [22] and NASA-TLX [53] but also embracing qualitative and ethnographic methods such as offering thick descriptions [46] and interpretive criticism [5]…”
GRIDS: Interactive Layout Design with Integer Programming
Dayama, N. R., Todi, K., Saarelainen, T., & Oulasvirta, A. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376553 · Cited by 82
“We analysed the number of designs created by designers, as well as scores from the SUS and CSI questionnaires.”
MethodInfluentialKoch, J., Taffin, N., Lucero, A., & Mackay, W. E. (2020) · Designing Interactive Systems Conference · doi:10.1145/3357236.3395494 · Cited by 65
“Creativity Support Index [10], which measures 1) collaboration, 2) enjoyment, 3) exploration, 4) expressiveness, 5) immersion, and 6) worthiness of effort; and 2.”
LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editing
Wang, B. K., Li, Y., Lv, Z., Xia, H., Xu, Y., & Sodhi, R. (2024) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3640543.3645143 · Cited by 140
“Additionally, we adapted applicable questions from the Creative Support Index [18].”
BackgroundMethodCASSIE: Curve and Surface Sketching in Immersive Environments
Yu, E., Arora, R., Stanko, T., Bærentzen, J. A., Singh, K. S., & Bousseau, A. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445158 · Cited by 82
“Users evaluated the degree of creative support provided by each system via the Creative Support Index (CSI) questionnaire [10].”
BackgroundMethodInfluentialOn the Development and Practice of AI Technology for Contemporary Popular Music Production
Deruty, E., Grachten, M., Lattner, S., Nistal, J., & Aouameur, C. (2022) · Transactions of the International Society for Music Information Retrieval · doi:10.5334/tismir.100 · Cited by 132
Kim, J., Suh, S., Chilton, L. B., & Xia, H. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3595996 · Cited by 61
“” The ratings for the creativity support index [23] showed that Metaphorian provided an immersive writing experience.”
BackgroundChakrabarty, T., Padmakumar, V., Brahman, F., & Muresan, S. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656201 · Cited by 61
Curriculum ergonomics: Conceptualizing the interactions between curriculum design and use
Choppin, J., McDuffie, A. R., Drake, C., & Davis, J. D. (2018) · International Journal of Educational Research · doi:10.1016/j.ijer.2018.09.015 · Cited by 69
GEM-NI: A System for Creating and Managing Alternatives In Generative Design
Zaman, L., Stuerzlinger, W., Neugebauer, C., Woodbury, R., Elkhaldi, M., Shireen, N., & Terry, M. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702398 · Cited by 59
“Since the tasks in our study were similar enough, we performed the CSI evaluation as a within subject tool comparison with the same task.”
MethodResultInfluentialEvolving Roles and Workflows of Creative Practitioners in the Age of Generative AI
Palani, S., & Ramos, G. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656190 · Cited by 111
Drawing with Reframer: Emergence and Control in Co-Creative AI
Lawton, T., Ibarrola, F., Ventura, D. A., & Grace, K. S. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581641.3584095 · Cited by 90
“The Creativity Support Index (CSI) [5] is a simple and flexible survey-based method for evaluating user perceptions of a creativity support tool.”
BackgroundMethodInfluentialInfoColorizer: Interactive Recommendation of Color Palettes for Infographics
Yuan, L.-P., Zhou, Z., Zhao, J., Guo, Y., Du, F., & Qu, H. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3085327 · Cited by 59
“filled in an exit-questionnaire and the Creativity Support Index questionnaire [13], followed by a semi-structured interview.”
MethodInfluentialChen, L., Xiao, S., Chen, Y., Song, Y., Wu, R., & Sun, L. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642229 · Cited by 60
“Subsequently, participants were asked to complete the Creativity Support Index questionnaire [9] to gauge how effectively their processes were supported.”
BackgroundMethodInfluentialFork It: Supporting Stateful Alternatives in Computational Notebooks
Weinman, N., Drucker, S. M., Barik, T., & DeLine, R. A. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445527 · Cited by 69
“The items are based on Exploration, Results Worth Effort, Expressiveness, and Collaboration items from the Creativity Support Index [4], a psychometric survey designed to evaluate how well a tool assists a user in their creative work such as data exploratory analyses.”
MethodKnotation: Exploring and Documenting Choreographic Processes
Felice, M. C., Alaoui, S. F., & Mackay, W. E. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174022 · Cited by 71
“Other promising directions include extending support for personal sublan-guages; letting users create their own instrument palettes [3]; and assessing results with the Creativity Support Index [10].”
A Redhead Walks into a Bar: Experiences of Writing Fiction with Artificial Intelligence
Ghajargar, M., Bardzell, J., & Lagerkvist, L. (2022) · Proceedings of the 25th International Academic Mindtrek Conference · doi:10.1145/3569219.3569418 · Cited by 54
“Cherry and Latulipe developed the Creativity Support Index to measure the effectiveness of creativity tools based on six dimensions [23].”
BackgroundGenQuery: Supporting Expressive Visual Search with Generative Models
Son, K., Choi, D., Kim, T. S., Kim, Y., & Kim, J. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642847 · Cited by 83
“The survey also included questions that asked participants to rate how well they could express their search intent, along with questions related to the Creativity Support Index [6].”
BackgroundVRCopilot: Authoring 3D Layouts with Generative AI Models in VR
Zhang, L., Pan, J., Gettig, J., Oney, S., & Guo, A. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3654777.3676451 · Cited by 109
“…following aspects: (1) user perceived effort via the NASA-TLX [26] questionnaire; (2) user perceived creativity from the Creativity Support Index [9], with an emphasis on how well our system help users explore different ideas; and (3) user perceived agency adapted from prior work (e.g., Tapal et…”
Design students meet industry players: Feedback and creativity in communities of practice
Mavri, A., Ioannou, A., & Loizides, F. (2020) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2020.100684 · Cited by 72
Palani, S., Ledo, D., Fitzmaurice, G. W., & Anderson, F. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501933 · Cited by 70
“One quantitative measure is the Creativity Support Index [14, 17], a general-purpose survey to gauge a novel CST’s efectiveness.”
Andolina, S., Klouche, K., Cabral, D., Ruotsalo, T., & Jacucci, G. (2015) · Creativity and Cognition · doi:10.1145/2757226.2757252 · Cited by 48
“To measure the performance of our system in terms of creativity support, we involved participants in the assessment of the Creativity Support Index (CSI) [4].”
MethodSketchar: Supporting Character Design and Illustration Prototyping Using Generative AI
Ling, L., Chen, X., Wen, R., Li, T. J.-J., & LC, R. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3677102 · Cited by 52
“Unlike in the first study, we asked participants to complete a Creativity Support Index (CSI) survey [13] to collect user feedback after each of the trials, both after task 1 and after task 2.”
Tangible Interaction for Children’s Creative Learning: A Review
Liang, M., Li, Y., Weber, T., & Hußmann, H. (2021) · Creativity and Cognition · doi:10.1145/3450741.3465262 · Cited by 58
“According to Cherry and Latulipe’s Creativity Support Index [22], creative behaviors were measured from exploration, collaboration, engagement, effort/reward trade-off, tool transparency, and expressiveness.”
MethodGANCollage: A GAN-Driven Digital Mood Board to Facilitate Ideation in Creativity Support
Wan, Q., & Lu, Z. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3596072 · Cited by 46
“In the third theme, we extended the “Results Worth Efort” dimension of CSI into 8 questions, in order reduce efects of randomness of AI in fnal results, and focus our survey results mainly on ideation.”
InfluentialDavis, R. L., Wambsganß, T., Jiang, W., Kim, K. G., Käser, T., & Dillenbourg, P. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642908 · Cited by 68
Schmitt, O., & Buschek, D. (2021) · Creativity and Cognition · doi:10.1145/3450741.3465253 · Cited by 41
“Finally, people filled in the Creativity Support Index (CSI) questionnaire [6].”
BackgroundMethodInfluentialColor Builder: A Direct Manipulation Interface for Versatile Color Theme Authoring
Shugrina, M., Zhang, W., Chevalier, F., Fidler, S., & Singh, K. S. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300686 · Cited by 49
“We evaluate Color Builder’s support for the creative task of color theme authoring using the Creativity Support Index (CSI) [19], which uses a research-tested questionnaire to rate creativity support of an interface using 5 factors: Collaboration, Enjoyment, Exploration, Expressiveness, Immersion…”
BackgroundMethodCodeToon: Story Ideation, Auto Comic Generation, and Structure Mapping for Code-Driven Storytelling
Suh, S., Zhao, J., & Law, E. (2022) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3526113.3545617 · Cited by 40
“After the task phase, we administered three surveys: (1) poststudy survey with creativity support index (CSI) [10], (2) paired factor comparison (PFC) [10], and (3) system usability survey (SUS) [7].”
MethodMirowski, P., Love, J., Mathewson, K., & Mohamed, S. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3658993 · Cited by 37
“We asked about the potential and limitations of language models as Creativity Support Tools [22], and quantified the Creativity Support Index of LLMs for comedy writing [25].”
Method3D Pen + 3D Printer: Exploring the Role of Humans and Fabrication Machines in Creative Making
Takahashi, H., & Kim, J. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300525 · Cited by 47
“We refer to the Creative support Index [11] and Shneider-man’s principles for creativity support tools [34].”
MethodMavri, A., Ioannou, A., & Loizides, F. (2021) · The Internet and Higher Education · doi:10.1016/j.iheduc.2021.100792 · Cited by 51
Smartphone-based augmented reality for end-user creation of home automations
Ariano, R., Manca, M., Paternò, F., & Santoro, C. (2022) · Behaviour and Information Technology · doi:10.1080/0144929x.2021.2017482 · Cited by 45
“In future work, we plan to assess whether the solution proposed can stimulate the creativity of users in creating automations by using relevant methods such as the Creativity Support Index (Cherry and Latulipe 2014), and compare it with traditional Web-based environments for trigger-action rule creation.”
MethodHouzangbe, S., Masson, D. H., Fleury, S., Jáuregui, D. A. G., Legardeur, J., Richir, S., & Couture, N. (2022) · Frontiers in Virtual Reality · doi:10.3389/frvir.2022.958223 · Cited by 44
Creativity on Paid Crowdsourcing Platforms
Oppenlaender, J., Milland, K., Visuri, A., Ipeirotis, P. G., & Hosio, S. J. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376677 · Cited by 44
“For instance, the Creativity Support Index (CSI) [7, 11] aims to measure how well a CST supports creativity and the Experience of Creativity Questionnaire (ECQ) [50] measures experiential and existential aspects of artistic creativity.”
BackgroundCreativity in virtual teams: Systematic review, synthesis and research agenda
Saad, E. A., & Agogué, M. (2023) · Creativity and Innovation Management · doi:10.1111/caim.12540 · Cited by 55
Cloud-smart Musical Instrument Interactions
Turchet, L., Pauwels, J., Fischione, C., & Fazekas, G. (2020) · ACM Transactions on Internet of Things · doi:10.1145/3377881 · Cited by 36
The Nudge Deck: A Design Support Tool for Technology-Mediated Nudging
Caraban, A., Konstantinou, L., & Karapanos, E. (2020) · Designing Interactive Systems Conference · doi:10.1145/3357236.3395485 · Cited by 38
“We employed the Creativity Support Index [13] to measure participants’ experienced creativity during the design session.”
MethodAn ubiquitous smart guitar system for collaborative musical practice
Turchet, L., & Barthet, M. (2019) · Journal of New Music Research · doi:10.1080/09298215.2019.1637439 · Cited by 40
“The CSI metric enables to assess the ability of a tool to support the open-ended creation of new artefacts (Cherry & Latulipe, 2014).”
MethodHsueh, S., Ciolfi Felice, M., Alaoui, S. F., & Mackay, W. E. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642854 · Cited by 33
“An example of such relationship between creativity defnition and evaluation metrics can be seen in Cherry and Latulipe’s [30] work on the creativity support index (CSI).”
BackgroundArtinter: AI-powered Boundary Objects for Commissioning Visual Arts
Chung, J. J. Y., & Adar, E. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3595961 · Cited by 33
“After each condition, we asked participants to complete a Creativity Support Index survey [12].”
MethodXCreation: A Graph-based Crossmodal Generative Creativity Support Tool
Yan, Z., Yang, C., Liang, Q., & Chen, X. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606826 · Cited by 55
“However, emerging technologies and human power are expected to be reciprocal: humans develop Creativity Support Tools (CSTs) as aux-iliaries, which in turn bolster human creativity and accelerate the traditional creative process [17, 41, 63].”
BackgroundPodReels: Human-AI Co-Creation of Video Podcast Teasers
Wang, S., Ning, Z., Truong, A., Dontcheva, M., Li, D., & Chilton, L. B. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661591 · Cited by 54
“Overall, 43.3% of clips score high in all four parameters, 33.3% in three parameters, and 23.3% in two of them.”
BackgroundInfluentialCompressables: A Haptic Prototyping Toolkit for Wearable Compression-based Interfaces
Endow, S., Moradi, H., Srivastava, A., Noya, E. G., & Torres, C. (2021) · Designing Interactive Systems Conference · doi:10.1145/3461778.3462057 · Cited by 39
“We administered the creativity support index (CSI), a psychometric survey grounded in creativity support tools literature which measures how well a tool "assists a user engaged in creative work" [3].”
MethodDesigning Interactions with Generative AI for Art and Creativity: A Systematic Review and Taxonomy
Hu, X., Xing, Y., Cai, X., Zhao, Y., Cook, M., Borgo, R., & Neate, T. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735843 · Cited by 60
“To evaluate CST effectiveness, the Creativity Support Index (CSI) was developed, measuring six dimensions of creativity support: Exploration, Expressiveness, Immersion, Enjoyment, Results Worth Effort, and Collaboration [34].”
Sketchy: Drawing Inspiration from the Crowd
Wallace, S., Le, B., Leiva, L. A., Haq, A., Kintisch, A., Bufrem, G., Chang, L., & Huang, J. J. S. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415243 · Cited by 37
“A higher CSI score indicates better creativity support [13]; in Study 1, the overall CSI score is 72.”
BackgroundMethodInfluentialLouie, R., Engel, J., & Huang, C.-Z. A. (2022) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3490099.3511159 · Cited by 60
“For example, the Creativity Support Index (CSI) measures the impact on six dimensions such as exploration, expressiveness, immersion, en-joyment, results worth efort, and collaboration [11].”
BackgroundInkspire: Supporting Design Exploration with Generative AI through Analogical Sketching
Lin, D. C.-E., Kang, H. B., Martelaro, N., Kittur, A., Chen, Y.-Y., & Hong, M. K. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713397 · Cited by 57
“We assess creativity using the Creativity Support Index [22], measuring exploration, inspiration, engagement, expressiveness, tool transparency, and effort/reward tradeoff.”
Designing Deep Reinforcement Learning for Human Parameter Exploration
Scurto, H., Kerrebroeck, B. V., Caramiaux, B., & Bevilacqua, F. P. (2021) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3414472 · Cited by 39
“Using questionnaire methods, such as the Creativity Support Index [15], may enable to measure different dimensions of human creativity in relation to different algorithm implementations.”
MethodEvaluation of Interactive Machine Learning Systems
Boukhelifa, N., Bezerianos, A., & Lutton, É. (2018) · Human-computer interaction series · doi:10.1007/978-3-319-90403-0_17 · Cited by 35
“Our recommendation with this respect is two-fold: first, to work towards creating tools that support creativity (something that the HCI community is already looking into [15]); and second, to investigate objective and subjective metrics to study creativity within iML (e.”
BackgroundPatchview: LLM-powered Worldbuilding with Generative Dust and Magnet Visualization
Chung, J. J. Y., & Kreminski, M. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3654777.3676352 · Cited by 57
“The survey asked about the helpfulness of each Patchview feature and included Creativity Support Index [12] questions on enjoyment, exploration, expressiveness, immersion, and the results of tool usage being worth the effort.”
MethodPatchProv: Supporting Improvisational Design Practices for Modern Quilting
Leake, M., Lai, F., Grossman, T., Wigdor, D., & Lafreniere, B. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445601 · Cited by 33
“Creativity support tools support the open-ended creation of new artifacts [9].”
BackgroundMimisbrunnur: AI-Assisted Authoring for Interactive Storytelling
Stefnisson, I. S., & Thue, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v14i1.13046 · Cited by 28
“An evaluation of our tool is currently underway using the Cre-ativity Support Index (CSI) (Cherry and Latulipe 2014), a psychometric survey designed for evaluating a tool’s ability to assist a user’s creative work.”
MethodPhosphenes: Crafting Resistive Heaters within Thermoreactive Composites
Torres, C., Chang, J., Patel, A., & Paulos, E. (2019) · Designing Interactive Systems Conference · doi:10.1145/3322276.3322375 · Cited by 29
“For this reason, we administered the creativity support index [7], a psychometric survey grounded in creativity support tools literature which measures how well a tool "assists a user engaged in creative work".”
MethodMesserschmidt, M. A., Muthukumarana, S., Hamdan, N. A.-H., Wagner, A., Zhang, H., Borchers, J., & Nanayakkara, S. C. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3490497 · Cited by 34
ExpressEdit: Video Editing with Natural Language and Sketching
Tilekbay, B., Yang, S., Lewkowicz, M. A., Suryapranata, A., & Kim, J. (2024) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3640543.3645164 · Cited by 53
“We also rated ExpressEdit in terms of CSI [21] for editing informational videos by novice editors.”
MethodHit the Thumb Jack! Using Electromyography to Augment the Piano Keyboard
Karolus, J., Kilian, A., Kosch, T., Schmidt, A., & Woźniak, P. W. (2020) · Designing Interactive Systems Conference · doi:10.1145/3357236.3395500 · Cited by 32
“To this end, Cherry and Latulipe [8] presented the Creativity Support Index (CSI); a validated score to measure creativity support, which we applied in our work.”
InfluentialHow Time Constraints in a Creativity Support Tool Affect the Creative Writing Experience
Biskjær, M. M., Frich, J., MacDonald, L., Remy, C., & Dalsgaard, P. (2019) · European Conference on Cognitive Ergonomics · doi:10.1145/3335082.3335084 · Cited by 30
“Notable examples include studies of the use of Google Docs for general creativity support [10, 24] and the practice of collaborative writing [33, 38].”
BackgroundToward More Comprehensive Evaluations of 3D Immersive Sketching, Drawing, and Painting
Machuca, M. D. B., Israel, J. H., Keefe, D. F., & Stuerzlinger, W. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3276291 · Cited by 30
“Finally, work in this sub-category usually leverages previously proposed methodologies to evaluate the impact on creativity or the design process (e.g., AttrakDiff [89], the Creativity Support Index [90], or the Torrance Tests of Creative Thinking [91]).”
MethodDigitization of the Design Thinking Process Solving Problems with Geographically Dispersed Teams
Lattemann, C., Siemon, D., Dorawa, D., & Redlich, B. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-58634-2_6 · Cited by 29
A Design Space for Writing Support Tools Using a Cognitive Process Model of Writing
Gero, K., Calderwood, A., Li, C., & Chilton, L. (2022) · Proceedings of the First Workshop on Intelligent and Interactive Writing Assistants (In2Writing 2022) · doi:10.18653/v1/2022.in2writing-1.2 · Cited by 25
“The Creativity Support Index (Cherry and Latulipe, 2014), NASA Task Load Index (Hart and Staveland, 1988), and Technology Acceptance Model (Venkatesh and Davis, 2000) may all be useful.”
MethodNeuralPMG: A Neural Polyphonic Music Generation System Based on Machine Learning Algorithms
Colafiglio, T., Ardito, C. A., Sorino, P., Lofù, D., Festa, F., Noia, T. D., & Sciascio, E. D. (2024) · Cognitive Computation · doi:10.1007/s12559-024-10280-6 · Cited by 35
Zhang, H., Chen, P., Xie, X., Jiang, Z., Zhou, Z., & Sun, L. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3689433 · Cited by 36
“The Creativity Support Index (CSI) [13] was also utilised to investigate differences in creativity resulting from the use of diverse CSTs.”
Friction: Deciphering Writing Feedback into Writing Revisions through LLM-Assisted Reflection
Zhang, C., Ju, K., Bidoshi, P., Yen, Y.-C. G., & Rzeszotarski, J. M. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714316 · Cited by 48
Supporting Creativity through the Interactive Exploratory Search Paradigm
Taramigkou, M., Apostolou, D., & Mentzas, G. N. (2016) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2016.1220104 · Cited by 31
“Since concept developers were the experts in the field of the workshop, we did not evaluate the outcome of their ideas, but we used the CSI to evaluate the effect of CRUISE on the following aspects of creative work: exploration, collaboration, engagement, effort, transparency, and expressiveness.”
MethodInfluentialAdaptive Photographic Composition Guidance
E, J. L., Fried, O., Lu, J., Zhang, J., Měch, R., Echevarria, J., Hanrahan, P., & Landay, J. A. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376635 · Cited by 31
“After each condition, participants filled out a survey asking them to rate their confidence in their ability to capture well-composed photos, and measuring the Creativity Support Index (CSI) [11].”
MethodInfluentialCreative and Progressive Interior Color Design with Eye-tracked User Preference
Guo, S., Shi, Y., Xiao, P., Fu, Y., Lin, J., Zeng, W., & Lee, T. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3542922 · Cited by 36
IdeationWeb: Tracking the Evolution of Design Ideas in Human-AI Co-Creation
Shen, H., Shen, L., Wu, W., & Zhang, K. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713375 · Cited by 24
“…using a 7-point Likert scale [54] in 5 minutes to assess their design processes with AI, including the Creativity Support Index (CSI) questionnaire [21], the assessment of overall human-AI interaction experience (controllable, transparent, cognitive load, collaboration, trust), and the evaluation…”
Trajkova, M., Long, D., Deshpande, M., Knowlton, A., & Magerko, B. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642677 · Cited by 24
“Evaluating Creative AI: Existing of evaluating creative AI focus on technical benchmarks [41], generated artifacts [39], or on users’ feelings of creativity and immersion [20, 54].”
BackgroundInteractive Exploration-Exploitation Balancing for Generative Melody Composition
Zhou, Y., Koyama, Y., Goto, M., & Igarashi, T. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397481.3450663 · Cited by 36
“Even though our system does not involve collaboration, we included it as suggested by the original paper [4].”
BackgroundMethodInfluentialDe-Stijl: Facilitating Graphics Design with Interactive 2D Color Palette Recommendation
Shi, X., Zhou, Z., Zhang, J. W., Neshati, A., Tyagi, A., Rossi, R. A., Guo, S., Du, F., & Zhao, J. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581070 · Cited by 31
“We utilize Creativity Support Index (CSI [7]) to measure the degree of creativity support for De-Stijl and the Baseline in the study.”
MethodStemasov, E., Demharter, S., Rädler, M., Gugenheimer, J., & Rukzio, E. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642083 · Cited by 24
“For the user study, we acquired the following measures: the System Usability Scale [13], the (raw) NASA Task Load Index (TLX) [39], and the Creativity Support Index (CSI) [20].”
MethodDesigning Creativity Support Tools for Failure
Kim, J. O., Bagla, A., & Bernstein, M. S. (2015) · Creativity and Cognition · doi:10.1145/2757226.2764542 · Cited by 28
“Likewise, creativity support tool design principles developed by HCI and CSCW research communities aim to bolster creative output [16] or decrease friction in engaging in creativity [15].”
BackgroundAmuse: Human-AI Collaborative Songwriting with Multimodal Inspirations
Kim, Y., Lee, S.-J., & Donahue, C. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713818 · Cited by 23
““ Amuse was definitely more helpful when starting from ””
Analysing trade-offs in frameworks for the design of smart environments
Ardito, C. A., Desolda, G., Lanzilotti, R., Malizia, A., & Matera, M. (2019) · Behaviour and Information Technology · doi:10.1080/0144929x.2019.1634760 · Cited by 28
“The second section included the Creativity Support Index (CSI), a psychometric survey to evaluate the ability of a tool in supporting users ’ engagement in creative works and which aspects of creativity support may need attention (Cherry and Latulipe 2014).”
BackgroundMethodMagical Brush: A Symbol-Based Modern Chinese Painting System for Novices
Xu, H., Chen, S., & Zhang, Y. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581429 · Cited by 30
“6.2.6 Predictability, Inspiration and Exploration.”
MethodInfluentialCRUX: a creativity and user experience model
Fleury, S., Vanukuru, R., Mille, C., Poinsot, K., Agnès, A., & Richir, S. (2021) · Digital Creativity · doi:10.1080/14626268.2021.1915339 · Cited by 22
“Bux-ton (2010) recommendations and the Creativity Support Index are useful when designing or improving digital tools for creativity.”
BackgroundSchlagowski, R., Wildgrube, F., Mertes, S., George, C., & André, E. (2022) · Creativity and Cognition · doi:10.1145/3527927.3532799 · Cited by 25
Reflection Across AI-based Music Composition
Ford, C., Noel-Hirst, A., Cardinale, S., Loth, J., Sarmento, P., Wilson, E., Wolstanholme, L., Worrall, K., & Bryan-Kinns, N. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656185 · Cited by 22
“For example, the citations to researcher’s in-spirations in the first-person accounts are not captured by the RiCE questionnaire [44], nor other questionnaire measures typically used in creative HCI research [25, 59].”
Background
Metadata
- Authors
- Cherry, E., & Latulipe, C.
- Affiliations
- University of North Carolina at Charlotte (US)
- ORCID
- Latulipe, Celine
- Venue
- ACM Transactions on Computer-Human Interaction
- Published
- 2014-06
- Volume
- 21
- Issue
- 4
- Pages
- 1-25
- ISSN
- 1073-0516 (ISSN-L)
- 1557-7325
- OpenAlex
- W2087641817
- Semantic Scholar
- d32c3b85a853c3b315fbc31c3267f5dd6d20f067
- Cited by
- 498
- References
- 25
- Citations by year
- 2026: 118 · 2025: 99 · 2024: 67 · 2023: 47 · 2022: 38 · 2021: 33 · 2020: 25 · 2019: 22 · 2018: 22 · 2017: 13 · 2016: 7 · 2015: 7
- FWCI
- 17.45
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Computer-Human Interaction (publishedVersion)
- Funders
- Division of Information and Intelligent Systems (IIS-0855882)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Creativity in Education and Neuroscience
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- creativity support tools, creativity assessment, creative work, exploration, expressiveness, immersion, enjoyment, collaboration, tool evaluation, design improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.