Toward Collaborative Ideation at Scale: Leveraging Ideas from Others to Generate More Creative and Diverse Ideas
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
A growing number of large collaborative idea generation platforms promise that by generating ideas together, people can create better ideas than any would have alone. But how might these platforms best leverage the number and diversity of contributors to help each contributor generate even better ideas? Prior research suggests that seeing particularly creative or diverse ideas from others can inspire you, but few scalable mechanisms exist to assess diversity. We contribute a new scalable crowd-powered method for evaluating the diversity of sets of ideas. The method relies on similarity comparisons (is idea A more similar to B or C) generated by non-experts to create an abstract spatial idea map. Our validation study reveals that human raters agree with the estimates of dissimilarity derived from our idea map as much or more than they agree with each other. People seeing the diverse sets of examples from our idea map generate more diverse ideas than those seeing randomly selected examples. Our results also corroborate findings from prior research showing that people presented with creative examples generated more creative ideas than those who saw a set of random examples. We see this work as a step toward building more effective online systems for supporting large scale collective ideation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Jansson, D. G., & Smith, S. M. (1991) · Design Studies · doi:10.1016/0142-694x(91)90003-f · Cited by 1,087
Constraining effects of examples in a creative generation task
Smith, S. M., Ward, T. B., & Schumacher, J. S. (1993) · Memory & Cognition · doi:10.3758/bf03202751 · Cited by 542
Parallel prototyping leads to better design results, more divergence, and increased self-efficacy
Dow, S. P., Glassco, A., Kass, J., Schwarz, M., Schwartz, D. L., & Klemmer, S. R. (2010) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1879831.1879836 · Cited by 367 · cited 3×
“We chose to use an established measure of diversity for our outcomes: as in the validation experiment, we used average pairwise similarity [6].”
BackgroundMethodInfluentialSelf-citationLaw, E., & von Ahn, L. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518881 · Cited by 248 · cited 1×
“Some take the approach of generating labels or tags for each individual item [18], while others produce hierarchical taxonomies capturing the semantic structure of the concepts represented in the item set [3, 2, 1].”
BackgroundDesigning with interactive example galleries
Lee, B., Srivastava, S., Kumar, R., Brafman, R., & Klemmer, S. R. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753667 · Cited by 195 · cited 2×
“Seeing ideas different from their own broadens people’s perspectives, sheds light on obscure connections, and inspires people to come up with ideas they might not have thought of alone [14, 19, 5].”
BackgroundPrototyping dynamics: sharing multiple designs improves exploration, group rapport, and results
Dow, S., Fortuna, J., Schwartz, D., Altringer, B., Schwartz, D., & Klemmer, S. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979359 · Cited by 138
Self-citationDistributed analogical idea generation: inventing with crowds
Yu, L., Kittur, A., & Kraut, R. E. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557371 · Cited by 60 · cited 1×
“Existing approaches are to either help people parametrically browse and search for examples [19, 17] or extract schemas from examples and search for the schema that allows analogical transfer for a new idea [38, 36].”
Background
Cited by
Examining Crowd Work and Gig Work Through The Historical Lens of Piecework
Alkhatib, A., Bernstein, M. S., & Levi, M. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025974 · Cited by 148
“This decomposition style has been successfully applied across many areas, including food labeling [112], brainstorming [137, 163], and accessibility [90, 87, 88].”
MethodAI-Augmented Brainwriting: Investigating the use of LLMs in group ideation
Shaer, O., Cooper, A., Mokryn, O., Kun, A. L., & Ben Shoshan, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642414 · Cited by 130
“However, in order to expose users to those ideas that are creative and potentially inspiring, such systems need to implement methods to select and present creative and diverse ideas [66].”
BackgroundProviding Timely Examples Improves the Quantity and Quality of Generated Ideas
Siangliulue, P., Chan, J., Gajos, K. Z., & Dow, S. P. (2015) · Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition · doi:10.1145/2757226.2757230 · Cited by 99
“Once a sys-tem gathers these ideas, it can select which one to show using existing methods to select a set of inspiring examples [49, 45] We plan to explore novel mechanisms for real-time semantic analysis of people’s idea exploration to gain a deeper understanding of how to best provide them with…”
BackgroundMethodInfluentialSelf-citationAngleKindling: Supporting Journalistic Angle Ideation with Large Language Models
Petridis, S., Diakopoulos, N., Crowston, K., Hansen, M., Henderson, K., Jastrzebski, S., Nickerson, J. V., & Chilton, L. B. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580907 · Cited by 98
“overview of the idea space [51] [50] [13].”
BackgroundOn Suggesting Phrases vs. Predicting Words for Mobile Text Composition
Arnold, K. C., Gajos, K. Z., & Kalai, A. T. (2016) · Proceedings of the 29th Annual Symposium on User Interface Software and Technology · doi:10.1145/2984511.2984584 · Cited by 69
“But the phrases shown were the most likely , thus not novel or creative—and poor examples have been shown to hinder creativity [20, 24, 32].”
BackgroundSelf-citation
Metadata
- Authors
- Siangliulue, P., Arnold, K. C., Gajos, K. Z., & Dow, S. P.
- Venue
- Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing
- Publisher
- ACM
- Published
- 2015-02-28
- Pages
- 937-945
- OpenAlex
- W2071638895
- Cited by
- 127
- References
- 7
- FWCI
- 36.35
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.