GEM-NI: A System for Creating and Managing Alternatives In Generative Design
The DOI matches its Crossref record; 40 of the 41 references it cites were found in a registry or an index.
Abstract
We present GEM-NI -- a graph-based generative-design tool that supports parallel exploration of alternative designs. Producing alternatives is a key feature of creative work, yet it is not strongly supported in most extant tools. GEM-NI enables various forms of exploration with alternatives such as parallel editing, recalling history, branching, merging, comparing, and Cartesian products of and for alternatives. Further, GEM-NI provides a modal graphical user interface and a design gallery, which both allow designers to control and manage their design exploration. We conducted an exploratory user study followed by in-depth one-on-one interviews with moderately and highly skills participants and obtained positive feedback for the system features, showing that GEM-NI supports creative design work well.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As units, cells can then be assembled together into generation inputs (e.g., sentences into an essay and requirements into a prompt) which allows users to quickly assemble input variations [6,59] or to mix-and-match the variants [101,111].”
From Cells, Generators, and Lenses: Design Framework for Object-Oriented Interaction with Large Language Models (2023) · cites this paper as [111]
Citations
Cites
The eyes have it: a task by data type taxonomy for information visualizations
Shneiderman, B. (2002) · Proceedings 1996 IEEE Symposium on Visual Languages · doi:10.1109/vl.1996.545307 · Cited by 4,535
(2007) · International Linear Collider · Cited by 1,382
Woodbury, R. F. (2010) · Cited by 738
Self-citationCognitive dimensions of notations
Green, T. R. G. (1990) · Cited by 645
Design galleries: a general approach to setting parameters for computer graphics and animation
Marks, J., Ruml, W., Ryall, K., Seims, J., Shieber, S., Andalman, B., Beardsley, P. A., Freeman, W., Gibson, S., Hodgins, J., et al. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258887 · Cited by 551
Collaborative conceptual design—state of the art and future trends
Wang, L., Shen, W., Xie, H., Neelamkavil, J., & Pardasani, A. (2002) · Computer-Aided Design · doi:10.1016/s0010-4485(01)00157-9 · Cited by 545 · cited 1×
“Despite many methods proposed by researchers for the use of CAD in early stage conceptual design [17,36], CAD is still mostly used in the final stages of design, though this is changing [37].”
MethodQuantifying the Creativity Support of Digital Tools through the Creativity Support Index
Cherry, E., & Latulipe, C. (2014) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2617588 · Cited by 498 · cited 7×
“Since the tasks in our study were similar enough, we performed the CSI evaluation as a within subject tool comparison with the same task.”
MethodResultInfluentialGraphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation
Heer, J., Mackinlay, J., Stolte, C., & Agrawala, M. (2008) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2008.137 · Cited by 300 · cited 1×
“describe branching history as a way to remember operations that have been undone [16].”
BackgroundDesign Knowing and Learning: Cognition in Design Education
(2001) · Elsevier eBooks · doi:10.1016/b978-0-08-043868-9.x5000-1 · Cited by 268
Sitemaps, storyboards, and specifications: a sketch of Web site design practice
Newman, M. W., & Landay, J. A. (2000) · Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques · doi:10.1145/347642.347758 · Cited by 220
Current research in the conceptual design of mechanical products
Hsu, W., & Woon, I. M. Y. (1998) · Computer-Aided Design · doi:10.1016/s0010-4485(97)00101-2 · Cited by 208 · cited 1×
“Despite many methods proposed by researchers for the use of CAD in early stage conceptual design [17,36], CAD is still mostly used in the final stages of design, though this is changing [37].”
MethodFit and diverse: set evolution for inspiring 3D shape galleries
Xu, K., Zhang, H., Cohen-Or, D., & Chen, B. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185553 · Cited by 162
Chronicle: capture, exploration, and playback of document workflow histories
Grossman, T., Matejka, J., & Fitzmaurice, G. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866054 · Cited by 155 · cited 3×
“Chronicle [13] is a sophisticated system for exploring a document’s history via a zoomable and track-based video playback metaphor.”
BackgroundAkın, Ö. (2001) · Elsevier eBooks · doi:10.1016/b978-008043868-9/50006-1 · Cited by 154 · cited 1×
“These sketches help designers externalize knowledge, better understand the problem, and explore the space of potential solutions [2].”
BackgroundDesign as exploration: creating interface alternatives through parallel authoring and runtime tuning
Hartmann, B., Yu, L., Allison, A., Yang, Y., & Klemmer, S. R. (2008) · Proceedings of the 21st annual ACM symposium on User interface software and technology · doi:10.1145/1449715.1449732 · Cited by 151 · cited 2×
“Juxtapose [15] presents a parallel code editor and runtime parameter tuning environment for GUI alternatives.”
BackgroundWOODBURY, R. F., & BURROW, A. L. (2006) · Artificial Intelligence for Engineering Design, Analysis and Manufacturing · doi:10.1017/s0890060406060057 · Cited by 147 · cited 3×
“Woodbury and Burrow [38] argue that design activity is well-modeled by a network structure.”
BackgroundSelf-citationPrototyping dynamics: sharing multiple designs improves exploration, group rapport, and results
Dow, S., Fortuna, J., Schwartz, D., Altringer, B., Schwartz, D., & Klemmer, S. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979359 · Cited by 138
How designers perceive sketches
Menezes, A., & Lawson, B. (2006) · Design Studies · doi:10.1016/j.destud.2006.02.001 · Cited by 133 · cited 1×
“For example, it is common practice for web designers [25], architects [1,24] and software engineers [31] to generate sketches of potential designs as they solve problems.”
BackgroundWhere do web sites come from?: capturing and interacting with design history
Klemmer, S. R., Thomsen, M., Phelps-Goodman, E., Lee, R., & Landay, J. A. (2002) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/503376.503378 · Cited by 132 · cited 1×
“Many recent systems provide history-keeping mechanisms in the form of a timeline [19].”
BackgroundAkın, Ö. (1978) · Cumulative Index of Computer Aided Architectural Design · Cited by 126
Artificial intelligence and pattern recognition in computer aided design
Willey, D. S. (1979) · Computer-Aided Design · doi:10.1016/0010-4485(79)90153-2 · Cited by 122
A Survey of Model Comparison Approaches and Applications
Stephan, M., & Cordy, J. R. (2013) · International Conference on Model-Driven Engineering and Software Development · doi:10.5220/0004311102650277 · Cited by 120 · cited 1×
“For example, it is common practice for web designers [25], architects [1,24] and software engineers [31] to generate sketches of potential designs as they solve problems.”
BackgroundVariation in element and action: supporting simultaneous development of alternative solutions
Terry, M., Mynatt, E. D., Nakakoji, K., & Yamamoto, Y. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985782 · Cited by 119 · cited 8×
“This can be interpreted as an adaptation of skating [35] to generative design.”
BackgroundMethodInfluentialSelf-citationRecognizing creative needs in user interface design
Terry, M., & Mynatt, E. D. (2002) · Proceedings of the fourth conference on Creativity & cognition - C&C '02 · doi:10.1145/581710.581718 · Cited by 115
Self-citationGenerative Design: Visualize, Program, and Create with Processing
Bohnacker, H., Groß, B., Laub, J., & Lazzeroni, C. (2012) · Cited by 95
Artificial intelligence and pattern recognition in computer aided design
Sproull, R. F. (1980) · Artificial Intelligence · doi:10.1016/0004-3702(80)90025-9 · Cited by 82
Image graphs—a novel approach to visual data exploration
Ma, K. (1999) · Visualization · doi:10.5555/319351.319360 · Cited by 75
Lunzer, A., & Hornbæk, K. (2008) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1314683.1314685 · Cited by 73 · cited 3×
“Lunzer and Hornbæk [21] present a novel subjunctive interface with multi-state sliders for each parameter to enable parallel exploration of a parametric space.”
BackgroundMethodInfluentialA temporal model for multi-level undo and redo
Edwards, W. K., Igarashi, T., LaMarca, A., & Mynatt, E. D. (2000) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/354401.354409 · Cited by 64 · cited 1×
“When interactive [11], graphical histories can amplify the exploration capabilities of a system.”
BackgroundUsing text animated transitions to support navigation in document histories
Chevalier, F., Dragicevic, P., Bezerianos, A., & Fekete, J. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753427 · Cited by 62
Comparing and managing multiple versions of slide presentations
Drucker, S. M., Petschnigg, G., & Agrawala, M. (2006) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1166253.1166263 · Cited by 46 · cited 1×
“Users then can not only go back in time [13] and defer decisions [37, 38]; they have a mechanism to try out variations [35] by creating revisions [6] and versions [10] of the timeline.”
BackgroundNonlinear revision control for images
Chen, H., Wei, L., & Chang, C. (2011) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1964921.1965000 · Cited by 45 · cited 1×
“Users then can not only go back in time [13] and defer decisions [37, 38]; they have a mechanism to try out variations [35] by creating revisions [6] and versions [10] of the timeline.”
A Visual Language for Browsing, Undoing, and Redoing Graphical Interface Commands
Kurlander, D., & Feiner, S. (1989) · doi:10.7916/d8w95nfs · Cited by 42
A Spreadsheet Interface for Visualization Exploration
Jankun-Kelly, T. J., & Ma, K. (2000) · eScholarship (California Digital Library) · Cited by 41
Hartmann, B., Follmer, S., Ricciardi, A., Cardenas, T., & Klemmer, S. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753400 · Cited by 29 · cited 1×
“note tool [14] also offers alternatives, together with revision control, change tracking and annotations.”
Generative Art Inspired by Nature, Using NodeBox
Smedt, T. D., Lechat, L., & Daelemans, W. M. P. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-20520-0_27 · Cited by 20 · cited 1×
“Examples include visualizations of real-time data, evolutionary art installations that react to users, documents in a single visual style but with variations across pages, and customized wallpapers based on e-mail spam [29].”
BackgroundInteractive Visual Histories for Vector Graphics
Scull, C., Johnson, S., Aliaga, F., Paris, S., Su, S. L., & Durand, F. (2009) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 15
Improving interaction models for generating and managing alternative ideas during early design work
Smith, B. N., Xu, A., & Bailey, B. P. (2010) · Graphics Interface · Cited by 15
Bueno, C., Crossland, S., Lutteroth, C., & Weber, G. (2011) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/2071536.2071545 · Cited by 5
You can get more than you make
Sheikholeslami, M., & Woodbury, R. F. (2009) · Summit (Simon Fraser University) · Cited by 4
Self-citation
Research works printed but not linked: 2
- Simon , H.A. The sciences of the artificial . MIT press , 1996 . Simon, H.A. The sciences of the artificial. MIT press, 1996.
- Su , S.L. Visualizing , editing , and inferring structure in 2D graphics . Adjunct UIST 2007 , ACM ( 2007 ), 29--32. Su, S.L. Visualizing, editing, and inferring structure in 2D graphics. Adjunct UIST 2007, ACM (2007), 29--32.
Cited by
Brade, S., Wang, B., Sousa, M., Oore, S., & Grossman, T. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606725 · Cited by 198
“Prompt Engineering [24, 25, 36, 44, 50, 53, 54] refers to methods for constructing prompts to effectively communicate with models and direct the generation toward desired outcomes.”
BackgroundMethodDream Lens: Exploration and Visualization of Large-Scale Generative Design Datasets
Matejka, J., Glueck, M., Bradner, E., Hashemi, A., Grossman, T., & Fitzmaurice, G. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173943 · Cited by 144
“GEM-NI is a graph-based generative design tool allowing designers to explore multiple design alternatives in parallel [37].”
BackgroundDreamSketch: Early Stage 3D Design Explorations with Sketching and Generative Design
Kazi, R. H., Grossman, T., Cheong, H., Hashemi, A., & Fitzmaurice, G. (2017) · Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3126594.3126662 · Cited by 142
“Concept variations & ambiguous intentions In the HCI literature, GEM-NI [40] explored parallel creation, visualization, and exploration of alternative 2D Session: 3D Sketching UIST 2017, Oct.”
BackgroundGmeiner, F., Yang, H., Yao, L., Holstein, K., & Martelaro, N. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580999 · Cited by 130
“Recent research has developed generative design interfaces for interactively exploring multiple design options [39, 52, 83] or more iterative engagement between the designer and the tool through real-time design generation and assessment [14, 19, 37].”
BackgroundCreativeConnect: Supporting Reference Recombination for Graphic Design Ideation with Generative AI
Choi, D., Hong, S., Park, J., Chung, J. J. Y., & Kim, J. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642794 · Cited by 124
Metadata
- Authors
- Zaman, L., Stuerzlinger, W., Neugebauer, C., Woodbury, R., Elkhaldi, M., Shireen, N., & Terry, M.
- Affiliations
- York University (CA)
- Simon Fraser University (CA)
- Hochschule Bonn-Rhein-Sieg (DE)
- Simon Fraser Univeristy, Vancouver, BC, Canada
- University of Waterloo (CA)
- Venue
- Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2015-04-18
- Pages
- 1201-1210
- OpenAlex
- W2003083160
- Cited by
- 59
- References
- 41
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 6 · 2023: 7 · 2022: 6 · 2021: 3 · 2020: 7 · 2019: 7 · 2018: 6 · 2017: 6 · 2016: 1
- FWCI
- 11.67
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- GRAND NCE
- NSERC Discovery
- Topics
- Physical Sciences › Engineering › Mechanical Engineering › Design Education and Practice
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Digital Media and Visual Art
- Keywords
- generative design, design exploration, parallel editing, Cartesian product, design gallery, user study
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.