Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.

Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Tools

Open access
Gmeiner, Frederic, Yang, Humphrey, Yao, Lining, Holstein, Kenneth, Martelaro, Nikolas · 2023 · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Abstract

AI-based design tools are proliferating in professional software to assist engineering and industrial designers in complex manufacturing and design tasks. These tools take on more agentic roles than traditional computer-aided design tools and are often portrayed as “co-creators.” Yet, working effectively with such systems requires different skills than working with complex CAD tools alone. To date, we know little about how engineering designers learn to work with AI-based design tools. In this study, we observed trained designers as they learned to work with two AI-based tools on a realistic design task. We find that designers face many challenges in learning to effectively co-create with current systems, including challenges in understanding and adjusting AI outputs and in communicating their design goals. Based on our findings, we highlight several design opportunities to better support designer-AI co-creation.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3544548.3580999

Cites

79 of 79 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 The Fusion 360 design task and workfow. The task involves (A) designing an engine bracket that connects the engine to a damper. (B) A starter fle containing connection holes and bounding dimensions is provided to the users to initiate the design in (C) Fusions 360. The user is prompted to create (D) a viable design while minimizing weight. (E) The workfow involves fve steps, and based on the AI system's solutions, the user may iterate the design by adjusting the design constraints and criteria to produce new solutions. (Image A: © Rolls-Royce Solutions America Inc.)
Figure 1 The Fusion 360 design task and workfow. The task involves (A) designing an engine bracket that connects the engine to a damper. (B) A starter fle containing connection holes and bounding dimensions is provided to the users to initiate the design in (C) Fusions 360. The user is prompted to create (D) a viable design while minimizing weight. (E) The workfow involves fve steps, and based on the AI system's solutions, the user may iterate the design by adjusting the design constraints and criteria to produce new solutions. (Image A: © Rolls-Royce Solutions America Inc.)CC-BY · From the PDF
Figure 2 The SimuLearn design task. (A) The user is prompted to design a bike bottle holder using the provided (B) starter fle and (C) the SimuLearn tool to create (D) morphing grid structures. (E) The transformed grid should assemble into the holder and ft around the bottle and bike frame. (F) The SimuLearn tool provides three types of design workfows. After initializing a morphing grid design, the user can choose between AI-assisted optimization functions or rapid simulations to iterate the design.
Figure 2 The SimuLearn design task. (A) The user is prompted to design a bike bottle holder using the provided (B) starter fle and (C) the SimuLearn tool to create (D) morphing grid structures. (E) The transformed grid should assemble into the holder and ft around the bottle and bike frame. (F) The SimuLearn tool provides three types of design workfows. After initializing a morphing grid design, the user can choose between AI-assisted optimization functions or rapid simulations to iterate the design.CC-BY · From the PDF
Figure 3 Overview of Study 1 think-aloud design sessions procedure. Participants were frst introduced to the design tool and task, then worked while thinking aloud across multiple sessions. They completed an interview after turning in their design.
Figure 3 Overview of Study 1 think-aloud design sessions procedure. Participants were frst introduced to the design tool and task, then worked while thinking aloud across multiple sessions. They completed an interview after turning in their design.CC-BY · From the PDF
Figure 4 Overview of engine bracket designs created by participants. P-F05 met both the shape and structural requirements. P-F01 only met the shape requirements (the bracket has holes for bolts with sufcient clearance and respects the specifed dimensions but is structurally too weak). All other brackets missed both requirements and were either too heavy, weak, larger than the specifed dimensions, or had not enough bolt clearance. For simplicity, we only show one design option per participant. Please see the Appendix for all submitted design options.
Figure 4 Overview of engine bracket designs created by participants. P-F05 met both the shape and structural requirements. P-F01 only met the shape requirements (the bracket has holes for bolts with sufcient clearance and respects the specifed dimensions but is structurally too weak). All other brackets missed both requirements and were either too heavy, weak, larger than the specifed dimensions, or had not enough bolt clearance. For simplicity, we only show one design option per participant. Please see the Appendix for all submitted design options.CC-BY · From the PDF
Figure 5 Overview of bottle holder designs created by participants. Participants came up with diferent designs using the shape-changing grid material in various ways. Participant P-S01 was not able to control the shape as intended and improvised by stacking grids together. While some designs (P-S06, P-S07) would not be able to hold a bottle, some designers (P-S04, P-S10) utilized the shape-changing grid structure to create promising bottle holder designs. Participant P-S11 stopped working on the task out of frustration and did not submit a design.
Figure 5 Overview of bottle holder designs created by participants. Participants came up with diferent designs using the shape-changing grid material in various ways. Participant P-S01 was not able to control the shape as intended and improvised by stacking grids together. While some designs (P-S06, P-S07) would not be able to hold a bottle, some designers (P-S04, P-S10) utilized the shape-changing grid structure to create promising bottle holder designs. Participant P-S11 stopped working on the task out of frustration and did not submit a design.CC-BY · From the PDF
Table 3: Schematic overview of each participant's learning process of design task-relevant features of the AI system. Left: Engine Bracket Task. Right: Bottle Holder Task. Correct use of input parameters or AI tools is shown with check marks. Increasing numbers of check marks from the frst iteration to the last iteration suggest participants learning to work with the AI system.
Table 3: Schematic overview of each participant's learning process of design task-relevant features of the AI system. Left: Engine Bracket Task. Right: Bottle Holder Task. Correct use of input parameters or AI tools is shown with check marks. Increasing numbers of check marks from the frst iteration to the last iteration suggest participants learning to work with the AI system.CC-BY · From the PDF
Figure 6 Overview of all engine mounting brackets created in the Fusion360 task. Every participant submitted three design options. Since the AI system generated the three options based on the same parameter values, each trio either met or missed the same criteria.
Figure 6 Overview of all engine mounting brackets created in the Fusion360 task. Every participant submitted three design options. Since the AI system generated the three options based on the same parameter values, each trio either met or missed the same criteria.CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 more claim about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 78 references

Research works printed but not linked: 4

  1. 10.1109/vl · doi:10.1109/vl
  2. Anna Kawakami, Nikos Arechiga, Luke Guerdan, Matthew Lee, Yang Cheng, Scott Carter, Anita Sun, Haiyi Zhu, and Alison Hu. 2022. Towards a Learner-Centered Explainable AI. Workshop on Human-Centered Explainable AI (HCXAI) at the ACM Conference on Human Factors in Computing Systems, CHI 2022 (2022), 7.
  3. 10.1109/vl · doi:10.1109/vl
  4. Mary Lou Maher, Brian Magerko, Dan Venura, Douglas Fisher, Rogelio E. Cardona-Rivera, Nancy Fulda, John Gero, Minwoo Lee, David Wilson, James C. Kaufman, Maithilee Kunda, Michael Muller, Rachel K.E. Bellamy, Maya Ackerman, and Evangelia Chrysikou. 2022. A Research Plan for Integrating Generative and Cognitive AI for Human Centered, Explainable Co-Creative AI. In CHI 2022 Workshop on Generative AI and HCI. https://generativeaiandhci.github.io/

Cited by

See all 171

Metadata

Authors
Gmeiner, F., Yang, H., Yao, L., Holstein, K., & Martelaro, N.
Affiliations
Carnegie Mellon University (US)
Venue
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2023-04-19
Pages
1-20
OpenAlex
W4322831995
Cited by
130
References
78
Citations by year
2026: 37 · 2025: 54 · 2024: 33 · 2023: 6
FWCI
115.04
Type
conference paper
Language
en
Open access
Locations
  • CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
National Science Foundation (2118924)
Topics
  • Physical Sciences › Engineering › Mechanical Engineering › Design Education and Practice
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
Keywords
human-AI collaboration, manufacturing design, computer-aided design, agentic AI, design support

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Tools. https://app.cochat.ai/papers/10.1145/3544548.3580999
The paper
Gmeiner, F., Yang, H., Yao, L., Holstein, K., & Martelaro, N. (2023). Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Tools. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3544548.3580999

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.