The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Evaluation of Idea Generation Methods for Conceptual Design: Effectiveness Metrics and Design of Experiments
Abstract
A wide range of formal methods have been devised and used for idea generation in conceptual design. Experimental evidence is needed to support claims regarding the effectiveness of these methods in promoting idea generation in engineering design. Towards that goal this paper presents a set of effectiveness metrics experimental methods, data collection and analysis techniques. Statistically based Design of Experiments (DOE) principles were used in developing the guidelines. Four classes of operating variables were considered to characterize the design problem and the environment. The effectiveness metrics proposed are based on outcome and consists of the quantity, quality, novelty, and variety of ideas generated. Two experimental approaches have been developed. In the Direct Method, the influence of the type of design problem and various parameters related to the procedure of an idea generation method is measured by using the method in its entirety. In the Indirect Method, each idea generation method is decomposed into key components and its overall effectiveness is predicted by experimentally studying the effectiveness of its components and their mutual interactions. [S1050-0472(00)02004-3]
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Engineering Design: A Systematic Approach
(1963) · Students Quarterly Journal · doi:10.1049/sqj.1963.0055 · Cited by 4,100
Groups: Interaction and Performance.
Polley, R. B., & McGrath, J. E. (1984) · Administrative Science Quarterly · doi:10.2307/2393041 · Cited by 3,290
Pólya, G. (1945) · Cited by 3,005
Mbti Manual: A Guide to the Development and Use of the Myers-briggs Type Indicator
Myers, I. B., McCaulley, M. H., & Most, R. B. (1985) · Medical Entomology and Zoology · Cited by 2,783
Torrance, E. P. (1962) · Prentice-Hall, Inc eBooks · doi:10.1037/13134-000 · Cited by 1,598
Creative Cognition: Theory, Research, and Applications
Finke, R. A., Ward, T. B., & Smith, S. M. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/7722.001.0001 · Cited by 1,433
Creativity As an Exact Science
Altshuller (1984) · CRC Press eBooks · doi:10.1201/9781466593442 · Cited by 1,320
Jansson, D. G., & Smith, S. M. (1991) · Design Studies · doi:10.1016/0142-694x(91)90003-f · Cited by 1,087
Johnson, D. M., & Sternberg, R. J. (1978) · The American Journal of Psychology · doi:10.2307/1421839 · Cited by 999
Pahl, G., & Beitz, W. (1996) · Springer eBooks · doi:10.1007/978-1-4471-3581-4 · Cited by 890
Cited by
Metrics for measuring ideation effectiveness
Shah, J. J., Smith, S. M., & Vargas-Hernandez, N. (2003) · Design Studies · doi:10.1016/s0142-694x(02)00034-0 · Cited by 1,095
Self-citationA Study of Design Fixation, Its Mitigation and Perception in Engineering Design Faculty
Linsey, J. S., Tseng, I., Fu, K., Cagan, J., Wood, K. L., & Schunn, C. (2010) · Journal of Mechanical Design · doi:10.1115/1.4001110 · Cited by 393
What inspires designers? Preferences on inspirational approaches during idea generation
Gonçalves, M., Cardoso, C., & Badke-Schaub, P. (2014) · Design Studies · doi:10.1016/j.destud.2013.09.001 · Cited by 295
Linsey, J. S., Clauss, E. F., Kurtoglu, T., Murphy, J. T., Wood, K. L., & Markman, A. B. (2011) · Journal of Mechanical Design · doi:10.1115/1.4003498 · Cited by 277
Collaborative Sketching (C‐Sketch) — An Idea Generation Technique for Engineering Design
SHAH, J. J., VARGAS‐HERNANDEZ, N., SUMMERS, J. D., & KULKARNI, S. (2001) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.2001.tb01045.x · Cited by 263
Self-citation
Metadata
- Authors
- Shah, J. J., Kulkarni, S. V., & Vargas-Hernandez, N.
- Venue
- Journal of Mechanical Design
- Publisher
- ASME International
- Published
- 2000-02-01
- Volume
- 122
- Issue
- 4
- Pages
- 377-384
- ISSN
- 0161-8458 (ISSN-L)
- 1050-0472
- 1528-9001
- OpenAlex
- W1976067223
- Cited by
- 367
- References
- 40
- FWCI
- 2.51
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluation of Idea Generation Methods for Conceptual Design: Effectiveness Metrics and Design of Experiments. https://app.cochat.ai/papers/10.1115/1.1315592
- The paper
- Shah, J. J., Kulkarni, S. V., & Vargas-Hernandez, N. (2000). Evaluation of Idea Generation Methods for Conceptual Design: Effectiveness Metrics and Design of Experiments. Journal of Mechanical Design. https://doi.org/10.1115/1.1315592
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.