The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Evaluation of Idea Generation Methods for Conceptual Design: Effectiveness Metrics and Design of Experiments
Abstract
A wide range of formal methods have been devised and used for idea generation in conceptual design. Experimental evidence is needed to support claims regarding the effectiveness of these methods in promoting idea generation in engineering design. Towards that goal this paper presents a set of effectiveness metrics experimental methods, data collection and analysis techniques. Statistically based Design of Experiments (DOE) principles were used in developing the guidelines. Four classes of operating variables were considered to characterize the design problem and the environment. The effectiveness metrics proposed are based on outcome and consists of the quantity, quality, novelty, and variety of ideas generated. Two experimental approaches have been developed. In the Direct Method, the influence of the type of design problem and various parameters related to the procedure of an idea generation method is measured by using the method in its entirety. In the Indirect Method, each idea generation method is decomposed into key components and its overall effectiveness is predicted by experimentally studying the effectiveness of its components and their mutual interactions. [S1050-0472(00)02004-3]
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Engineering Design: A Systematic Approach
(1963) · Students Quarterly Journal · doi:10.1049/sqj.1963.0055 · Cited by 4,100
Groups: Interaction and Performance.
Polley, R. B., & McGrath, J. E. (1984) · Administrative Science Quarterly · doi:10.2307/2393041 · Cited by 3,290
Pólya, G. (1945) · Cited by 3,006
Mbti Manual: A Guide to the Development and Use of the Myers-briggs Type Indicator
Myers, I. B., McCaulley, M. H., & Most, R. B. (1985) · Medical Entomology and Zoology · Cited by 2,783
Torrance, E. P. (1962) · Prentice-Hall, Inc eBooks · doi:10.1037/13134-000 · Cited by 1,598
Creative Cognition: Theory, Research, and Applications
Finke, R. A., Ward, T. B., & Smith, S. M. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/7722.001.0001 · Cited by 1,433
Creativity As an Exact Science
Altshuller (1984) · CRC Press eBooks · doi:10.1201/9781466593442 · Cited by 1,320
Jansson, D. G., & Smith, S. M. (1991) · Design Studies · doi:10.1016/0142-694x(91)90003-f · Cited by 1,087
Johnson, D. M., & Sternberg, R. J. (1978) · The American Journal of Psychology · doi:10.2307/1421839 · Cited by 999
Pahl, G., & Beitz, W. (1996) · Springer eBooks · doi:10.1007/978-1-4471-3581-4 · Cited by 890
Synectics: The Development of Creative Capacity
Gordon, W. J. J. (1961) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 885
Perkins, D. N. (2009) · Harvard University Press eBooks · doi:10.2307/j.ctvjnrvqd · Cited by 800
Design and other types of fixation
Purcell, A. T., & Gero, J. S. (1996) · Design Studies · doi:10.1016/s0142-694x(96)00023-3 · Cited by 552
Basadur, M., Graen, G. B., & Green, S. G. (1982) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(82)90233-1 · Cited by 387
Parnes, S. J., & Meadow, A. (1959) · Journal of Educational Psychology · doi:10.1037/h0047223 · Cited by 323
Sketching and creative discovery
Verstijnen, I., van Leeuwen, C., Goldschmidt, G., Hamel, R., & Hennessey, J. (1998) · Design Studies · doi:10.1016/s0142-694x(98)00017-9 · Cited by 285
Relations of creative responses to working time and instructions
Christensen, P. R., Guilford, J. P., & Wilson, R. C. (1957) · Journal of Experimental Psychology · doi:10.1037/h0045461 · Cited by 263
Barron, F. (1988) · Cited by 261
Lawson, B. (1994) · Medical Entomology and Zoology · Cited by 231
Strategies for Creative Problem Solving
Fogler, H. S., & LeBlanc, S. E. (1994) · Cited by 229
The Electronic Cocktail Napkin—a computational environment for working with design diagrams
Gross, M. D. (1996) · Design Studies · doi:10.1016/0142-694x(95)00006-d · Cited by 228
Judgment and Choice: The Psychology of Decision.
Connolly, T., & Hogarth, R. M. (1982) · Administrative Science Quarterly · doi:10.2307/2392308 · Cited by 201
Design protocol data and novel design decisions
Akın, Ö., & Lin, C. (1995) · Design Studies · doi:10.1016/0142-694x(94)00010-b · Cited by 200
(1995) · The Creative Cognition Approach · doi:10.7551/mitpress/2205.003.0015 · Cited by 189
Effects of extended effort in creative problem solving.
Parnes, S. J. (1961) · Journal of Educational Psychology · doi:10.1037/h0044650 · Cited by 179
Managing Creativity Enhancement Through Goal‐Setting and Feedback*
Carson, P. P., & CARSON, K. D. (1993) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.1993.tb01385.x · Cited by 123
Frames of reference in architectural design: analysing the hyperacclamation (A-h-a-!)
Akın, Ö., & Akin, C. (1996) · Design Studies · doi:10.1016/s0142-694x(96)00024-5 · Cited by 123
Winning by design: the methods of Gordon Murray, racing car designer
Cross, N., & Cross, A. C. (1996) · Design Studies · doi:10.1016/0142-694x(95)00027-o · Cited by 108
A computational model of scientific insight
Langley, P., & Jones, R. (1986) · eScholarship (California Digital Library) · Cited by 107
Curriculum Planning for Creative Thinking and Problem Solving
Isaksen, S. G., & Parnes, S. J. (1985) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.1985.tb00400.x · Cited by 102
Powers of observation in creative design
Kolodner, J. L., & Wills, L. M. (1996) · Design Studies · doi:10.1016/s0142-694x(96)00021-x · Cited by 100
Effect of group cohesiveness and training upon creative thinking.
Cohen, D., Whitmyre, J. W., & Funk, W. H. (1960) · Journal of Applied Psychology · doi:10.1037/h0041655 · Cited by 98
Creative design of the Lotus bicycle: implications for knowledge support systems research
Candy, L., & Edmonds, E. A. (1996) · Design Studies · doi:10.1016/0142-694x(95)00026-n · Cited by 96
Case studies of creativity in innovative product development
Roy, R. (1993) · Design Studies · doi:10.1016/0142-694x(93)80016-6 · Cited by 88
Perceptions of Brainstorming in Groups: The Quality Over Quantity Hypothesis
Rowatt, W. C., Nesselroade, K. P., Beggan, J. K., & Allison, S. T. (1997) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.1997.tb00786.x · Cited by 71
Analogical Connections—The Essence of Creativity
Poze, T. (1983) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.1983.tb00359.x · Cited by 64
Creative Thinking And Problem Solving
Fabian, J. M. (1990) · Cited by 54
Thinking styles and modelling systems
Tovey, M. (1986) · Design Studies · doi:10.1016/0142-694x(86)90004-9 · Cited by 40
Creativity Styles of Freshmen Students*
Kumar, V. K., Holman, E., & RUDEGEAIR, P. (1991) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.1991.tb01144.x · Cited by 23
PROCEDURES FOR MANAGERS IN IDEA‐DEFICIENT SITUATIONS: AN EXAMINATION OF BRAINSTORMING APPROACHES
Rickards, T., & Freedman, B. L. (1978) · Journal of Management Studies · doi:10.1111/j.1467-6486.1978.tb00908.x · Cited by 22
Cited by
Metrics for measuring ideation effectiveness
Shah, J. J., Smith, S. M., & Vargas-Hernandez, N. (2003) · Design Studies · doi:10.1016/s0142-694x(02)00034-0 · Cited by 1,095
Self-citationA Study of Design Fixation, Its Mitigation and Perception in Engineering Design Faculty
Linsey, J. S., Tseng, I., Fu, K., Cagan, J., Wood, K. L., & Schunn, C. (2010) · Journal of Mechanical Design · doi:10.1115/1.4001110 · Cited by 393
What inspires designers? Preferences on inspirational approaches during idea generation
Gonçalves, M., Cardoso, C., & Badke-Schaub, P. (2014) · Design Studies · doi:10.1016/j.destud.2013.09.001 · Cited by 295
Linsey, J. S., Clauss, E. F., Kurtoglu, T., Murphy, J. T., Wood, K. L., & Markman, A. B. (2011) · Journal of Mechanical Design · doi:10.1115/1.4003498 · Cited by 277
Collaborative Sketching (C‐Sketch) — An Idea Generation Technique for Engineering Design
SHAH, J. J., VARGAS‐HERNANDEZ, N., SUMMERS, J. D., & KULKARNI, S. (2001) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.2001.tb01045.x · Cited by 263
Self-citation
Metadata
- Authors
- Shah, J. J., Kulkarni, S. V., & Vargas-Hernandez, N.
- Venue
- Journal of Mechanical Design
- Publisher
- ASME International
- Published
- 2000-02-01
- Volume
- 122
- Issue
- 4
- Pages
- 377-384
- ISSN
- 0161-8458 (ISSN-L)
- 1050-0472
- 1528-9001
- OpenAlex
- W1976067223
- Cited by
- 367
- References
- 40
- FWCI
- 2.51
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.