The DOI matches its Crossref record; 111 of the 111 references it cites were found in a registry or an index.
Identifying Quality, Novel, and Creative Ideas: Constructs and Scales for Idea Evaluation
Open accessAbstract
Researchers and practitioners have an abiding interest in improving tools and methods to support idea generation. In studies that go beyond merely enumerating ideas, researchers typically select one or more of the following three constructs, which are often operationalized as the dependent variable(s): 1) idea quality, 2) idea novelty, which is sometimes referred to as rarity or unusualness, and 3) idea creativity. It has been chronically problematic to compare findings across studies because these evaluation constructs have been variously defined and the constructs have been sampled in different ways. For example, some researchers term an idea 'creative' if it is novel, while others consider an idea to be creative only if it is also applicable, effective, and implementable. This paper examines 90 studies on creativity and idea generation. Within the creativity studies considered here, the novelty of ideas was always measured, but in some cases the ideas had to also meet additional requirements to be considered creative. Some studies that examined idea quality also assessed novelty, while others measured different quality attributes, such as effectiveness and implementability, instead. This paper describes a method for evaluating ideas with regard to four dimensions--novelty, workability, relevance, and specificity--and has identified two measurable sub-dimensions for each of the four main dimensions. An action-research approach was used to develop ordinal scales anchored by clearly differentiable descriptions for each sub-dimension. Confirmatory factor analysis revealed high loadings among the sub-dimensions that comprise each dimension as well as high discriminant validity between dimensions. Application of this method resulted in high inter-rater reliability even when the method was applied by different raters to different problems and to ideas produced by both manual methods and group support systems (GSS).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Alternative Ways of Assessing Model Fit
Browne, M. W., & Cudeck, R. (1992) · Sociological Methods & Research · doi:10.1177/0049124192021002005 · Cited by 27,200
Significance tests and goodness of fit in the analysis of covariance structures.
Bentler, P. M., & Bonett, D. G. (1980) · Psychological Bulletin · doi:10.1037//0033-2909.88.3.588 · Cited by 19,023
Structural Equation Modeling With AMOS: Basic Concepts, Applications, and Programming, Third Edition
Byrne, B. M. (2016) · doi:10.4324/9781315757421 · Cited by 4,653
Toward a theory of organizational creativity
Woodman, R. W., Sawyer, J. E., & Griffin, R. W. (1993) · The Academy of Management Review · doi:10.2307/258761 · Cited by 4,399
(1995) · Cited by 4,008
LISREL 7 : a guide to the program and applications
Jöreskog, K. G., & Sörbom, D. (1989) · Medical Entomology and Zoology · Cited by 3,786
Information Systems Research: Relevant Theory and Informed Practice
(2004) · IFIP International Federation for Information Processing · doi:10.1007/b115738 · Cited by 3,122
Alternative ways of assessing model fit
Browne, M. (1993) · Medical Entomology and Zoology · Cited by 2,595
Productivity loss in brainstorming groups: Toward the solution of a riddle.
Diehl, M., & Stroebe, W. (1987) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.53.3.497 · Cited by 1,955
Plucker, J. A., Beghetto, R. A., & Dow, G. T. (2004) · Educational Psychologist · doi:10.1207/s15326985ep3902_1 · Cited by 1,794
Cited by
Frey, K., Lüthje, C., & Haag, S. (2011) · Long Range Planning · doi:10.1016/j.lrp.2011.09.006 · Cited by 307
AI-Augmented Brainwriting: Investigating the use of LLMs in group ideation
Shaer, O., Cooper, A., Mokryn, O., Kun, A. L., & Ben Shoshan, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642414 · Cited by 130
Meinel, M., Eismann, T. T., Baccarella, C. V., Fixson, S. K., & Voigt, K.-I. (2020) · European Management Journal · doi:10.1016/j.emj.2020.02.002 · Cited by 98
Enhancing collaborative creativity with virtual dynamic personas
Bonnardel, N., & Pichot, N. (2020) · Applied Ergonomics · doi:10.1016/j.apergo.2019.102949 · Cited by 54
How good are ideas identified by an automatic idea detection system?
Christensen, K., Scholderer, J., Hersleth, S. A., Næs, T., Kvaal, K., Mollestad, T., Veflen, N., & Risvik, E. (2018) · Creativity and Innovation Management · doi:10.1111/caim.12260 · Cited by 31
Metadata
- Authors
- Brigham Young University, Dean, D., Hender, J., Henley Management College, Rodgers, T., Consultant College Station, T., Santanen, E., & Bucknell University
- Venue
- Journal of the Association for Information Systems
- Publisher
- Association for Information Systems
- Published
- 2006-10
- Volume
- 7
- Issue
- 10
- Pages
- 646-699
- ISSN
- 1536-9323 (ISSN-L)
- OpenAlex
- W2168697680
- Cited by
- 476
- References
- 111
- FWCI
- 2.82
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Identifying Quality, Novel, and Creative Ideas: Constructs and Scales for Idea Evaluation. https://app.cochat.ai/papers/10.17705/1jais.00106
- The paper
- Brigham Young University, Dean, D., Hender, J., Henley Management College, Rodgers, T., Consultant College Station, T., Santanen, E., & Bucknell University. (2006). Identifying Quality, Novel, and Creative Ideas: Constructs and Scales for Idea Evaluation. Journal of the Association for Information Systems. https://doi.org/10.17705/1jais.00106
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.