A Fitness-Utility Model for Design Science Research
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Current thinking in design science research (DSR) defines the usefulness of the design artifact in a relevant problem environment as the primary research goal. Here we propose a complementary evaluation model for DSR. Drawing from evolutionary economics, we define a fitness-utility model that better captures the evolutionary nature of design improvements and the essential DSR nature of searching for a satisfactory design across a fitness landscape. Our goal is to move DSR to more meaningful evaluations of design artifacts for sustainable impacts. A key premise of this new thinking is that the evolutionary fitness of a design artifact is more valuable than its immediate usefulness. We conclude with a discussion of the strengths and challenges of the fitness-utility model for the performance of rigorous and relevant DSR.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mining association rules between sets of items in large databases
Agrawal, R., Imieliński, T., & Swami, A. (1993) · Proceedings of the 1993 ACM SIGMOD international conference on Management of data · doi:10.1145/170035.170072 · Cited by 14,907
The DeLone and McLean Model of Information Systems Success: A Ten-Year Update
(2003) · Journal of Management Information Systems · doi:10.1080/07421222.2003.11045748 · Cited by 11,791 · cited 2×
“The choice of usefulness as the pre-eminent dependent variable for DSR ties it to earlier MIS research exploring appropriate dependent variables for information systems [2, 3].”
BackgroundDesign Science in Information Systems Research1
Hevner, A. R., March, S. T., Park, J., & Ram, S. (2004) · MIS Quarterly · doi:10.2307/25148625 · Cited by 10,707 · cited 2×
“[1].”
BackgroundSelf-citationInformation Systems Success: The Quest for the Dependent Variable
DeLone, W. H., & McLean, E. R. (1992) · Information Systems Research · doi:10.1287/isre.3.1.60 · Cited by 10,697
Design science in information systems research
(2004) · Journal of the Association for Information Systems · doi:10.5555/2017212.2017217 · Cited by 8,254
Self-citationFehr, E., & Fischbacher, U. (2003) · Nature · doi:10.1038/nature02043 · Cited by 3,475 · cited 2×
“For example, altruism—the desire to give without any expectation of reciprocation—is a widely observed trait in the human population [Fehr and Fischbacher 2003].”
BackgroundLakhani, K. R., & Wolf, R. G. (2003) · doi:10.2139/ssrn.443040 · Cited by 1,531
Lakhani, K. R., & Wolf, R. G. (2005) · Perspectives on Free and Open Source Software · doi:10.7551/mitpress/5326.003.0005 · Cited by 1,530
That's Interesting!: Towards a Phenomenology of Sociology and a Sociology of Phenomenology
Davis, M. S. (1971) · Philosophy of the Social Sciences · doi:10.1177/004839317100100211 · Cited by 1,219
Community, joining, and specialization in open source software innovation: a case study
von Krogh, G., Spaeth, S., & Lakhani, K. R. (2003) · Research Policy · doi:10.1016/s0048-7333(03)00050-7 · Cited by 1,025 · cited 1×
“A study of what motivates open source developers [von Krogh et al. 2003, p. 1231] identi.ed four key factors that would act as a contribution barrier if not in place.”
Background
Cited by
FEDS: a Framework for Evaluation in Design Science Research
Venable, J., Pries-Heje, J., & Baskerville, R. (2016) · European Journal of Information Systems · doi:10.1057/ejis.2014.36 · Cited by 1,061
Design science research contributions: Finding a balance between artifact and theory
Georgia State University, Baskerville, R., Baiyere, A., University of Turku, F., Gergor, S., Australian National University, Hevner, A., University of South Florida, Rossi, M., & Aalto University (2018) · Journal of the Association for Information Systems · doi:10.17705/1jais.00495 · Cited by 437
Self-citationA Taxonomy of Evaluation Methods for Information Systems Artifacts
Prat, N., Comyn-Wattiau, I., & Akoka, J. (2015) · Journal of Management Information Systems · doi:10.1080/07421222.2015.1099390 · Cited by 278
University of Liechtenstein, L., vom Brocke, J., Winter, R., University of St. Gallen, S., Hevner, A., University of South Florida, U., Maedche, A., & Karlsruhe Institute of Technology, G. (2020) · Journal of the Association for Information Systems · doi:10.17705/1jais.00611 · Cited by 254
Self-citation(2016) · Electronic Journal of Information Systems Evaluation · Cited by 8
Metadata
- Authors
- Gill, T. G., & Hevner, A. R.
- Venue
- ACM Transactions on Management Information Systems
- Published
- 2013-08
- Volume
- 4
- Issue
- 2
- Pages
- 1-24
- ISSN
- 2158-656X (ISSN-L)
- 2158-6578
- OpenAlex
- W2134436159
- Cited by
- 127
- References
- 10
- FWCI
- 45.34
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.