The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Toward Improving the Relevance of Information Systems Research to Practice: The Role of Applicability Checks1
Abstract
This paper takes a first step in aiding researchers to improve the relevance of their research to practice. By proposing that Information Systems researchers conduct applicability checks with practitioners on the research objects (for example, theories, models, frameworks, processes, technical artifacts, or other theoretically based IS artifacts) they either produce or use in theory-focused research, our paper presents an actionable, systematic approach to evaluating, establishing, and further improving research relevance. Furthermore, because it is an approach that can be conducted as an additional step either at the beginning or the end of the traditional research life cycle, it leaves untouched the rigorous methods used to conduct the study, that is, it does not compromise traditional research models. The approach we propose is based on the analyses of three dimensions of relevance that are critical to practitioners’ attempts to internalize IS research findings (importance, accessibility, and suitability), and a comprehensive set of solutions that can be used to address them. Our analysis reveals that the most critical dimension for practice is the importance of the research to the needs of practice. The solution we propose to address that need is to conduct an applicability check on the research objects of interest. The applicability check forms an integral part of the research process, either prior to or following engagement in a typical research process. We present principles and criteria for the conduct and evaluation of an applicability check, which is primarily based on the focus group method, and secondarily on a modified nominal group technique.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1984) · Cited by 81,983
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
(1998) · Sage eBooks · Cited by 38,631
Building Theories from Case Study Research
Eisenhardt, K. M. (1989) · The Academy of Management Review · doi:10.2307/258557 · Cited by 17,455
(2008) · Biostatistics and Microbiology: A Survival Manual · doi:10.1007/978-0-387-77282-0_6 · Cited by 17,371
The DeLone and McLean Model of Information Systems Success: A Ten-Year Update
(2003) · Journal of Management Information Systems · doi:10.1080/07421222.2003.11045748 · Cited by 11,791
Building theories from case study research
Eisenhardt, K. M. (2009) · STUDI ORGANIZZATIVI · doi:10.3280/so2008-002004 · Cited by 11,299
Design Science in Information Systems Research1
Hevner, A. R., March, S. T., Park, J., & Ram, S. (2004) · MIS Quarterly · doi:10.2307/25148625 · Cited by 10,707
Information Systems Success: The Quest for the Dependent Variable
DeLone, W. H., & McLean, E. R. (1992) · Information Systems Research · doi:10.1287/isre.3.1.60 · Cited by 10,697
Focus Groups: A Practical Guide for Applied Research
Billson, J. M. (1989) · Human Biology · Cited by 8,560
Design science in information systems research
(2004) · Journal of the Association for Information Systems · doi:10.5555/2017212.2017217 · Cited by 8,254
Qualitative data analysis (2nd ed)
Morse, J. M. (1996) · Journal of Psychosomatic Research · doi:10.1016/0022-3999(96)00056-6 · Cited by 5,593
(1990) · Cited by 3,957
Capturing the Complexity in Advanced Technology Use: Adaptive Structuration Theory
DeSanctis, G., & Poole, M. S. (1994) · Organization Science · doi:10.1287/orsc.5.2.121 · Cited by 3,879
Morgan, D. (1998) · Sage eBooks · doi:10.4135/9781483328164 · Cited by 1,691
Empirical Research in Information Systems: The Practice of Relevance1
Benbasat, I., & Zmud, R. V. (1999) · MIS Quarterly · doi:10.2307/249403 · Cited by 1,120
Stewart, D., Shamdasani, P., & Rook, D. (2007) · SAGE Publications Ltd eBooks · doi:10.4135/9781412991841 · Cited by 1,098
Group Techniques for Program Planning
de Ven, A. V., & Delbecq, A. L. (1975) · Cited by 907
Principles of canonical action research
Davison, R., Martinsons, M. G., & Kock, N. (2004) · Information Systems Journal · doi:10.1111/j.1365-2575.2004.00162.x · Cited by 832
Baskerville, R., & Myers, M. D. (2004) · MIS Quarterly · doi:10.2307/25148642 · Cited by 747
Avison, D. E., Lau, F., Myers, M. D., & Nielsen, P. A. (1999) · Communications of the ACM · doi:10.1145/291469.291479 · Cited by 722
Understanding the use of Group Decision Support Systems: The Theory of Adaptive Structuration
Poole, M., & DeSanctis, G. (1990) · Organizations and Communication Technology · doi:10.4135/9781483325385.n8 · Cited by 652
Research Commentary: Rethinking “Diversity” in Information Systems Research
Benbasat, I., & Weber, R. (1996) · Information Systems Research · doi:10.1287/isre.7.4.389 · Cited by 418
Research in Information Systems: An Empirical Study of Diversity in the Discipline and Its Journals
Vessey, I., Ramesh, V., & Glass, R. L. (2002) · Journal of Management Information Systems · doi:10.1080/07421222.2002.11045721 · Cited by 391
Self-citationSchultze, U., & Orlikowski, W. J. (2004) · Information Systems Research · doi:10.1287/isre.1030.0016 · Cited by 380
Beyond Rigor and Relevance: Producing Consumable Research about Information Systems
Robey, D., & Markus, M. L. (1998) · Information Resources Management Journal · doi:10.4018/irmj.1998010101 · Cited by 206
Research Standards for Promotion and Tenure in Information Systems1
Dennis, A. R., Valacich, J. S., Fuller, M. A., & Schneider, C. (2006) · MIS Quarterly · doi:10.2307/25148714 · Cited by 190
Empirical Research in Information Systems: On the Relevance of Practice in Thinking of IS Research
Lyytinen, K. (1999) · MIS Quarterly · doi:10.2307/249406 · Cited by 154
Rigor and Relevance: Careers on the Line
Applegate, L. M., & King, J. L. (1999) · MIS Quarterly · doi:10.2307/249404 · Cited by 99
Moody, D. L. (2000) · doi:10.5555/359640.359760 · Cited by 74
IS Research Relevance Revisited: Subtle Accomplishment, Unfulfilled Promise, or Serial Hypocrisy?
Kock, N., Gray, P., Hoving, R., Klein, H. K., Myers, M. D., & Rockart, J. (2002) · Communications of the Association for Information Systems · doi:10.17705/1cais.00823 · Cited by 74
The Challenge of Relating IS Research to Practice
Senn, J. (1998) · Information Resources Management Journal · doi:10.4018/irmj.1998010103 · Cited by 60
Galliers, R. D. (1994) · Cited by 40
Linking Theory and practice: Performing a Reality Check on a Model of IS Success
Rosemann, M., & Vessey, I. (2005) · QUT ePrints (Queensland University of Technology) · Cited by 21
Self-citationKlein, G. A., Jiang, J. J., & Saunders, C. (2006) · Communications of the Association for Information Systems · doi:10.17705/1cais.01813 · Cited by 20
Cited by
Sein, M. K., Henfridsson, O., Purao, S., Rossi, M., & Lindgren, R. (2011) · MIS Quarterly · doi:10.2307/23043488 · Cited by 1,463
Sein, M. K., Henfridsson, O., Purao, S., Rossi, M., & Lindgren, R. (2011) · Borås Academic Digital Archive (University of Borås) · doi:10.82444/warw.33619288 · Cited by 1,181
Anderson, C. L., & Agarwal, R. (2010) · MIS Quarterly · doi:10.2307/25750694 · Cited by 713
A Framework and Guidelines for Context-Specific Theorizing in Information Systems Research
Hong, W., Chan, F. K. Y., Thong, J. Y. L., Chasalow, L. C., & Dhillon, G. (2014) · Information Systems Research · doi:10.1287/isre.2013.0501 · Cited by 609
Integrating Technology Addiction and Use: an Empirical Investigation of Online Auction Users1
Turel, O., Serenko, A., & Giles, P. (2011) · MIS Quarterly · doi:10.2307/41409972 · Cited by 547
Metadata
- Authors
- Rosemann, M., & Vessey, I.
- Venue
- MIS Quarterly
- Publisher
- MIS Quarterly
- Published
- 2008-03-01
- Volume
- 32
- Issue
- 1
- Pages
- 1-22
- ISSN
- 0276-7783 (ISSN-L)
- 2162-9730
- OpenAlex
- W2168351114
- Cited by
- 471
- References
- 36
- FWCI
- 112.67
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.