Understanding frameworks and reviews: a commentary to assist us in moving our field forward by analyzing our past
The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Review and framework articles, which are commonly used to synthesize the research literature on a topic area can be important tools for advancing the state of knowledge in a field of inquiry. However, the appraisal of, and the distinction between, survey review and framework articles are often difficult because of the common focus on analyzing a substantial volume of literature. As more review and framework articles are produced with the concomitant increase in outlets for publication, such as MISQ Review and JAIS, it seems this is an opportune time for a reflexive pause regarding what are appropriate criteria for authors and reviewers to have in assessing such articles and recognizing their salient features. By assessing a representative sample of North American journals and IS researchers currently working in U.S. institutions, we present a set of criteria for the assessment of survey review and framework articles and identify the most salient features of these types of articles. Our findings suggest that, among other things, a "good" framework article should offer a clear guideline (indicating possible problems that can be examined within the stated framework), consist of a parsimonious set of elements, and have a clearly defined boundary. On the other hand, a good review article should advance the field as a result of consolidating prior research, identify and propose testable hypotheses, and focus on simplifying past results. We also found that both framework and review articles can be characterized according to their stated objective, comprehensiveness, relationship to research boundaries, temporal focus, and content focus. As our effort focuses primarily on our colleagues working in U.S. institutions, we invite our colleagues from other regions and academic traditions to make similar assessments of work from their perspectives.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Structure of Scientific Revolutions: 50th Anniversary Edition
Kuhn, T. S., & Hacking, I. (2012) · doi:10.7208/chicago/9780226458144.001.0001 · Cited by 21,170
Qualitative evaluation and research methods
Ellis, D. (1990) · International Journal of Information Management · doi:10.1016/0268-4012(90)90041-p · Cited by 17,943
Maslach, C., Schaufeli, W. B., & Leiter, M. P. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.397 · Cited by 12,852
Social Capital: Prospects for a New Concept
Adler, P. S., & Kwon, S.-W. (2002) · The Academy of Management Review · doi:10.2307/4134367 · Cited by 9,665
Determining Validity in Qualitative Inquiry
Creswell, J. W., & Miller, D. L. (2000) · Theory Into Practice · doi:10.1207/s15430421tip3903_2 · Cited by 9,184 · cited 2×
“…stated purposes; (6) Cluster analysis and validation; and (8) Triangulation, a validity procedure used by researchers to search for convergence among multiple sources of information and methods of data collection and analysis (Denzin, 1978; Patton, 2002; Creswell & Miller, 2000, p.126).”
BackgroundMethodAnalyzing the Past to Prepare for the Future: Writing a Literature Review
Webster, J., & Watson, R. T. (2002) · MIS Quarterly · doi:10.2307/4132319 · Cited by 7,449
An organizational learning framework: From intuition to institution
Crossan, M. M., Lane, H. W., & White, R. E. (1999) · The Academy of Management Review · doi:10.2307/259140 · Cited by 4,544
Anderson, C. A., & Bushman, B. J. (2002) · Annual Review of Psychology · doi:10.1146/annurev.psych.53.100901.135231 · Cited by 3,915
Information Privacy: Measuring Individuals’ Concerns About Organizational Practices1
Smith, H. J., Milberg, S. J., & Burke, S. J. (1996) · MIS Quarterly · doi:10.2307/249477 · Cited by 2,266
Understanding the influence of national culture on the development of trust
Doney, P. M., Cannon, J. P., & Mullen, M. R. (1998) · The Academy of Management Review · doi:10.2307/259297 · Cited by 1,844
Cited by
A method for taxonomy development and its application in information systems
Nickerson, R. C., Varshney, U., & Muntermann, J. (2013) · European Journal of Information Systems · doi:10.1057/ejis.2012.26 · Cited by 1,143
The public value of E-Government – A literature review
Twizeyimana, J. D., & Andersson, A. (2019) · Government Information Quarterly · doi:10.1016/j.giq.2019.01.001 · Cited by 954
vom Brocke, J., Simons, A., Riemer, K., Niehaves, B., Plattfaut, R., & Cleven, A. (2015) · Communications of the Association for Information Systems · doi:10.17705/1cais.03709 · Cited by 625
A Hermeneutic Approach for Conducting Literature Reviews and Literature Searches
Boell, S. K., & Cecez-Kecmanovic, D. (2014) · Communications of the Association for Information Systems · doi:10.17705/1cais.03412 · Cited by 576
A Framework for Guiding and Evaluating Literature Reviews
Templier, M., & Paré, G. (2015) · Communications of the Association for Information Systems · doi:10.17705/1cais.03706 · Cited by 553
Metadata
- Authors
- Schwarz, A., Mehta, M., Johnson, N., & Chin, W. W.
- Venue
- ACM SIGMIS Database: the DATABASE for Advances in Information Systems
- Published
- 2007-07-28
- Volume
- 38
- Issue
- 3
- Pages
- 29-50
- ISSN
- 0095-0033 (ISSN-L)
- 1532-0936
- OpenAlex
- W2045016560
- Cited by
- 121
- References
- 22
- FWCI
- 4.59
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Understanding frameworks and reviews: a commentary to assist us in moving our field forward by analyzing our past. https://app.cochat.ai/papers/10.1145/1278253.1278259
- The paper
- Schwarz, A., Mehta, M., Johnson, N., & Chin, W. W. (2007). Understanding frameworks and reviews: a commentary to assist us in moving our field forward by analyzing our past. ACM SIGMIS Database: the DATABASE for Advances in Information Systems. https://doi.org/10.1145/1278253.1278259
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.