Quantitative approaches to content analysis: identifying conceptual drift across publication outlets
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Unstructured text data, such as emails, blogs, contracts, academic publications, organizational documents, transcribed interviews, and even tweets, are important sources of data in Information Systems research. Various forms of qualitative analysis of the content of these data exist and have revealed important insights. Yet, to date, these analyses have been hampered by limitations of human coding of large data sets, and by bias due to human interpretation. In this paper, we compare and combine two quantitative analysis techniques to demonstrate the capabilities of computational analysis for content analysis of unstructured text. Specifically, we seek to demonstrate how two quantitative analytic methods, viz., Latent Semantic Analysis and data mining, can aid researchers in revealing core content topic areas in large (or small) data sets, and in visualizing how these concepts evolve, migrate, converge or diverge over time. We exemplify the complementary application of these techniques through an examination of a 25-year sample of abstracts from selected journals in Information Systems, Management, and Accounting disciplines. Through this work, we explore the capabilities of two computational techniques, and show how these techniques can be used to gather insights from a large corpus of unstructured text.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Weber, R. (1990) · doi:10.4135/9781412983488 · Cited by 7,750
An introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880 · cited 2×
“H O The basis for this analysis is that ‘the aggregate of all the word contexts in which a given word does and does not appear provides a set of constraints that determines the similarity of meanings of words, and sets of words, to each other’ (Landauer et al , 1998, p. 260).”
BackgroundMethodUrquhart, C., Lehmann, H., & Myers, M. D. (2010) · Information Systems Journal · doi:10.1111/j.1365-2575.2009.00328.x · Cited by 841 · cited 1×
“While methodological guidelines have been offered to assist with these interpretative tasks (Urquhart et al , 2010), for example, by offering different types of codes (Miles & Huberman, 1994) or the use of coding teams (Fernandez, 2004), still, the subjective bias introduced by the researcher(s)…”
MethodAvoidance of Information Technology Threats: A Theoretical Perspective1
Liang, H., & Xue, Y. (2009) · MIS Quarterly · doi:10.2307/20650279 · Cited by 733 · cited 1×
“In IT risk and security research, for example, the complementary use of the two techniques could be useful for forensics or profiling purposes (e.g., Liang & Xue, 2009), to identify key topics (e.g., those indicating activities related to threats) in conversational data, or to understand the…”
BackgroundQuantifying incoherence in speech: An automated methodology and novel application to schizophrenia
Elvevåg, B., Foltz, P. W., Weinberger, D. R., & Goldberg, T. E. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.03.001 · Cited by 363
Fashion Waves in Information Systems Research and Practice1
Baskerville, R. L., & Myers, M. D. (2009) · MIS Quarterly · doi:10.2307/20650319 · Cited by 137
Cited by
Artificial intelligence innovation in education: A twenty-year data-driven historical analysis
Guan, C., Mou, J., & Jiang, Z. (2020) · International Journal of Innovation Studies · doi:10.1016/j.ijis.2020.09.001 · Cited by 665
Theme in Qualitative Content Analysis and Thematic Analysis
Vaismoradi, M., & Snelgrove, S. R. (2019) · Forum qualitative Sozialforschung · doi:10.17169/fqs-20.3.3376 · Cited by 441
Tseng, C., Wu, B., Morrison, A. M., Zhang, J., & Chen, Y.-C. (2015) · Tourism Management · doi:10.1016/j.tourman.2014.07.012 · Cited by 353
On the role of context in business process management
Brocke, J. V., Zelt, S., & Schmiedel, T. (2016) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2015.10.002 · Cited by 291
Text mining for information systems researchers: An annotated topic modeling tutorial
University of Liechtenstein, Debortoli, S., Müller, O., IT University of Copenhagen, Junglas, I., Florida State University, vom Brocke, J., & University of Liechtenstein (2016) · Communications of the Association for Information Systems · doi:10.17705/1cais.03907 · Cited by 199
Metadata
- Authors
- Indulska, M., Hovorka, D. S., & Recker, J.
- Venue
- European Journal of Information Systems
- Publisher
- Informa UK Limited
- Published
- 2012-01
- Volume
- 21
- Issue
- 1
- Pages
- 49-69
- ISSN
- 0960-085X (ISSN-L)
- 1476-9344
- OpenAlex
- W2016062440
- Cited by
- 143
- References
- 6
- FWCI
- 34.06
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Quantitative approaches to content analysis: identifying conceptual drift across publication outlets. https://app.cochat.ai/papers/10.1057/ejis.2011.37
- The paper
- Indulska, M., Hovorka, D. S., & Recker, J. (2012). Quantitative approaches to content analysis: identifying conceptual drift across publication outlets. European Journal of Information Systems. https://doi.org/10.1057/ejis.2011.37
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.