The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Evaluating Journal Quality and the Association for Information Systems Senior Scholars’ Journal Basket Via Bibliometric Measures: Do Expert Journal Assessments Add Value?1
Open accessAbstract
Information systems journal rankings and ratings help scholars focus their publishing efforts and are widely used surrogates for judging the quality of research. Over the years, numerous approaches have been used to rank IS journals, approaches such as citation metrics, school lists, acceptance rates, and expert assessments. However, the results of these approaches often conflict due to a host of validity concerns. In the current scientometric study, we make significant strides toward correcting for these limitations in the ranking of mainstream IS journals. We compare expert rankings to bibliometric measures such as the ISI Impact Factor™, the h-index, and social network analysis metrics. Among other findings, we conclude that bibliometric measures provide very similar results to expert-based methods in determining a tiered structure of IS journals, thereby suggesting that bibliometrics can be a complete, less expensive, and more efficient substitute for expert assessment. We also find strong support for seven of the eight journals in the Association for Information Systems Senior Scholars’ “basket” of journals. A cluster analysis of our results indicates a two-tiered separation in the quality of the highest quality IS journals—with MIS Quarterly, Information Systems Research, and Journal of Management Information Systems belonging, in that order, to the highest A+ tier. Journal quality metrics fit nicely into the sociology of science literature and can be useful in models that attempt to explain how knowledge disseminates through scientific communities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Centrality in social networks conceptual clarification
Freeman, L. C. (1978) · Social Networks · doi:10.1016/0378-8733(78)90021-7 · Cited by 17,062
The History and Meaning of the Journal Impact Factor
Garfield, E. (2006) · JAMA · doi:10.1001/jama.295.1.90 · Cited by 2,770
Early predictors of job burnout and engagement.
Maslach, C., & Leiter, M. P. (2008) · Journal of Applied Psychology · doi:10.1037/0021-9010.93.3.498 · Cited by 2,397
That's Interesting!: Towards a Phenomenology of Sociology and a Sociology of Phenomenology
Davis, M. S. (1971) · Philosophy of the Social Sciences · doi:10.1177/004839317100100211 · Cited by 1,219
Diversity in information systems action research methods
Baskerville, R., & Wood-Harper, A. T. (1998) · European Journal of Information Systems · doi:10.1057/palgrave.ejis.3000298 · Cited by 689
Coercive Citation in Academic Publishing
Wilhite, A. W., & Fong, E. A. (2012) · Science · doi:10.1126/science.1212540 · Cited by 433
Acuna, D. E., Allesina, S., & Kording, K. P. (2012) · Nature · doi:10.1038/489201a · Cited by 249
Validating research performance metrics against peer rankings
Harnad, S. (2008) · Ethics in Science and Environmental Politics · doi:10.3354/esep00088 · Cited by 96
Cited by
Marzi, G., Balzano, M., Caputo, A., & Pellegrini, M. M. (2025) · International Journal of Management Reviews · doi:10.1111/ijmr.12381 · Cited by 577
Artificial intelligence in marketing: Topic modeling, scientometric analysis, and research agenda
Mustak, M., Salminen, J., Plé, L., & Wirtz, J. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2020.10.044 · Cited by 555
Artificial intelligence in E-Commerce: a bibliometric study and literature review
Bawack, R. E., Wamba, S. F., Carillo, K. D. A., & Akter, S. (2022) · Electronic Markets · doi:10.1007/s12525-022-00537-z · Cited by 372
Digital innovation: Review and novel perspective
Hund, A., Wagner, H.-T., Beimborn, D., & Weitzel, T. (2021) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2021.101695 · Cited by 324
Mingers, J., & Yang, L. (2017) · European Journal of Operational Research · doi:10.1016/j.ejor.2016.07.058 · Cited by 184
Metadata
- Authors
- Lowry, P. B., Moody, G. D., Gaskin, J., Galletta, D. F., Humpherys, S. L., Barlow, J. B., & Wilson, D. W.
- Venue
- MIS Quarterly
- Publisher
- MIS Quarterly
- Published
- 2013-12-01
- Volume
- 37
- Issue
- 4
- Pages
- 993-1012
- ISSN
- 0276-7783 (ISSN-L)
- 2162-9730
- OpenAlex
- W2100912143
- Cited by
- 188
- References
- 8
- FWCI
- 16.13
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluating Journal Quality and the Association for Information Systems Senior Scholars’ Journal Basket Via Bibliometric Measures: Do Expert Journal Assessments Add Value?1. https://app.cochat.ai/papers/10.25300/misq/2013/37.4.01
- The paper
- Lowry, P. B., Moody, G. D., Gaskin, J., Galletta, D. F., Humpherys, S. L., Barlow, J. B., & Wilson, D. W. (2013). Evaluating Journal Quality and the Association for Information Systems Senior Scholars’ Journal Basket Via Bibliometric Measures: Do Expert Journal Assessments Add Value?1. MIS Quarterly. https://doi.org/10.25300/misq/2013/37.4.01
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.