PLS-Based Model Selection: The Role of Alternative Explanations in Information Systems Research
The DOI matches its OpenAlex record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Exploring theoretically plausible alternative models for explaining the phenomenon under study is a crucial step in advancing scientific knowledge. This paper advocates model selection in information systems (IS) studies that use partial least squares path modeling (PLS) and suggests the use of model selection criteria derived from information theory for this purpose. These criteria allow researchers to compare alternative models and select a parsimonious yet well-fitting model. However, as our review of prior IS research practice shows, their use—while common in the econometrics field and in factor-based SEM—has not found its way into studies using PLS. Using a Monte Carlo study, we compare the performance of several model selection criteria in selecting the best model from a set of competing models under different model set-ups and various conditions of sample size, effect size, and loading patterns. Our results suggest that appropriate model selection cannot be achieved by relying on the PLS criteria (i.e., R2, Adjusted R2, GoF, and Q2), as is the current practice in academic research. Instead, model selection criteria—in particular, the Bayesian information criterion (BIC) and the Geweke-Meese criterion (GM)—should be used due to their high model selection accuracy and ease of use. To support researchers in the adoption of these criteria, we introduce a five-step procedure that delineates the roles of model selection and statistical inference and discuss misconceptions that may arise in their use.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The ASA Statement on p -Values: Context, Process, and Purpose
Wasserstein, R. L., & Lazar, N. A. (2016) · The American Statistician · doi:10.1080/00031305.2016.1154108 · Cited by 6,306 · cited 1×
“…Association has recently cautioned that an overreliance on p-values, and especially the prevalent thresholds (e.g., 1%, 5% significance levels), may cause selective inference and lead researchers to “cherry-pick” promising findings, the so-called “p-value hacking” issue (Wasserstein & Lazar, 2016).”
BackgroundBurnham, K. P., Anderson, D. R., & Huyvaert, K. P. (2011) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-010-1029-6 · Cited by 4,104
Texas A&M International University, Kock, N., Lynn, G., & Stevens Institute of Technology (2012) · Journal of the Association for Information Systems · doi:10.17705/1jais.00302 · Cited by 3,783 · cited 3×
“9 of the 34 studies (11.54%; Table A2 in Appendix A), the authors engaged in model comparisons in terms of Nuzzo (2015) by testing theoretically justified alternative model set-ups for explaining the phenomenon under study (e.”
BackgroundMethodInfluentialThe Nature of Theory in Information Systems1
Gregor, S. (2006) · MIS Quarterly · doi:10.2307/25148742 · Cited by 3,306 · cited 3×
“In addition to its empirical role in predictive relevance and generalizability, parsimony is also regarded by many social scientists as an important ingredient in theory development (e.g., Gregor, 2006; Simon, 2001), precisely because it “explains much by little” (Friedman, 1994; p.153).”
BackgroundPublication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
An empirical comparison of the efficacy of covariance-based and variance-based SEM
Reinartz, W., Haenlein, M., & Henseler, J. (2009) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2009.08.001 · Cited by 2,906
AIC model selection using Akaike weights
Wagenmakers, E.-J., & Farrell, S. (2004) · Psychonomic Bulletin & Review · doi:10.3758/bf03206482 · Cited by 2,684
An entropy criterion for assessing the number of clusters in a mixture model
Celeux, G., & Soromenho, G. (1996) · Journal of Classification · doi:10.1007/bf01246098 · Cited by 2,448 · cited 1×
“…various scenarios and methodological contexts, such as mixtures of normal distributions (e.g., Biernacki, Celeux, & Govaert, 2000; Bozdogan, 1994; Celeux & Soromenho, 1996), mixture regression models (e.g., Andrews & Currim, 2003a; Becker, Ringle, Sarstedt, & Völckner, 2015; Hawkins, Allen, &…”
Practical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778
Predictive Analytics in Information Systems Research
Shmueli, G., & Koppius, O. (2010) · doi:10.2139/ssrn.1606674 · Cited by 676
Cited by
When to Use and How to Report the Results of PLS-SEM
Hair, J. F., Risher, J. J., Sarstedt, M., & Ringle, C. M. (2019) · European Business Review · doi:10.1108/ebr-11-2018-0203 · Cited by 27,541
Self-citationPartial Least Squares Structural Equation Modeling (PLS-SEM) Using R: A Workbook
Hair, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., Danks, N. P., & Ray, S. (2021) · Classroom Companion: Business · doi:10.1007/978-3-030-80519-7 · Cited by 10,343
Self-citationAssessing measurement model quality in PLS-SEM using confirmatory composite analysis
Hair, J. F., Howard, M. C., & Nitzl, C. (2020) · Journal of Business Research · doi:10.1016/j.jbusres.2019.11.069 · Cited by 5,446
Predictive model assessment in PLS-SEM: guidelines for using PLSpredict
Shmueli, G., Sarstedt, M., Hair, J. F., Cheah, J.-H., Ting, H., Vaithilingam, S., & Ringle, C. M. (2019) · European Journal of Marketing · doi:10.1108/ejm-02-2019-0189 · Cited by 4,618
Self-citationRethinking some of the rethinking of partial least squares
Hair, J. F., Sarstedt, M., & Ringle, C. M. (2019) · European Journal of Marketing · doi:10.1108/ejm-10-2018-0665 · Cited by 1,839
Self-citation
Metadata
- Authors
- Sharma, P. N., Sarstedt, M., Galit Shmueli, A., Kim, K. H., & Thiele, K. O.
- Venue
- tub.dok (Hamburg University of Technology)
- Publisher
- Hamburg University of Technology
- Published
- 2019-01-01
- Volume
- 20
- Issue
- 4
- Pages
- 346-397
- OpenAlex
- W2942790531
- Cited by
- 98
- References
- 13
- FWCI
- 12.78
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: PLS-Based Model Selection: The Role of Alternative Explanations in Information Systems Research. https://app.cochat.ai/papers/10.17005/1.jais.00538
- The paper
- Sharma, P. N., Sarstedt, M., Galit Shmueli, A., Kim, K. H., & Thiele, K. O. (2019). PLS-Based Model Selection: The Role of Alternative Explanations in Information Systems Research. tub.dok (Hamburg University of Technology). https://doi.org/10.17005/1.jais.00538
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.