The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Research Note—Statistical Power in Analyzing Interaction Effects: Questioning the Advantage of PLS with Product Indicators
Abstract
A significant amount of information systems (IS) research involves hypothesizing and testing for interaction effects. Chin et al. (2003) completed an extensive experiment using Monte Carlo simulation that compared two different techniques for detecting and estimating such interaction effects: partial least squares (PLS) with a product indicator approach versus multiple regression with summated indicators. By varying the number of indicators for each construct and the sample size, they concluded that PLS using product indicators was better (at providing higher and presumably more accurate path estimates) than multiple regression using summated indicators. Although we view the Chin et al. (2003) study as an important step in using Monte Carlo analysis to investigate such issues, we believe their results give a misleading picture of the efficacy of the product indicator approach with PLS. By expanding the scope of the investigation to include statistical power, and by replicating and then extending their work, we reach a different conclusion—that although PLS with the product indicator approach provides higher point estimates of interaction paths, it also produces wider confidence intervals, and thus provides less statistical power than multiple regression. This disadvantage increases with the number of indicators and (up to a point) with sample size. We explore the possibility that these surprising results can be explained by capitalization on chance. Regardless of the explanation, our analysis leads us to recommend that if sample size or statistical significance is a concern, regression or PLS with product of the sums should be used instead of PLS with product indicators for testing interaction effects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Modern Methods for Business Research
(1998) · doi:10.4324/9781410604385 · Cited by 6,534
Chin, W. W., Marcolin, B. L., & Newsted, P. R. (2003) · Information Systems Research · doi:10.1287/isre.14.2.189.16018 · Cited by 6,479
Research works printed but not linked: 18
- Aiken L. S., 1991, Multiple Regression: Testing and Interpreting Interactions
- 10.2307/248704 · DOI · Paper page
- 10.2307/30036541 · DOI · Paper page
- 10.1080/02664769922322 · DOI · Paper page
- Chin W. W., 2001, PLS Graph User’s Guide Version 3.0
- Chin W. W., 1996, Proc. 17th Internat. Conf. Inform. Systems, 21
- Cohen J., 1988, Statistical Power Analysis for the Behavioral Sciences
- 10.2307/3151312 · DOI · Paper page
- 10.1109/HICSS.2006.381 · DOI · Paper page
- Joreskog K. G., 1996, Advanced Structural Equation Modeling, Issues and Techniques, 57
- 10.1037/0033-2909.96.1.201 · doi:10.1037/0033-2909.96.1.201 · Paper page
- Larsen R. J., 1981, An Introduction to Mathematical Statistics and Its Applications
- 10.2307/25148727 · DOI · Paper page
- 10.2307/256280 · DOI
- Neter J., 1974, Applied Linear Statistical Models: Regression, Analysis of Variance, and Experimental Designs
- 10.2307/3150969 · doi:10.2307/3150969
- 10.5465/amr.1989.4279078 · doi:10.5465/amr.1989.4279078 · Paper page
- 10.2307/248694 · DOI · Paper page
Cited by
Consistent Partial Least Squares Path Modeling1
Dijkstra, T. K., & Henseler, J. (2015) · MIS Quarterly · doi:10.25300/misq/2015/39.2.02 · Cited by 2,898
Minimum sample size estimation in PLS‐SEM: The inverse square root and gamma‐exponential methods
Kock, N., & Hadaya, P. (2018) · Information Systems Journal · doi:10.1111/isj.12131 · Cited by 2,621
Lower bounds on sample size in structural equation modeling
Christopher Westland, J. (2010) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2010.07.003 · Cited by 1,846
Gefen (2011) · doi:10.2307/23044042 · Cited by 1,596
Lu, Y., & Ramamurthy, K. (. (2011) · MIS Quarterly · doi:10.2307/41409967 · Cited by 1,309
Metadata
- Authors
- Goodhue, D., Lewis, W., & Thompson, R.
- Venue
- Information Systems Research
- Published
- 2007-06
- Volume
- 18
- Issue
- 2
- Pages
- 211-227
- ISSN
- 1047-7047 (ISSN-L)
- 1526-5536
- OpenAlex
- W2112976112
- Cited by
- 232
- References
- 2
- FWCI
- 15.74
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Research Note—Statistical Power in Analyzing Interaction Effects: Questioning the Advantage of PLS with Product Indicators. https://app.cochat.ai/papers/10.1287/isre.1070.0123
- The paper
- Goodhue, D., Lewis, W., & Thompson, R. (2007). Research Note—Statistical Power in Analyzing Interaction Effects: Questioning the Advantage of PLS with Product Indicators. Information Systems Research. https://doi.org/10.1287/isre.1070.0123
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.