The Multifaceted Nature of Measurement Artifacts and Its Implications for Estimating Construct-Level Relationships
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Measurement artifacts, including measurement errors and scale-specific factors, distort observed correlations between measures of psychological and organizational constructs. The authors discuss two alternative procedures, one using the generalized coefficient of equivalence and stability (GCES) and one based on structural equation modeling, to correct for the biasing effect of measurement artifacts in order to estimate construct-level relationships. Assumptions underlying the procedures are discussed and the degrees of biases resulting from violating the assumptions are examined by means of Monte Carlo simulation. They then propose an approach using cumulative knowledge in the literature about properties of measures of a construct to estimate the GCES. That approach can allow researchers to estimate relationships between constructs in most research situations. The authors apply the approach to estimate the GCES for overall job satisfaction, an important organizational construct.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997
Lack of method variance in self-reported affect and perceptions at work: reality or artifact?
Williams, L. J., Cote, J. A., & Buckley, M. R. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.3.462 · Cited by 1,616
Statistical analysis of sets of congeneric tests
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291393 · Cited by 1,481
Common methods bias: does common methods variance really bias results?
Doty, D. H., & Glick, W. H. (1998) · Organizational Research Methods · doi:10.1177/109442819814002 · Cited by 1,380 · cited 10×
“A close examination of MTMM studies examined in Doty and Glick (1998) suggests a reason that the method factors as operationalized in those studies are likely to be correlated: Most studies there were either administered at the same time or the difference in instrument-based methods examined in…”
BackgroundMethodResultInfluentialBrennan, R. L. (2001) · doi:10.1007/978-1-4757-3456-0 · Cited by 1,121
Measurement error in psychological research: Lessons from 26 research scenarios.
Schmidt, F. L., & Hunter, J. E. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.199 · Cited by 567 · cited 4×
“The potential deleterious effect of measurement error on substantive conclusions in scientific research has been well documented (e.g., Cronbach, 1947; Ree & Carretta, 2006; Schmidt & Hunter, 1996, 1999; Stanley, 1971; Thorndike, 1951).”
BackgroundInfluentialSelf-citationOn the Meaning of within-Factor Correlated Measurement Errors
Gerbing, D. W., & Anderson, J. C. (1984) · Journal of Consumer Research · doi:10.1086/208993 · Cited by 526 · cited 1×
“That approach is theoretically advantageous to the current approach because it unambiguously identifies the factors that account for the correlated errors (Gerbing & Anderson, 1984).”
BackgroundSchmidt, F. L., Le, H., & Ilies, R. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.2.206 · Cited by 362 · cited 10×
“The second component in the right side of Equation 6 above (TEV) can be estimated from the following equation provided by Schmidt et al. (2003): TEV =CE −CES, ð7Þ where CE= coefficient of equivalence (typically coefficient alpha or other coefficients for internal consistency); and CES= coefficient…”
BackgroundMethodInfluentialSelf-citation
Cited by
Sources of method bias in social science research and recommendations on how to control it
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100452 · Cited by 15,744
Common Method Bias in Marketing: Causes, Mechanisms, and Procedural Remedies
MacKenzie, S. B., & Podsakoff, P. M. (2012) · Journal of Retailing · doi:10.1016/j.jretai.2012.08.001 · Cited by 3,051
Common method bias: It’ s bad, it’ s complex, it’ s widespread, and it’ s not easy to fix
Podsakoff, P. M., Podsakoff, N. P., Williams, L. J., Huang, C., & Yang, J. (2024) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-110721-040030 · Cited by 1,899
Wang, G., Oh, I.-S., Courtright, S. H., & Colbert, A. E. (2011) · Group & Organization Management · doi:10.1177/1059601111401017 · Cited by 1,315
An Updated Guideline for Assessing Discriminant Validity
Rönkkö, M., & Cho, E. (2022) · Organizational Research Methods · doi:10.1177/1094428120968614 · Cited by 1,309
“However, several articles point out that this may be a simplistic view of measurement error that only considers random and item-specific factor errors, ignoring time-specific transient errors (Le et al., 2009; Woehr et al., 2012).”
BackgroundMethodInfluential
Metadata
- Authors
- Le, H., Schmidt, F. L., & Putka, D. J.
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2007-08-08
- Volume
- 12
- Issue
- 1
- Pages
- 165-200
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2122983130
- Cited by
- 101
- References
- 8
- FWCI
- 5.25
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.