The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Construct Validity and Error Components of Survey Measures: A Structural Modeling Approach
Abstract
Measurement errors can have profound effects on statistical relationships, and better information on the quality of measures seems needed. This study uses a new technology—structural modeling of data from special supplements to regular surveys—to generate estimates of construct validity, method effects (a major source of correlated error), and residual error (mainly random error) for a broad set of measures obtained from five national surveys and an organizational survey (total respondents = 7,706). Analysis of these estimates suggested that a typical survey item, when administered by a respected survey organization to a general population sample, can be expected to yield 50–83 percent valid variance, 0–7 percent method effects variance, and 14–48 percent residual variance. Multivariate analysis showed that over two-thirds of the variation in measurement quality could be explained by 13 survey design characteristics; characteristics of respondents explained a small additional portion. Results provide: (a) information on design conditions associated with better (or worse) measurement quality, (b) empirically based suggestions for improving measurement quality in future surveys, and (c) a set of coefficients for predicting the quality of measures not studied here.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Significance tests and goodness of fit in the analysis of covariance structures.
Bentler, P. M., & Bonett, D. G. (1980) · Psychological Bulletin · doi:10.1037//0033-2909.88.3.588 · Cited by 19,023
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Assessing Reliability and Stability in Panel Models
Wheaton, B., Muthen, B., Alwin, D. F., & Summers, G. F. (1977) · Sociological Methodology · doi:10.2307/270754 · Cited by 3,116
The Approval Motive: Studies in Evaluative Dependence
Edwards, A. L., Crowne, D. P., & Marlowe, D. (1965) · The American Journal of Psychology · doi:10.2307/1420595 · Cited by 1,933
Multivariate Analysis with Latent Variables: Causal Modeling
Bentler, P. M. (1980) · Annual Review of Psychology · doi:10.1146/annurev.ps.31.020180.002223 · Cited by 1,619
Social Measurement: Current Issues
Bohrnstedt, G. W., & Borgatta, E. F. (1981) · Medical Entomology and Zoology · Cited by 1,394
Structural Analysis of Covariance and Correlation Matrices
Jöreskog, K. G. (1978) · Psychometrika · doi:10.1007/bf02293808 · Cited by 1,009
The Effectiveness of Adjustment by Subclassification in Removing Bias in Observational Studies
Cochran, W. G. (1968) · Biometrics · doi:10.2307/2528036 · Cited by 961
Sociological Methodology 1980.
Carter, L. F., & Schuessler, K. F. (1981) · Contemporary Sociology · doi:10.2307/2066948 · Cited by 894
The Optimal Number of Response Alternatives for a Scale: A Review
Cox, E. P. (1980) · Journal of Marketing Research · doi:10.1177/002224378001700401 · Cited by 811
Multiple classification analysis
Andrews, F. M. (1967) · Medical Entomology and Zoology · Cited by 501
Self-citationEffect of the number of scale points on reliability: A Monte Carlo approach.
Lissitz, R. W., & Green, S. B. (1975) · Journal of Applied Psychology · doi:10.1037/h0076268 · Cited by 488
Schooling and Achievement in American Society.
Marini, M. M., Sewell, W. H., Hauser, R. M., & Featherman, D. L. (1977) · Contemporary Sociology · doi:10.2307/2066346 · Cited by 411
Pearson's R and Coarsely Categorized Measures
Bollen, K. A., & Barb, K. H. (1981) · American Sociological Review · doi:10.2307/2094981 · Cited by 337
Measurement in the Social Sciences
Howell, R. D., Zeller, R. A., & Carmines, E. G. (1981) · Journal of Marketing Research · doi:10.2307/3150964 · Cited by 328
Validity, Invalidity, and Reliability
Heise, D. R., & Bohrnstedt, G. W. (1970) · Sociological Methodology · doi:10.2307/270785 · Cited by 286
Robustness in Regression Analysis
Bohrnstedt, G. W., & Carter, T. M. (1971) · Sociological Methodology · doi:10.2307/270820 · Cited by 266
The validity of measures of self-reported well-being
Andrews, F. M., & Crandall, R. (1976) · Social Indicators Research · doi:10.1007/bf00286161 · Cited by 206
Self-citationApplied Multivariate Analysis and Experimental Designs
Kidd, J. B., Namboodiri, K., Carter, L. F., & Blalock, H. M. (1976) · Operational Research Quarterly (1970-1977) · doi:10.2307/3008828 · Cited by 182
Bielby, W. T., Hauser, R. M., & Featherman, D. L. (1977) · American Journal of Sociology · doi:10.1086/226465 · Cited by 154
The Effect of Number of Categories in Rating Scales on Precision of Estimation of Scale Values
Ramsay, J. O. (1973) · Psychometrika · doi:10.1007/bf02291492 · Cited by 130
Measurement Models for Response Errors in Surveys: Issues and Applications
Alwin, D. F., & Jackson, D. J. (1980) · Sociological Methodology · doi:10.2307/270860 · Cited by 125
Approaches to the Interpretation of Relationships in the Multitrait-Multimethod Matrix
Alwin, D. F. (1973) · Sociological Methodology · doi:10.2307/270833 · Cited by 96
A Review And Critique Of Analyses Of Multitrait-Multimethod Matrices
Schmitt, N., Coyle, B. W., & Saari, B. B. (1977) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr1204_3 · Cited by 82
Subjective Class Identification: A Multiple Indicator Approach
Kluegel, J. R., Singleton, R. A., & Starnes, C. E. (1977) · American Sociological Review · doi:10.2307/2094558 · Cited by 81
The Quality of Survey Data as Related to Age of Respondent
Andrews, F. M., & Herzog, A. R. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478284 · Cited by 70
Self-citationMeasurement Errors in the Estimation of Home Value
Robins, P. K., & West, R. W. (1977) · Journal of the American Statistical Association · doi:10.1080/01621459.1977.10480992 · Cited by 65
Alternative Methods of Analysis: Multitrait-Multimethod Data
Boruch, R. F., Larkin, J. D., Wolins, L., & MacKinney, A. C. (1970) · Educational and Psychological Measurement · doi:10.1177/001316447003000405 · Cited by 59
Response Error in Earnings Functions for Nonblack Males
Bielby, W. T., & Hauser, R. M. (1977) · Sociological Methods & Research · doi:10.1177/004912417700600207 · Cited by 55
Response Errors of Nonblack Males in Models of the Stratification Process
Bielby, W. T., Hauser, R. M., & Featherman, D. L. (1977) · Journal of the American Statistical Association · doi:10.1080/01621459.1977.10479948 · Cited by 52
Grouping for Testing Trends in Categorical Data
Connor, R. (1972) · Journal of the American Statistical Association · doi:10.1080/01621459.1972.10481256 · Cited by 46
Sex Differences in Measurement Error in Status Attainment Models
Corcoran, M. (1980) · Sociological Methods & Research · doi:10.1177/004912418000900205 · Cited by 24
Cited by
A national customer satisfaction barometer: the Swedish experience
Fornell, C. (1992) · Journal of Marketing · doi:10.2307/1252129 · Cited by 5,641
The American Customer Satisfaction Index: Nature, Purpose, and Findings
Fornell, C., Johnson, M. D., Anderson, E. W., Cha, J., & Bryant, B. E. (1996) · Journal of Marketing · doi:10.2307/1251898 · Cited by 4,736
McHorney, C. A., Ware, J. E., Rachel Lu, J. F., & Sherbourne, C. D. (1994) · Medical Care · doi:10.1097/00005650-199401000-00004 · Cited by 4,458
The MOS Short-form General Health Survey: Reliability and Validity in a Patient Population
Stewart, A. L., Hays, R. D., & Ware, J. E. (1988) · Medical Care · doi:10.1097/00005650-198807000-00007 · Cited by 3,339
Intellectual capital: an exploratory study that develops measures and models
Bontis, N. (1998) · Management Decision · doi:10.1108/00251749810204142 · Cited by 3,276
Metadata
- Authors
- Andrews, F. M.
- Venue
- Public Opinion Quarterly
- Publisher
- Oxford University Press (OUP)
- Published
- 1984
- Volume
- 48
- Issue
- 2
- Pages
- 409
- ISSN
- 0033-362X (ISSN-L)
- OpenAlex
- W2039404010
- Cited by
- 415
- References
- 33
- FWCI
- 33.19
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.