The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Construct Validity and Error Components of Survey Measures: A Structural Modeling Approach
Abstract
Measurement errors can have profound effects on statistical relationships, and better information on the quality of measures seems needed. This study uses a new technology—structural modeling of data from special supplements to regular surveys—to generate estimates of construct validity, method effects (a major source of correlated error), and residual error (mainly random error) for a broad set of measures obtained from five national surveys and an organizational survey (total respondents = 7,706). Analysis of these estimates suggested that a typical survey item, when administered by a respected survey organization to a general population sample, can be expected to yield 50–83 percent valid variance, 0–7 percent method effects variance, and 14–48 percent residual variance. Multivariate analysis showed that over two-thirds of the variation in measurement quality could be explained by 13 survey design characteristics; characteristics of respondents explained a small additional portion. Results provide: (a) information on design conditions associated with better (or worse) measurement quality, (b) empirically based suggestions for improving measurement quality in future surveys, and (c) a set of coefficients for predicting the quality of measures not studied here.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Significance tests and goodness of fit in the analysis of covariance structures.
Bentler, P. M., & Bonett, D. G. (1980) · Psychological Bulletin · doi:10.1037//0033-2909.88.3.588 · Cited by 19,023
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Assessing Reliability and Stability in Panel Models
Wheaton, B., Muthen, B., Alwin, D. F., & Summers, G. F. (1977) · Sociological Methodology · doi:10.2307/270754 · Cited by 3,116
The Approval Motive: Studies in Evaluative Dependence
Edwards, A. L., Crowne, D. P., & Marlowe, D. (1965) · The American Journal of Psychology · doi:10.2307/1420595 · Cited by 1,933
Multivariate Analysis with Latent Variables: Causal Modeling
Bentler, P. M. (1980) · Annual Review of Psychology · doi:10.1146/annurev.ps.31.020180.002223 · Cited by 1,619
Social Measurement: Current Issues
Bohrnstedt, G. W., & Borgatta, E. F. (1981) · Medical Entomology and Zoology · Cited by 1,394
Structural Analysis of Covariance and Correlation Matrices
Jöreskog, K. G. (1978) · Psychometrika · doi:10.1007/bf02293808 · Cited by 1,009
The Effectiveness of Adjustment by Subclassification in Removing Bias in Observational Studies
Cochran, W. G. (1968) · Biometrics · doi:10.2307/2528036 · Cited by 961
Sociological Methodology 1980.
Carter, L. F., & Schuessler, K. F. (1981) · Contemporary Sociology · doi:10.2307/2066948 · Cited by 894
Cited by
A national customer satisfaction barometer: the Swedish experience
Fornell, C. (1992) · Journal of Marketing · doi:10.2307/1252129 · Cited by 5,641
The American Customer Satisfaction Index: Nature, Purpose, and Findings
Fornell, C., Johnson, M. D., Anderson, E. W., Cha, J., & Bryant, B. E. (1996) · Journal of Marketing · doi:10.2307/1251898 · Cited by 4,736
McHorney, C. A., Ware, J. E., Rachel Lu, J. F., & Sherbourne, C. D. (1994) · Medical Care · doi:10.1097/00005650-199401000-00004 · Cited by 4,458
The MOS Short-form General Health Survey: Reliability and Validity in a Patient Population
Stewart, A. L., Hays, R. D., & Ware, J. E. (1988) · Medical Care · doi:10.1097/00005650-198807000-00007 · Cited by 3,339
Intellectual capital: an exploratory study that develops measures and models
Bontis, N. (1998) · Management Decision · doi:10.1108/00251749810204142 · Cited by 3,276
Will raising the incomes of all increase the happiness of all?
Easterlin, R. A. (1995) · Journal of Economic Behavior & Organization · doi:10.1016/0167-2681(95)00003-b · Cited by 3,116
Validation Guidelines for IS Positivist Research
Straub, D., & Gefen, D. (2004) · Communications of the Association for Information Systems · doi:10.17705/1cais.01324 · Cited by 2,797
The C-OAR-SE procedure for scale development in marketing
Rossiter, J. R. (2002) · International Journal of Research in Marketing · doi:10.1016/s0167-8116(02)00097-6 · Cited by 2,477
Response strategies for coping with the cognitive demands of attitude measures in surveys
Krosnick, J. A. (1991) · Applied Cognitive Psychology · doi:10.1002/acp.2350050305 · Cited by 2,460
Krosnick, J. A. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.537 · Cited by 1,852
Managing An Organizational Learning System By Aligning Stocks and Flows
Bontis, N., Crossan, M. M., & Hulland, J. (2002) · Journal of Management Studies · doi:10.1111/1467-6486.t01-1-00299 · Cited by 1,267
Criteria for Scale Selection and Evaluation
Robinson, J. P., Shaver, P. R., & Wrightsman, L. S. (1991) · Measures of Personality and Social Psychological Attitudes · doi:10.1016/b978-0-12-590241-0.50005-8 · Cited by 1,229
Chen, C., Lee, S.-Y., & Stevenson, H. W. (1995) · Psychological Science · doi:10.1111/j.1467-9280.1995.tb00327.x · Cited by 873
Methods for Testing and Evaluating Survey Questionnaires
(2004) · doi:10.1002/0471654728 · Cited by 855
Testing the reliability and validity of the self-efficacy for exercise scale
Resnick, B., & Jenkins, L. S. (2000) · Nursing Research · doi:10.1097/00006199-200005000-00007 · Cited by 810
Weijters, B., Cabooter, E., & Schillewaert, N. (2010) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2010.02.004 · Cited by 801
Total Survey Error: Past, Present, and Future
Groves, R. M., & Lyberg, L. (2010) · Public Opinion Quarterly · doi:10.1093/poq/nfq065 · Cited by 594
Foundations of the American Customer Satisfaction Index
Anderson, E. W., & Fornell, C. (2000) · Total Quality Management · doi:10.1080/09544120050135425 · Cited by 553
Choosing the Number of Categories in Agree–Disagree Scales
Revilla, M. A., Saris, W. E., & Krosnick, J. A. (2014) · Sociological Methods & Research · doi:10.1177/0049124113509605 · Cited by 553
Methods for Testing and Evaluating Survey Questions
Presser, S., Couper, M. P., Lessler, J. T., Martin, E., Martin, J., Rothgeb, J. M., & Singer, E. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh008 · Cited by 546
The Impact of “No Opinion” Response Options on Data Quality
Krosnick, J. A., Holbrook, A. L., Berent, M. K., Carson, R. T., Hanemann, W. M., Kopp, R. J., Mitchell, R. C., Presser, S., Ruud, P. A., Smith, V. K., et al. (2001) · Public Opinion Quarterly · doi:10.1086/341394 · Cited by 546
Krosnick, J. A., Holbrook, A. L., Lowe, L., & Visser, P. S. (2006) · Climatic Change · doi:10.1007/s10584-006-9068-8 · Cited by 543
Designing Rating Scales for Effective Measurement in Surveys
Krosnick, J. A., & Fabrigar, L. R. (1997) · Wiley Series in Probability and Statistics · doi:10.1002/9781118490013.ch6 · Cited by 528
Measures of Subjective Well-Being
Andrews, F. M., & Robinson, J. P. (1991) · Measures of Personality and Social Psychological Attitudes · doi:10.1016/b978-0-12-590241-0.50007-1 · Cited by 495
Self-citationThe Quality-of-Life (QOL) Research Movement: Past, Present, and Future
Sirgy, M. J., Michalos, A. C., Ferriss, A. L., Easterlin, R. A., Patrick, D., & Pavot, W. (2006) · Social Indicators Research · doi:10.1007/s11205-005-2877-8 · Cited by 452
Jarvis, W. B. G., & Petty, R. E. (1996) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.70.1.172 · Cited by 427
The Reliability of Survey Attitude Measurement: The Influence of Question and Respondent Attributes
ALWIN, D. F., & KROSNICK, J. A. (1991) · Sociological Methods & Research · doi:10.1177/0049124191020001005 · Cited by 403
Designing and Conducting Health Surveys
Aday, L. A. (1998) · Journal For Healthcare Quality · doi:10.1097/01445442-199805000-00015 · Cited by 391
The Measurement of Values in Surveys: A Comparison of Ratings and Rankings
Alwin, D. F., & Krosnick, J. A. (1985) · Public Opinion Quarterly · doi:10.1086/268949 · Cited by 373
Steenbergen, M. R., & Marks, G. (2007) · European Journal of Political Research · doi:10.1111/j.1475-6765.2006.00694.x · Cited by 369
Assumptions of Multiple Regression: Correcting Two Misconceptions
Williams, M. N., Grajales, C. A. G., & Kurkiewicz, D. (2020) · Scholarworks (University of Massachusetts Amherst) · doi:10.7275/55hn-wk47 · Cited by 359
Normative Life Satisfaction: Measurement Issues and a Homeostatic Model
Cummins, R. A. (2003) · Social Indicators Research · doi:10.1023/a:1024712527648 · Cited by 348
Feeling Thermometers Versus 7-Point Scales: Which are Better?
ALWIN, D. F. (1997) · Sociological Methods & Research · doi:10.1177/0049124197025003003 · Cited by 345
Satisfaction with mobile services in Canada: An empirical investigation
Turel, O., & Serenko, A. (2006) · Telecommunications Policy · doi:10.1016/j.telpol.2005.10.003 · Cited by 333
Research into Questionnaire Design: A Summary of the Literature
Lietz, P. (2010) · International Journal of Market Research · doi:10.2501/s147078530920120x · Cited by 313
A Comprehensive Strategy for Developing Closed-Ended Survey Items for Use in Studies of Older Adults
Krause, N. (2002) · The Journals of Gerontology Series B: Psychological Sciences and Social Sciences · doi:10.1093/geronb/57.5.s263 · Cited by 272
Mobile augmented reality for cultural heritage: A technology acceptance study
Haugstvedt, A.-C., & Krogstie, J. (2012) · 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) · doi:10.1109/ismar.2012.6402563 · Cited by 271
Zhou, Y., Thøgersen, J., Ruan, Y., & Huang, G. (2013) · Journal of Consumer Marketing · doi:10.1108/jcm-02-2013-0482 · Cited by 269
Borgers, N., Sikkel, D., & Hox, J. (2004) · Quality and Quantity · doi:10.1023/b:ququ.0000013236.29205.a6 · Cited by 264
MCHORNEY, C. A., & WARE, J. E. (1995) · Medical Care · doi:10.1097/00005650-199501000-00002 · Cited by 260
Understanding repetitive travel mode choices in a stable context: A panel study approach
Thøgersen, J. (2006) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2005.11.004 · Cited by 259
A classification of response scale characteristics that affect data quality: a literature review
DeCastellarnau, A. (2018) · Quality & Quantity · doi:10.1007/s11135-017-0533-4 · Cited by 259
Stability of Life-satisfaction over Time
Ehrhardt, J. J., Saris, W. E., & Veenhoven, R. (2000) · Journal of Happiness Studies · doi:10.1023/a:1010084410679 · Cited by 258
The University of North Carolina at Charlotte, Zhou, L., Rudin, C., Duke University, Gombolay, M., Georgia Institute of Technology, Spohrer, J., International Society of Service Innovation Professionals, Zhou, M., Juji, et al. (2023) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00085 · Cited by 20
(2020) · PubMed
Metadata
- Authors
- Andrews, F. M.
- Venue
- Public Opinion Quarterly
- Publisher
- Oxford University Press (OUP)
- Published
- 1984
- Volume
- 48
- Issue
- 2
- Pages
- 409
- ISSN
- 0033-362X (ISSN-L)
- OpenAlex
- W2039404010
- Cited by
- 415
- References
- 33
- FWCI
- 33.19
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.