Construct Validation in Counseling Psychology Research
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Counseling psychology researchers devote little attention to theory-based measurement validation, as evidenced by cursory mention of validity issues in the method and discussion sections of published research reports. Especially, many researchers appear unaware of the limitations of correlations between pairs of self-report measures as evidence of construct validity. The authors provide an overview of the process of construct validation via user-friendly terminology and examples, with special attention to aspects often neglected in counseling psychology research, including specific recommendations for design and interpretation of multimethod validity investigations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.2.213 · Cited by 5,436
Schmidt, F. L., & Hunter, J. E. (1998) · Psychological Bulletin · doi:10.1037//0033-2909.124.2.262 · Cited by 4,180 · cited 1×
“Schmidt and Hunter (1998) published meta-analytic findings on the incremental validity of 18 categories of personnel measures as predictors of job performance, over and above variance predicted by GMA (for more on meta-analyses in counseling psychology research, see Quintana & Minami, 2006 [this…”
BackgroundScale Development Research: A Content Analysis and Recommendations for Best Practices
Worthington, R. L., & Whittaker, T. A. (2006) · The Counseling Psychologist · doi:10.1177/0011000006288127 · Cited by 4,087 · cited 1×
“…special issues on quantitative methods for counseling psychologists have included a detailed discussion of scale development (Dawis, 1987; Worthington & Whittaker, 2006 [this issue]) but no general introduction to psychometrics (principles of measurement for psychological constructs)…”
BackgroundA Brief Guide to Structural Equation Modeling
Weston, R., & Gore, P. A. (2006) · The Counseling Psychologist · doi:10.1177/0011000006286345 · Cited by 2,718
The stability of behavior: I. On predicting most of the people much of the time.
Epstein, S. (1979) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.37.7.1097 · Cited by 1,468 · cited 2×
“Using a single brief behavior sample as an indicator of behavioral tendencies, or a single rater as an informant about a target person’s characteristics, is a bit like relying on a single-item measure of a construct (Epstein, 1979).”
BackgroundMethodMeasurement error in psychological research: Lessons from 26 research scenarios.
Schmidt, F. L., & Hunter, J. E. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.199 · Cited by 567 · cited 3×
“Assessing incremental validity is useful for demonstrating that predictorcriterion correlations are not simply the effects of confounding variables— for example, does the measure account for variance in criterion variables beyond that accounted for by IQ?”
BackgroundInfluentialToward DSM—V and the classification of psychopathology.
Widiger, T. A., & Clark, L. A. (2000) · Psychological Bulletin · doi:10.1037/0033-2909.126.6.946 · Cited by 540
Schmidt, F. L., Le, H., & Ilies, R. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.2.206 · Cited by 362 · cited 3×
“…of equivalence and stability (CES) is needed; it can be computed as the correlation between different test forms, administered at different times.5 Schmidt et al. (2003) developed a simple procedure for estimating this coefficient from test-retest data for a multiitem scale and found that relying…”
BackgroundMethodInfluentialGuidelines for Meta-Analyses of Counseling Psychology Research
Quintana, S. M., & Minami, T. (2006) · The Counseling Psychologist · doi:10.1177/0011000006286991 · Cited by 83 · cited 1×
“…and Hunter (1998) published meta-analytic findings on the incremental validity of 18 categories of personnel measures as predictors of job performance, over and above variance predicted by GMA (for more on meta-analyses in counseling psychology research, see Quintana & Minami, 2006 [this issue]).”
BackgroundWhat if the hereditarian hypothesis is true?
Gottfredson, L. S. (2005) · Psychology, Public Policy, and Law · doi:10.1037/1076-8971.11.2.311 · Cited by 60
Research works printed but not linked: 70
- American Psychological Association, 1966, Standards for educational and psychological testing
- American Psychological Association, 1985, Standards for educational and psychological testing
- American Psychological Association, 1999, Standards for educational and psychological testing
- 10.1037/0003-066X.58.5.377 · DOI · Paper page
- Bateson, G., 2000, Steps to an ecology of mind, 10.7208/chicago/9780226924601.001.0001 · DOI · Paper page
- Butcher, J. N., 1989, Development and use of the MMPI-2 content scales
- 10.1037/h0048255 · DOI · Paper page
- 10.1037/h0046016 · DOI · Paper page
- Cohen, J., 1988, Statistical power analysis for the behavioral sciences
- Cohen, J., 2003, Applied multiple regression/correlation analysis for the behavioral sciences
- 10.1002/j.2161-1912.1998.tb00194.x · DOI
- 10.1037/0022-0167.48.4.456 · doi:10.1037/0022-0167.48.4.456 · Paper page
- 10.1037/1099-9809.8.4.335 · DOI · Paper page
- 10.1037/0022-0167.47.2.155 · doi:10.1037/0022-0167.47.2.155 · Paper page
- Cook, T. D., 1979, Quasi-experimentation: Design and analysis issues for field settings
- Crocker, L., 1986, Introduction to classical and modern test theory
- 10.1007/BF02289289 · DOI · Paper page
- 10.1007/BF02310555 · DOI · Paper page
- Cronbach, L. J., 1971, Educational measurement, 443
- Cronbach, L. J., 1984, Essentials of psychological testing
- Cronbach, L. J., 1995, Personality research, methods, and theory: A festschrift honoring Donald W. Fiske, 145
- 10.1037/h0040957 · DOI · Paper page
- 10.1037/h0047358 · DOI · Paper page
- 10.1002/j.1556-6676.1991.tb01576.x · DOI · Paper page
- 10.1037/0022-0167.34.4.481 · DOI · Paper page
- 10.1037/1082-989X.3.4.412 · doi:10.1037/1082-989x.3.4.412 · Paper page
- Eid, M., 2005, Handbook of multimethod measurement in psychology
- 10.1111/j.1467-6494.1983.tb00338.x · DOI · Paper page
- 10.1037/0033-2909.112.3.393 · doi:10.1037/0033-2909.112.3.393 · Paper page
- 10.1177/001316444600600401 · DOI · Paper page
- 10.1177/0011000006288308 · DOI · Paper page
- 10.1177/0011000005283558 · DOI · Paper page
- Heppner, P. P., 2004, Writing and publishing your thesis, dissertation, and research
- Heppner, P. P., 1999, Research design in counseling
- 10.1037/1082-989X.5.1.64 · doi:10.1037/1082-989x.5.1.64 · Paper page
- 10.1037/1082-989X.4.4.403 · doi:10.1037/1082-989x.4.4.403 · Paper page
- Hoyt, W. T., 2005, Handbook of forgiveness, 109
- 10.1177/0011000099273003 · DOI · Paper page
- 10.1177/0011000006286347 · DOI · Paper page
- 10.1037/1040-3590.7.3.228 · doi:10.1037/1040-3590.7.3.228 · Paper page
- Kline, R., 1998, Principles and practice of structural equation modeling
- 10.1037/0735-7028.22.5.380 · doi:10.1037/0735-7028.22.5.380 · Paper page
- Lakes, K. D., Journal of Clinical Child and Adolescent Psychology
- Leong, F. T. L., 1995, Handbook of vocational psychology: Theory, research, and practice, 143
- Loevinger, J., 1957, Psychological Reports, 3, 635
- 10.1177/0011000005283395 · DOI · Paper page
- 10.1037/0022-006X.51.6.882 · doi:10.1037/0022-006x.51.6.882 · Paper page
- Messick, S., 1989, Educational measurement, 13
- Mischel, W., 1968, Personality and assessment
- 10.1037/0022-0167.50.4.448 · DOI · Paper page
- 10.1037/0022-0167.49.3.290 · doi:10.1037/0022-0167.49.3.290 · Paper page
- 10.1037/0021-9010.81.6.660 · doi:10.1037/0021-9010.81.6.660 · Paper page
- 10.1002/j.2161-1912.2002.tb00489.x · DOI · Paper page
- Quintana, S. M., 2001, Handbook of multicultural counseling, 604
- 10.1037/0021-9010.75.3.322 · doi:10.1037/0021-9010.75.3.322 · Paper page
- 10.3102/00346543049002252 · DOI
- 10.1037/0033-2909.124.2.262 · doi:10.1037/0033-2909.124.2.262 · Paper page
- Schmidt, F. L., 2003, Validity generalization: A critical review, 31
- Shadish, W. R., 2002, Experimental and quasi-experimental designs for generalized causal inference
- 10.1177/0011000006287103 · DOI · Paper page
- 10.1037/0022-0167.49.4.438 · doi:10.1037/0022-0167.49.4.438 · Paper page
- 10.1037/0022-0167.45.3.256 · doi:10.1037/0022-0167.45.3.256 · Paper page
- 10.1037/0022-0167.41.2.137 · doi:10.1037/0022-0167.41.2.137 · Paper page
- 10.1037/0033-2909.112.3.387 · DOI
- 10.1037/0003-066X.52.6.630 · DOI · Paper page
- 10.1002/j.2161-1912.1992.tb00563.x · DOI · Paper page
- 10.1037/0022-0167.35.3.330 · doi:10.1037/0022-0167.35.3.330 · Paper page
- 10.1177/0013164402062004002 · doi:10.1177/0013164402062004002 · Paper page
- 10.1037/0022-3514.84.3.608 · doi:10.1037/0022-3514.84.3.608 · Paper page
- 10.1037/0022-0167.47.4.460 · doi:10.1037/0022-0167.47.4.460 · Paper page
Cited by
Scale Development Research: A Content Analysis and Recommendations for Best Practices
Worthington, R. L., & Whittaker, T. A. (2006) · The Counseling Psychologist · doi:10.1177/0011000006288127 · Cited by 4,087
Qualitative Research Designs: Selection and Implementation
Creswell, J. W., Hanson, W. E., Clark Plano, V. L., & Morales, A. (2007) · The Counseling Psychologist · doi:10.1177/0011000006287390 · Cited by 3,096
Kahn, J. H. (2006) · The Counseling Psychologist · doi:10.1177/0011000006286347 · Cited by 695
Development, Use, and Psychometric Properties of the Trauma History Questionnaire
Hooper, L. M., Stockton, P., Krupnick, J. L., & Green, B. L. (2011) · Journal of Loss and Trauma · doi:10.1080/15325024.2011.572035 · Cited by 399
Racial and ethnic identity: Developmental perspectives and research.
Quintana, S. M. (2007) · Journal of Counseling Psychology · doi:10.1037/0022-0167.54.3.259 · Cited by 383
Metadata
- Authors
- Hoyt, W. T., Warbasse, R. E., & Chu, E. Y.
- Venue
- The Counseling Psychologist
- Publisher
- SAGE Publications
- Published
- 2006-11
- Volume
- 34
- Issue
- 6
- Pages
- 769-805
- ISSN
- 0011-0000 (ISSN-L)
- 1552-3861
- OpenAlex
- W2165121648
- Cited by
- 114
- References
- 11
- FWCI
- 11.99
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Construct Validation in Counseling Psychology Research. https://app.cochat.ai/papers/10.1177/0011000006287389
- The paper
- Hoyt, W. T., Warbasse, R. E., & Chu, E. Y. (2006). Construct Validation in Counseling Psychology Research. The Counseling Psychologist. https://doi.org/10.1177/0011000006287389
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.