Are we really measuring what we say we're measuring? Using video techniques to supplement traditional construct validation procedures.
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Several researchers have persuasively argued that the most important evidence to consider when assessing construct validity is whether variations in the construct of interest cause corresponding variations in the measures of the focal construct. Unfortunately, the literature provides little practical guidance on how researchers can go about testing this. Therefore, the purpose of this article is to describe how researchers can use video techniques to test whether their scales measure what they purport to measure. First, we discuss how researchers can develop valid manipulations of the focal construct that they hope to measure. Next, we explain how to design a study to use this manipulation to test the validity of the scale. Finally, comparing and contrasting traditional and contemporary perspectives on validation, we discuss the advantages and limitations of video-based validation procedures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
Self-citationA Paradigm for Developing Better Measures of Marketing Constructs
Churchill, G. A. (1979) · Journal of Marketing Research · doi:10.1177/002224377901600110 · Cited by 16,549
Constructing validity: Basic issues in objective scale development.
Clark, L. A., & Watson, D. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.309 · Cited by 6,567
Jarvis, C. B., MacKenzie, S. B., & Podsakoff, P. M. (2003) · Journal of Consumer Research · doi:10.1086/376806 · Cited by 5,807
Self-citationFlesch, R. (1948) · Journal of Applied Psychology · doi:10.1037/h0057532 · Cited by 5,391
Ericsson (1993) · doi:10.1037/0033-295x.87.3.215 · Cited by 4,539
Conventional wisdom on measurement: A structural equation perspective.
Bollen, K., & Lennox, R. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.110.2.305 · Cited by 3,618
A Review of Scale Development Practices in the Study of Organizations
Hinkin, T. R. (1995) · Journal of Management · doi:10.1177/014920639502100509 · Cited by 3,193
MacKenzie, S. B., Podsakoff, P. M., & Podsakoff, N. P. (2011) · MIS Quarterly · doi:10.2307/23044045 · Cited by 3,165
Self-citationLocke, E. A. (1969) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(69)90013-0 · Cited by 2,767
Cited by
Servant Leadership: A systematic review and call for future research
Eva, N., Robin, M., Sendjaya, S., van Dierendonck, D., & Liden, R. C. (2019) · The Leadership Quarterly · doi:10.1016/j.leaqua.2018.07.004 · Cited by 1,858
Scale development: ten main limitations and recommendations to improve future research practices
Morgado, F. F. R., Meireles, J. F. F., Neves, C. M., Amaral, A. C. S., & Ferreira, M. E. C. (2018) · Psicologia: Reflexão e Crítica · doi:10.1186/s41155-016-0057-1 · Cited by 780
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2016) · Organizational Research Methods · doi:10.1177/1094428115624965 · Cited by 712
Self-citationMaynes, T. D., & Podsakoff, P. M. (2014) · Journal of Applied Psychology · doi:10.1037/a0034284 · Cited by 560
Self-citationOn doing better science: From thrill of discovery to policy implications
Antonakis, J. (2017) · The Leadership Quarterly · doi:10.1016/j.leaqua.2017.01.006 · Cited by 475
Charisma: An ill-defined and ill-measured gift
Antonakis, J., Bastardoz, N., Jacquart, P., & Shamir, B. (2016) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-041015-062305 · Cited by 410
On doing relevant and rigorous experiments: Review and recommendations
Lonati, S., Quiroga, B. F., Zehnder, C., & Antonakis, J. (2018) · Journal of Operations Management · doi:10.1016/j.jom.2018.10.003 · Cited by 354
Podsakoff, P. M., & Podsakoff, N. P. (2019) · The Leadership Quarterly · doi:10.1016/j.leaqua.2018.11.002 · Cited by 312
Self-citationAn Ounce of Prevention Is Worth a Pound of Cure: Improving Research Quality Before Data Collection
Aguinis, H., & Vandenberg, R. J. (2014) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-031413-091231 · Cited by 304
“Another technological advancement is the use of video-based technology for creating manipulations that in turn are used to gather evidence regarding the extent to which a measure assesses the intended construct (Podsakoff et al. 2013).”
BackgroundThe assessment of commitment: Advantages of a unidimensional, target-free approach.
Klein, H. J., Cooper, J. T., Molloy, J. C., & Swanson, J. A. (2014) · Journal of Applied Psychology · doi:10.1037/a0034751 · Cited by 269
Güntner, A. V., Klasmeier, K. N., Klonek, F. E., & Kauffeld, S. (2021) · Journal of Leadership & Organizational Studies · doi:10.1177/15480518211012408 · Cited by 25
Metadata
- Authors
- Podsakoff, N. P., Podsakoff, P. M., MacKenzie, S. B., & Klinger, R. L.
- Venue
- Journal of Applied Psychology
- Published
- 2013
- Volume
- 98
- Issue
- 1
- Pages
- 99-113
- ISSN
- 0021-9010 (ISSN-L)
- 1939-1854
- OpenAlex
- W2331916847
- Cited by
- 92
- References
- 17
- FWCI
- 4.38
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.