The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Scale Adaptation in Organizational Science Research: A Review and Best-Practice Recommendations
Abstract
In describing measures used in their research, authors frequently report having adapted a scale, indicating that they changed something about it. Although such changes can raise concerns about validity, there has been little discussion of this practice in our literature. To estimate the prevalence and identify key forms of scale adaptation, we conducted two studies of the literature. In Study 1, we reviewed the descriptions of all scales ( N = 2,088) in four top journals over a 2-year period. We found that 46% of all scales were reported by authors as adapted and that evidence to support the validity of the adapted scales was presented in 23% of those cases. In Study 2, we chose six scales and examined their use across the literature, which allowed us to identify unreported adaptations. We found that 85% of the administrations of these scales had at least one form of adaptation and many had multiple adaptations. In Study 3, we surveyed editorial board members and a select group of psychometricians to evaluate the extent to which particular adaptations raised concerns about validity and the kinds of evidence needed to support the validity of the adapted scales. To provide guidance for authors who adapt scales and for reviewers and editors who evaluate papers with adapted scales, we present discussions of several forms of adaptations regarding potential threats to validity and recommendations for the kinds of evidence that might best support the validity of the adapted scale (including a reviewer checklist).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sources of method bias in social science research and recommendations on how to control it
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100452 · Cited by 15,744
(1991) · Cited by 15,554
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Vandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997
The standards for educational and psychological testing.
Eignor, D. R. (2013) · APA handbook of testing and assessment in psychology, Vol. 1: Test theory and testing and assessment in industrial and organizational psychology. · doi:10.1037/14047-013 · Cited by 6,988
Constructing validity: Basic issues in objective scale development.
Clark, L. A., & Watson, D. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.309 · Cited by 6,567
Strategic management of small firms in hostile and benign environments
Covin, J. G., & Slevin, D. P. (1989) · Strategic Management Journal · doi:10.1002/smj.4250100107 · Cited by 5,981
On the dimensionality of organizational justice: A construct validation of a measure.
Colquitt, J. A. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.3.386 · Cited by 4,114
Consequences of abusive supervision.
Tepper, B. J. (2000) · Academy of Management Journal · doi:10.2307/1556375 · Cited by 3,810
HELPING AND VOICE EXTRA-ROLE BEHAVIORS: EVIDENCE OF CONSTRUCT AND PREDICTIVE VALIDITY.
Van Dyne, L., & LePine, J. A. (1998) · Academy of Management Journal · doi:10.2307/256902 · Cited by 3,178
Development of a measure of workplace deviance.
Bennett, R. J., & Robinson, S. L. (2000) · Journal of Applied Psychology · doi:10.1037//0021-9010.85.3.349 · Cited by 3,066
Content validity in psychological assessment: A functional approach to concepts and methods.
Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995) · Psychological Assessment · doi:10.1037//1040-3590.7.3.238 · Cited by 2,387
Field Methods in Cross-Cultural Research
Shelly, R. K., Lonner, W. J., & Berry, J. W. (1988) · Contemporary Sociology · doi:10.2307/2069488 · Cited by 2,113
Validating the interpretations and uses of test scores
Kane, M. T. (2013) · Journal of Educational Measurement · doi:10.1111/jedm.12000 · Cited by 2,110
Dawes, J. (2008) · International Journal of Market Research · doi:10.1177/147078530805000106 · Cited by 2,107
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.1061 · Cited by 1,674
Moses, L. E., & Lindquist, E. F. (1951) · Journal of the American Statistical Association · doi:10.2307/2280411 · Cited by 1,661
Adapting Educational and Psychological Tests for Cross-Cultural Assessment
(2004) · Psychology Press eBooks · doi:10.4324/9781410611758 · Cited by 1,627
Mitchell, M. S., & Ambrose, M. L. (2007) · Journal of Applied Psychology · doi:10.1037/0021-9010.92.4.1159 · Cited by 1,514
Colquitt, J. A., Scott, B. A., Rodell, J. B., Long, D. M., Zapata, C. P., Conlon, D. E., & Wesson, M. J. (2013) · Journal of Applied Psychology · doi:10.1037/a0031757 · Cited by 1,462
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2016) · Organizational Research Methods · doi:10.1177/1094428115624965 · Cited by 712
Abusive supervision: A meta-analysis and empirical review
Mackey, J. D., Frieder, R. E., Brees, J. R., & Martinko, M. J. (2017) · Journal of Management · doi:10.1177/0149206315573997 · Cited by 706
Effects of Culture and Response Format on Extreme Response Style
Hui, C. H., & Triandis, H. C. (1989) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022189203004 · Cited by 644
ISSUES AND STRATEGIES FOR REDUCING THE LENGTH OF SELF‐REPORT SCALES
STANTON, J. M., SINAR, E. F., BALZER, W. K., & SMITH, P. C. (2002) · Personnel Psychology · doi:10.1111/j.1744-6570.2002.tb00108.x · Cited by 601
Schriesheim, C. A., Powers, K. J., Scandura, T. A., Gardiner, C. C., & Lankau, M. J. (1993) · Journal of Management · doi:10.1016/0149-2063(93)90058-u · Cited by 555
Choosing the Number of Categories in Agree–Disagree Scales
Revilla, M. A., Saris, W. E., & Krosnick, J. A. (2014) · Sociological Methods & Research · doi:10.1177/0049124113509605 · Cited by 553
Cultural differences in responses to a likert scale
Lee, J. W., Jones, P. S., Mineyama, Y., & Zhang, X. E. (2002) · Research in Nursing & Health · doi:10.1002/nur.10041 · Cited by 543
Chamberlin, M., Newton, D. W., & Lepine, J. A. (2017) · Personnel Psychology · doi:10.1111/peps.12185 · Cited by 532
What You See Is What You Get? Enhancing Methodological Transparency in Management Research
Aguinis, H., Ramani, R. S., & Alabduljader, N. (2018) · Academy of Management Annals · doi:10.5465/annals.2016.0011 · Cited by 463
Rosenbusch, N., Rauch, A., & Bausch, A. (2013) · Journal of Management · doi:10.1177/0149206311425612 · Cited by 454
Rating Scales: Numeric Values May Change the Meaning of Scale Labels
Schwarz, N., Knauper, B., Hippler, H.-J., Noelle-Neumann, E., & Clark, L. (1991) · Public Opinion Quarterly · doi:10.1086/269282 · Cited by 411
Weng, L.-J. (2004) · Educational and Psychological Measurement · doi:10.1177/0013164404268674 · Cited by 410
Schmidt, F. L., Le, H., & Ilies, R. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.2.206 · Cited by 362
Validity of personnel decisions: A conceptual analysis of the inferential and evidential bases.
Binning, J. F., & Barrett, G. V. (1989) · Journal of Applied Psychology · doi:10.1037//0021-9010.74.3.478 · Cited by 344
Problems of Translation in Cross-Cultural Research
Sechrest, L., Fay, T. L., & Zaidi, S. M. H. (1972) · Journal of Cross-Cultural Psychology · doi:10.1177/002202217200300103 · Cited by 341
An Ounce of Prevention Is Worth a Pound of Cure: Improving Research Quality Before Data Collection
Aguinis, H., & Vandenberg, R. J. (2014) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-031413-091231 · Cited by 304
indicated, N. A. (1954) · Journal of Consulting Psychology · doi:10.1037/h0049530 · Cited by 260
Methodological approaches to shortening composite measurement scales
Coste, J., Guillemin, F., Pouchot, J., & Fermanian, J. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(96)00363-0 · Cited by 240
On the loss of reliability in ratings due to coarseness of the scale
Symonds, P. M. (1924) · Journal of Experimental Psychology · doi:10.1037/h0074469 · Cited by 194
A meta-analysis of the relationship between general mental ability and nontask performance.
Gonzalez-Mule, E. N., Mount, M. K., & Oh, I. (2014) · Journal of Applied Psychology · doi:10.1037/a0037547 · Cited by 172
Item context effects on personality scales: Measuring changes the measure.
Knowles, E. S. (1988) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.55.2.312 · Cited by 163
Detecting and Correcting the Lies That Data Tell
Schmidt, F. (2010) · Perspectives on Psychological Science · doi:10.1177/1745691610369339 · Cited by 163
Ryan, A. M., Chan, D. K., Ployhart, R. E., & SLADE, L. A. (1999) · Personnel Psychology · doi:10.1111/j.1744-6570.1999.tb01812.x · Cited by 142
Wang, M., & Russell, S. S. (2005) · Educational and Psychological Measurement · doi:10.1177/0013164404272494 · Cited by 111
Tanzer, N. K., & Sim, C. Q. E. (1999) · European Journal of Psychological Assessment · doi:10.1027//1015-5759.15.3.258 · Cited by 89
Kozlowski, S. W. J., Chen, G., & Salas, E. (2017) · Journal of Applied Psychology · doi:10.1037/apl0000192 · Cited by 88
Hartley, J. R., & Betts, L. R. (2009) · International Journal of Social Research Methodology · doi:10.1080/13645570802648077 · Cited by 79
Nicholls, M. E. R., Orr, C., Okubo, M., & Loftus, A. M. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01822.x · Cited by 75
Item Placement on a Personality Measure: Effects on Faking Behavior and Test Measurement Properties
McFarland, L. A., Ryan, A. M., & Ellis, A. P. J. (2002) · Journal of Personality Assessment · doi:10.1207/s15327752jpa7802_09 · Cited by 74
Absence of malice: A meta-analysis of nonresponse bias in counterproductive work behavior research.
Greco, L., O’Boyle, E. H., & Walter, S. L. (2014) · Journal of Applied Psychology · doi:10.1037/a0037495 · Cited by 73
Scaling Back Survey Scales: How Short is Too Short?
Moore, K. A., Halle, T., Vandivere, S., & Mariner, C. L. (2002) · Sociological Methods & Research · doi:10.1177/0049124102030004003 · Cited by 63
STATISTICS IN THE SOCIAL AND BEHAVIORAL SCIENCES
Molenaar, I. (1985) · Statistica Neerlandica · doi:10.1111/j.1467-9574.1985.tb01136.x · Cited by 59
Becker, S. L. (1954) · Public Opinion Quarterly · doi:10.1086/266516 · Cited by 46
Item Presentaton as an Influence on Questionnaire Validity: a Field Experiment
Schriesheim, C. A., & DeNisi, A. S. (1980) · Educational and Psychological Measurement · doi:10.1177/001316448004000130 · Cited by 31
The effect of ordinal position upon responses to items in a check list.
Campbell, D. T., & Mohr, P. J. (1950) · Journal of Applied Psychology · doi:10.1037/h0061818 · Cited by 30
Perspectives on the measurement of job attitudes: the long view
Smith, P. C., & Stanton, J. M. (1998) · Human Resource Management Review · doi:10.1016/s1053-4822(99)00005-4 · Cited by 24
Cited by
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024) · Asia Pacific Journal of Management · doi:10.1007/s10490-023-09871-y · Cited by 2,262
“Hence, it is critically important to evaluate and report the reliability, convergent and discriminant validity of multiple-indicator scales before examining relationships among constructs or testing hypotheses (Heggestad et al., 2019).”
Common method bias: It’ s bad, it’ s complex, it’ s widespread, and it’ s not easy to fix
Podsakoff, P. M., Podsakoff, N. P., Williams, L. J., Huang, C., & Yang, J. (2024) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-110721-040030 · Cited by 1,899
Social support at work: an integrative review
Jolly, P. M., Kong, D. T., & Kim, K. Y. (2021) · Journal of Organizational Behavior · doi:10.1002/job.2485 · Cited by 513
Matthews, R. A., Pineault, L., & Hong, Y.-H. (2022) · Journal of Business and Psychology · doi:10.1007/s10869-022-09813-3 · Cited by 462
Mackey, J. D., Parker Ellen, B., McAllister, C. P., & Alexander, K. C. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2020.10.037 · Cited by 320
Metadata
- Authors
- Heggestad, E. D., Scheaf, D. J., Banks, G. C., Monroe Hausfeld, M., Tonidandel, S., & Williams, E. B.
- Venue
- Journal of Management
- Publisher
- SAGE Publications
- Published
- 2019-05-09
- Volume
- 45
- Issue
- 6
- Pages
- 2596-2627
- ISSN
- 0149-2063 (ISSN-L)
- 1557-1211
- OpenAlex
- W2944221793
- Cited by
- 402
- References
- 56
- FWCI
- 24.15
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.