The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
A Review and Analysis of the Policy-Capturing Methodology in Organizational Research: Guidelines for Research and Practice
Abstract
Policy-capturing has been employed extensively in the past to examine how organizational decision makers use the information available to them when making evaluative judgments. The purpose of this article is to provide researchers with guidelines for enhancing the reliability and validity of their studies. More specifically, the authors identify issues researchers may want to consider when designing such studies and offer suggestions for effectively addressing them. They draw on a review of 37 articles from 5 major journals to identify “best practice” and discuss the advantages and disadvantages of alternative approaches to resolving the various issues. The key issues are (a) the realism of the approach and its effect on both internal and external validity, (b) the limits of the full factorial design, (c) the need for orthogonal cues, (d) sample size and statistical power, and (e) the assessment of reliability. The analysis also includes comparisons with conjoint analysis, a similar methodology used in the marketing research literature.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Reliability and Validity Assessment
Carmines, E., & Zeller, R. (1979) · doi:10.4135/9781412985642 · Cited by 5,884
Conjoint Analysis in Consumer Research: Issues and Outlook
Green, P. E., & Srinivasan, V. (1978) · Journal of Consumer Research · doi:10.1086/208721 · Cited by 3,179
Conjoint Analysis in Marketing: New Developments with Implications for Research and Practice
Green, P. E., & Srinivasan, V. (1990) · Journal of Marketing · doi:10.1177/002224299005400402 · Cited by 2,687
Multiple regression in psychological research and practice.
Darlington, R. B. (1968) · Psychological Bulletin · doi:10.1037/h0025471 · Cited by 1,132
Effects of work values on job choice decisions.
Judge, T. A., & Bretz, R. D. (1992) · Journal of Applied Psychology · doi:10.1037//0021-9010.77.3.261 · Cited by 895
Judgment analysis : theory, methods, and applications
Cooksey, R. (1996) · Academic Press eBooks · Cited by 696
PAY PREFERENCES AND JOB SEARCH DECISIONS: A PERSON‐ORGANIZATION FIT PERSPECTIVE
CABLE, D. M., & JUDGE, T. A. (1994) · Personnel Psychology · doi:10.1111/j.1744-6570.1994.tb01727.x · Cited by 683
DETERMINANTS OF ACQUISITION INTEGRATION LEVEL: A DECISION-MAKING PERSPECTIVE.
PABLO, A. L. (1994) · Academy of Management Journal · doi:10.2307/256601 · Cited by 543
Social Desirability Response Bias in Self-Report Choice Situations
Arnold, H. J., & Feldman, D. C. (1981) · Academy of Management Journal · doi:10.5465/255848 · Cited by 479
WEBSTER, J., & TREVINO, L. K. (1995) · Academy of Management Journal · doi:10.2307/256843 · Cited by 461
On the Design of Choice Experiments Involving Multifactor Alternatives
Green, P. E. (1974) · Journal of Consumer Research · doi:10.1086/208592 · Cited by 423
Aiman-Smith, L., Scullen, S. E., & Barr, S. H. (2002) · Organizational Research Methods · doi:10.1177/109442802237117 · Cited by 289
The role of human resource systems in job applicant decision processes
Bretz, R. (1994) · Journal of Management · doi:10.1016/0149-2063(94)90001-9 · Cited by 276
Dunn, W. S., Mount, M. K., Barrick, M. R., & Ones, D. S. (1995) · Journal of Applied Psychology · doi:10.1037//0021-9010.80.4.500 · Cited by 236
Managerial selection decision models: Examination of configural cue processing.
Hitt, M. A., & Barr, S. H. (1989) · Journal of Applied Psychology · doi:10.1037//0021-9010.74.1.53 · Cited by 211
Cooper, W. H., & Richardson, A. J. (1986) · Journal of Applied Psychology · doi:10.1037//0021-9010.71.2.179 · Cited by 202
An information processing model and approach to the study of motivation
Zedeck, S. (1977) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(77)90018-6 · Cited by 178
Rynes, S. L., & Lawler, J. (1983) · Journal of Applied Psychology · doi:10.1037/0021-9010.68.4.620 · Cited by 169
Capturing rater policies for processing evaluation data
Zedeck, S., & Kafry, D. (1977) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(77)90031-9 · Cited by 146
The role of pay and market pay variability in job application decisions
Rynes, S. L., Schwab, D. P., & Heneman, H. G. (1983) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(83)90130-7 · Cited by 144
Performance appraisal decisions as a function of rater training and purpose of the appraisal.
Zedeck, S., & Cascio, W. F. (1982) · Journal of Applied Psychology · doi:10.1037//0021-9010.67.6.752 · Cited by 140
Rynes, S. L., & Lawler, J. (1983) · Journal of Applied Psychology · doi:10.1037//0021-9010.68.4.620 · Cited by 128
Position choice: Comparing the importance of organizational and job factors.
Feldman, D. C., & Arnold, H. J. (1978) · Journal of Applied Psychology · doi:10.1037/0021-9010.63.6.706 · Cited by 123
The role of prescribed and nonprescribed behaviors in estimating the dollar value of performance.
Orr, J. M., Sackett, P. R., & Mercer, M. W. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.1.34 · Cited by 122
Goal importance, self-focus, and the goal-setting process.
Hollenbeck, J. R., & Williams, C. R. (1987) · Journal of Applied Psychology · doi:10.1037/0021-9010.72.2.204 · Cited by 118
CHINESE AND AMERICAN MANAGERS' COMPENSATION AWARD DECISIONS: A COMPARATIVE POLICY‐CAPTURING STUDY
Zhou, J., & Martocchio, J. J. (2001) · Personnel Psychology · doi:10.1111/j.1744-6570.2001.tb00088.x · Cited by 118
DEFINING SEXUAL HARASSMENT IN WORKPLACES: A POLICY-CAPTURING APPROACH.
York, K. M. (1989) · Academy of Management Journal · doi:10.5465/256570 · Cited by 110
Capturing Rater Policies in Evaluating Candidates for Promotion
Stumpf, S. A., & London, M. (1981) · Academy of Management Journal · doi:10.2307/256174 · Cited by 109
Comparing Derived Importance Weights Across Attributes
Wittink, D. R., Krishnamurthi, L., & Nutter, J. B. (1982) · Journal of Consumer Research · doi:10.1086/208890 · Cited by 105
Policy capturing in the employment interview.
Dougherty, T. W., Ebert, R. J., & Callender, J. C. (1986) · Journal of Applied Psychology · doi:10.1037//0021-9010.71.1.9 · Cited by 99
COCHEAN, W. G., & Cox, G. M. (1957) · Soil Science · doi:10.1097/00010694-195711000-00018 · Cited by 94
INTERVIEWER DECISION PROCESSES AND EFFECTIVENESS: AN EXPERIMENTAL POLICY‐CAPTURING INVESTIGATION
Graves, L. M., & Karren, R. J. (1992) · Personnel Psychology · doi:10.1111/j.1744-6570.1992.tb00852.x · Cited by 88
Self-citationConsideration of the Incomplete Block Design for Policy-Capturing Research
Graham, M., & Cable, D. M. (2001) · Organizational Research Methods · doi:10.1177/109442810141002 · Cited by 86
MANAGERIAL SALARY‐RAISE DECISIONS: A POLICY‐ CAPTURING APPROACH
Sherer, P. D., Schwab, D. P., & Heneman, H. G. (1987) · Personnel Psychology · doi:10.1111/j.1744-6570.1987.tb02375.x · Cited by 79
MANAGERIAL DECISION MAKING ABOUT EMPLOYEE DISCIPLINE: A POLICY‐CAPTURING APPROACH
Klaas, B. S., & Wheeler, H. N. (1990) · Personnel Psychology · doi:10.1111/j.1744-6570.1990.tb02009.x · Cited by 74
Modeling Strategic Acquisition Policies: A Simulation of Executives' Acquisition Decisions
Stahl, M. J., & Zimmerer, T. W. (1984) · Academy of Management Journal · doi:10.2307/255930 · Cited by 67
Determining important tasks within jobs: A policy-capturing approach.
Sánchez, J. I., & Levine, E. L. (1989) · Journal of Applied Psychology · doi:10.1037//0021-9010.74.2.336 · Cited by 66
Martocchio, J. J., & Judge, T. A. (1995) · Journal of Management · doi:10.1177/014920639502100205 · Cited by 49
On the Creation of Acceptable Conjoint Analysis Experimental Designs
Steckel, J. H., DeSarbo, W. S., & Mahajan, V. (1991) · Decision Sciences · doi:10.1111/j.1540-5915.1991.tb00357.x · Cited by 44
“EXTRACTING” POLICY FROM JUDICIAL OPINIONS: THE DANGERS OF POLICY CAPTURING IN A FIELD SETTING
Roehling, M. V. (1993) · Personnel Psychology · doi:10.1111/j.1744-6570.1993.tb00881.x · Cited by 40
Dispositional Influences on Attributions Concerning Absenteeism
Judge, T. A., & Martocchio, J. J. (1996) · Journal of Management · doi:10.1016/s0149-2063(96)90039-2 · Cited by 29
Research Design, Measurement, Andeffects of Attribute Range on Job Choice:More Than Meets the Eye
Highhouse, S., Luong, A., & Sarkar-Barney, S. (1999) · Organizational Research Methods · doi:10.1177/109442819921003 · Cited by 15
USING POLICY‐CAPTURING TO MEASURE ATTITUDES IN ORGANIZATIONAL DIAGNOSIS
Madden, J. M. (1981) · Personnel Psychology · doi:10.1111/j.1744-6570.1981.tb00947.x · Cited by 12
Cited by
Aguinis, H., & Bradley, K. J. (2014) · Organizational Research Methods · doi:10.1177/1094428114547952 · Cited by 2,021
Short, J. C., Broberg, J. C., Cogliser, C. C., & Brigham, K. H. (2010) · Organizational Research Methods · doi:10.1177/1094428109335949 · Cited by 644
Unpacking the uncertainty construct: Implications for entrepreneurial action
McKelvie, A., Haynie, J. M., & Gustavsson, V. (2011) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2009.10.004 · Cited by 475
The Essence of Dynamic Capabilities and their Measurement
Laaksonen, O., & Peltoniemi, M. (2018) · International Journal of Management Reviews · doi:10.1111/ijmr.12122 · Cited by 374
Wright, B. E., & Grant, A. M. (2010) · Public Administration Review · doi:10.1111/j.1540-6210.2010.02197.x · Cited by 338
Metadata
- Authors
- Karren, R. J., & Barringer, M. W.
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2002-10
- Volume
- 5
- Issue
- 4
- Pages
- 337-361
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2028769137
- Cited by
- 274
- References
- 45
- FWCI
- 4.79
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.