The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Theory-Testing, Generalization, and the Problem of External Validity
Abstract
External validity refers to the generalization of research findings, either from a sample to a larger population or to settings and populations other than those studied. While definitions vary, discussions generally agree that experiments are lower in external validity than other methodological approaches. Further, external validity is widely treated as an issue to be addressed through methodological procedures. When testing theories, all measures are indirect indicators of theoretical constructs, and no methodological procedures taken alone can produce external validity. External validity can be assessed through determining (1) the extent to which empirical measures accurately reflect theoretical constructs, (2) whether the research setting conforms to the scope of the theory under test, (3) our confidence that findings will repeat under identical conditions, (4) whether findings support the theory being tested, and (5) the confirmatory status of the theory under test. In these ways, external validity is foremost a theoretical issue and can only be addressed by an examination of the interplay between theory and methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1963) · Medical Entomology and Zoology · Cited by 15,085
The Practice of Social Research
Neustadtl, A., & Babbie, E. (1989) · Teaching Sociology · doi:10.2307/1318433 · Cited by 14,398
(1979) · Medical Entomology and Zoology · Cited by 11,252
Qualitative research: Methods in the social sciences: (668352010-001)
(2006) · PsycEXTRA Dataset · doi:10.1037/e668352010-001 · Cited by 10,605
(2013) · Academy of Management Review · doi:10.5465/amr · Cited by 6,716
Journal of social behavior and personality
(1986) · Personality and Individual Differences · doi:10.1016/0191-8869(86)90025-5 · Cited by 6,706
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
Reliability and Validity Assessment
Carmines, E., & Zeller, R. (1979) · doi:10.4135/9781412985642 · Cited by 5,884
Qualitative Research Methods for the Social Sciences
Hillebrand, J. D., & Berg, B. L. (2000) · Teaching Sociology · doi:10.2307/1319429 · Cited by 5,508
Reliability and Validity Assessment
(2011) · The Encyclopedia of Political Science · doi:10.4135/9781608712434.n1341 · Cited by 5,040
Objective Knowledge, an Evolutionary Approach.
Ruja, H., & Popper, K. R. (1973) · Philosophy and Phenomenological Research · doi:10.2307/2106696 · Cited by 3,770
Nagel, E., & Hawkins, D. (1961) · American Journal of Physics · doi:10.1119/1.1937571 · Cited by 3,667
(2001) · Cited by 1,866
Status Characteristics and Social Interaction
Berger, J., Cohen, B. P., & Zelditch, M. (1972) · American Sociological Review · doi:10.2307/2093465 · Cited by 1,742
(1969) · Elsevier eBooks · doi:10.1016/c2013-0-02211-6 · Cited by 1,670
Journal of transport economics and policy
(1969) · Transportation Research · doi:10.1016/0041-1647(69)90163-4 · Cited by 1,542
Generalizability theory: a primer
(1992) · Choice Reviews Online · doi:10.5860/choice.29-4192 · Cited by 1,298
Sociological Perspectives on Social Psychology.
Stryker, S., Cook, K. S., Fine, G. A., & House, J. S. (1995) · Contemporary Sociology · doi:10.2307/2076717 · Cited by 1,272
In defense of external invalidity.
Mook, D. G. (1983) · American Psychologist · doi:10.1037/0003-066x.38.4.379 · Cited by 1,212
Sellers, R. M., Rowley, S. J., Chavous, T. M., Shelton, J. N., & Bynum, M. S. (1997) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.73.4.805 · Cited by 1,172
Research methods in the social sciences
Mishra, S. (2005) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2005.00515_7.x · Cited by 1,137
Applied Social Research: Tool for the Human Services
Ballard, C., Monette, D. R., Sullivan, T. J., & DeJong, C. R. (1987) · Teaching Sociology · doi:10.2307/1318044 · Cited by 766
Generalizing From Laboratory to Field Settings.
Saxton, S. L., & Locke, E. A. (1987) · Contemporary Sociology · doi:10.2307/2069857 · Cited by 732
Symbolic interactionist view of self-concept: Through the looking glass darkly.
Shrauger, J. S., & Schoeneman, T. J. (1979) · Psychological Bulletin · doi:10.1037//0033-2909.86.3.549 · Cited by 717
External validity is more than skin deep: Some answers to criticisms of laboratory experiments.
Berkowitz, L., & Donnerstein, E. (1982) · American Psychologist · doi:10.1037//0003-066x.37.3.245 · Cited by 713
Stimulus Sampling and Social Psychological Experimentation
Wells, G. L., & Windschitl, P. D. (1999) · Personality and Social Psychology Bulletin · doi:10.1177/01461672992512005 · Cited by 684
The Concept of External Validity
Calder, B. J., Phillips, L. W., & Tybout, A. M. (1982) · Journal of Consumer Research · doi:10.1086/208920 · Cited by 613
The "Science of the Sophomore" Revisited: From Conjecture to Empiricism
Gordon, M. E., Slade, L. A., & Schmitt, N. (1986) · The Academy of Management Review · doi:10.2307/258340 · Cited by 574
Gooderham, P. N., Nordhaug, O., & Ringdal, K. (1999) · Administrative Science Quarterly · doi:10.2307/2666960 · Cited by 567
What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology.
Schmidt, F. L. (1992) · American Psychologist · doi:10.1037/0003-066x.47.10.1173 · Cited by 564 · cited 1×
“The major task in any science, including the social sciences, is the development of theory (Schmidt 1992).”
BackgroundSociological Theories in Progress.
Costner, H. L., Berger, J., Zelditch, M., & Anderson, B. (1967) · American Sociological Review · doi:10.2307/2091729 · Cited by 521
On the External Validity of Experiments in Consumer Research
Lynch, Jr. (1982) · Journal of Consumer Research · doi:10.1086/208919 · Cited by 469
Disorder and Decay: The Concept and Measurement of Perceived Neighborhood Disorder
Ross, C. E., & Mirowsky, J. (1999) · Urban Affairs Review · doi:10.1177/107808749903400304 · Cited by 424
A sociological reader on complex organizations
Etzioni, A. (1969) · Cited by 365
Hierarchy Theory: A Vision, Vocabulary, and Epistemology
Ahl, V., & Allen, T. F. H. (1996) · Medical Entomology and Zoology · Cited by 358
Experimentation in the 21st Century: The Importance of External Validity
Winer, R. S. (1999) · Journal of the Academy of Marketing Science · doi:10.1177/0092070399273005 · Cited by 338
Ferber, R. (1977) · Journal of Consumer Research · doi:10.1086/208679 · Cited by 301
Easley, R. W., Madden, C. S., & Dunn, M. G. (2000) · Journal of Business Research · doi:10.1016/s0148-2963(98)00079-4 · Cited by 275
Lynch, J. G. (1999) · Journal of the Academy of Marketing Science · doi:10.1177/0092070399273007 · Cited by 271
Dipboye, R. L., & Flanagan, M. F. (1979) · American Psychologist · doi:10.1037//0003-066x.34.2.141 · Cited by 259
Scope Statements: Imperatives for Evaluating Theory
Walker, H. A., & Cohen, B. P. (1985) · American Sociological Review · doi:10.2307/2095540 · Cited by 235
Developing Sociological Knowledge: Theory and Method
Clegg, L. E., & Cohen, B. P. (1990) · Teaching Sociology · doi:10.2307/1318244 · Cited by 229
Revisiting field experimentation: Field notes for the future.
Shadish, W. R. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.3 · Cited by 188
Gang Resistance Education and Training (Great): Results from the National Evaluation
ESBENSEN, F.-A., & OSGOOD, D. W. (1999) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427899036002004 · Cited by 187
External Validity and the Research Process: A Comment on the Calder/Lynch Dialogue
McGrath, J. E., & Brinberg, D. (1983) · Journal of Consumer Research · doi:10.1086/208951 · Cited by 182
Status Processes and Mental Ability Test Scores
Lovaglia, M. J., Lucas, J. W., Houser, J. A., Thye, S. R., & Markovsky, B. (1998) · American Journal of Sociology · doi:10.1086/210006 · Cited by 172
Self-citationDobbins, G. H., Lane, I. M., & Steiner, D. D. (1988) · Journal of Organizational Behavior · doi:10.1002/job.4030090308 · Cited by 152
Detection and Determinants of Bias in Subjective Measures
Bollen, K. A., & Paxton, P. M. (1998) · American Sociological Review · doi:10.2307/2657559 · Cited by 140
Statistical Significance: Rationale, Validity and Utility
Nayak, T. K., & Chow, S. L. (1998) · Technometrics · doi:10.2307/1270661 · Cited by 136
The Role of External Validity in Theoretical Research
Lynch, J. G. (1983) · Journal of Consumer Research · doi:10.1086/208949 · Cited by 126
Blalock, H. M. (1979) · American Sociological Review · doi:10.2307/2094714 · Cited by 125
Harding, G., Nettleton, S., & Taylor, K. D. (1990) · doi:10.1007/978-1-349-21149-4_10 · Cited by 117
Reviewer bias against replication research.
Neuliep, J. W., & Crandall, R. (1993) · Journal of social behavior and personality · Cited by 113
Experimentation in social psychology: A reappraisal
Gergen, K. J. (1978) · European Journal of Social Psychology · doi:10.1002/ejsp.2420080407 · Cited by 112
D’Aunno, T. A., Vaughn, T. E., & McElroy, P. (1999) · Journal of Health and Social Behavior · doi:10.2307/2676372 · Cited by 105
Guthrie, D., & Roth, L. M. (1999) · Social Forces · doi:10.1093/sf/78.2.511 · Cited by 104
Foschi, M. (1997) · Small Group Research · doi:10.1177/1046496497284004 · Cited by 76
Theory and the Experimental Investigation of Social Structures
Willer, D. (2021) · Routledge eBooks · doi:10.4324/9781315074801 · Cited by 69
Statistical Significance: Rationale, Validity and Utility
Frick, R. W., & Chow, S. L. (1998) · Journal of the American Statistical Association · doi:10.2307/2669649 · Cited by 60
Group Processes: Sociological Analyses.
Heise, D. R., Foschi, M., & Lawler, E. J. (1995) · Social Forces · doi:10.2307/2580562 · Cited by 51
Artificiality in Experimental Sociology*
Webster, M., & Kervin, J. B. (1971) · Canadian Review of Sociology/Revue canadienne de sociologie · doi:10.1111/j.1755-618x.1971.tb02366.x · Cited by 50
Reliability in Experimental Sociology
Thye, S. R. (2000) · Social Forces · doi:10.1093/sf/78.4.1277 · Cited by 49
The Role of the Experiment in the Social Sciences
Martin, M., & Sell, J. A. (1979) · Sociological Quarterly · doi:10.1111/j.1533-8525.1979.tb01237.x · Cited by 48
A Framework for Epistemological Analysis in Empirical (Laboratory and Field) Studies
Xiao, Y., & Vicente, K. J. (2000) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872000779656642 · Cited by 48
Allen, M. J., & Borkowski, G. L. (1999) · CRC Press eBooks · doi:10.1201/9780849377518-10 · Cited by 45
Generalization in Decision Research: The Role of Formal Models
Hogarth, R. M. (1986) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1986.4308976 · Cited by 40
Influencing Policy with Social Psychology
Pettigrew, T. F. (1988) · Journal of Social Issues · doi:10.1111/j.1540-4560.1988.tb02071.x · Cited by 40
Greenwood, J. D. (1982) · Journal for the Theory of Social Behaviour · doi:10.1111/j.1468-5914.1982.tb00449.x · Cited by 39
Theoretical methods in sociology : seven essays
Freese, L. (1980) · Cited by 38
Top, T. J. (1991) · Sex Roles · doi:10.1007/bf00288704 · Cited by 38
Implications of representativeness for generalizability of field and laboratory research findings.
Bass, A. R., & Firestone, I. J. (1980) · American Psychologist · doi:10.1037/0003-066x.35.5.463 · Cited by 35
Inductive Inference and Replications: A Bayesian Perspective
Raman, K. (1994) · Journal of Consumer Research · doi:10.1086/209375 · Cited by 18
Mail Surveys of Professional Populations: The Effects of Monetary Gratuities on Return Rates
Hopkins, K. D., Hopkins, B., & Schön, I. (1988) · The Journal of Experimental Education · doi:10.1080/00220973.1988.10806483 · Cited by 13
Family Violence as a Case of Interpersonal Aggression: A Situational Analysis
Wiggins, J. (1983) · Social Forces · doi:10.1093/sf/62.1.102 · Cited by 10
The Determinants of Marital Instability: Some Methodological Issues
Hanson, S. L., & Tuch, S. A. (1984) · Journal of Marriage and the Family · doi:10.2307/352604 · Cited by 5
Cited by
Sample Size for Survey Research: Review and Recommendations
Memon, M. A., Ting, H., Cheah, J.-H., Thurasamy, R., Chuah, F., & Cham, T. H. (2020) · Journal of Applied Structural Equation Modeling · doi:10.47263/jasem.4(2)01 · Cited by 1,343
Representative learning design and functionality of research and practice in sport
Pinder, R. A., Davids, K., Renshaw, I., & Araújo, D. (2011) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.33.1.146 · Cited by 692
A survey of controlled experiments in software engineering
Sjoeberg, D. I. K., Hannay, J. E., Hansen, O., Kampenes, V. B., Karahasanovic, A., Liborg, N.-K., & Rekdal, A. C. (2005) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2005.97 · Cited by 682
Groups Reward Individual Sacrifice: The Status Solution to the Collective Action Problem
Willer, R. (2009) · American Sociological Review · doi:10.1177/000312240907400102 · Cited by 670
Debray, T. P. A., Vergouwe, Y., Koffijberg, H., Nieboer, D., Steyerberg, E. W., & Moons, K. G. M. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.06.018 · Cited by 597
Metadata
- Authors
- Lucas, J. W.
- Venue
- Sociological Theory
- Publisher
- SAGE Publications
- Published
- 2003-09
- Volume
- 21
- Issue
- 3
- Pages
- 236-253
- ISSN
- 0735-2751 (ISSN-L)
- 1467-9558
- OpenAlex
- W2159064677
- Cited by
- 372
- References
- 75
- FWCI
- 14.13
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.