Theory-Testing, Generalization, and the Problem of External Validity
The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Abstract
External validity refers to the generalization of research findings, either from a sample to a larger population or to settings and populations other than those studied. While definitions vary, discussions generally agree that experiments are lower in external validity than other methodological approaches. Further, external validity is widely treated as an issue to be addressed through methodological procedures. When testing theories, all measures are indirect indicators of theoretical constructs, and no methodological procedures taken alone can produce external validity. External validity can be assessed through determining (1) the extent to which empirical measures accurately reflect theoretical constructs, (2) whether the research setting conforms to the scope of the theory under test, (3) our confidence that findings will repeat under identical conditions, (4) whether findings support the theory being tested, and (5) the confirmatory status of the theory under test. In these ways, external validity is foremost a theoretical issue and can only be addressed by an examination of the interplay between theory and methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1963) · Medical Entomology and Zoology · Cited by 15,085
The Practice of Social Research
Neustadtl, A., & Babbie, E. (1989) · Teaching Sociology · doi:10.2307/1318433 · Cited by 14,398
(1979) · Medical Entomology and Zoology · Cited by 11,252
Qualitative research: Methods in the social sciences: (668352010-001)
(2006) · PsycEXTRA Dataset · doi:10.1037/e668352010-001 · Cited by 10,605
(2013) · Academy of Management Review · doi:10.5465/amr · Cited by 6,716
Journal of social behavior and personality
(1986) · Personality and Individual Differences · doi:10.1016/0191-8869(86)90025-5 · Cited by 6,706
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
Reliability and Validity Assessment
Carmines, E., & Zeller, R. (1979) · doi:10.4135/9781412985642 · Cited by 5,884
Qualitative Research Methods for the Social Sciences
Hillebrand, J. D., & Berg, B. L. (2000) · Teaching Sociology · doi:10.2307/1319429 · Cited by 5,508
Reliability and Validity Assessment
(2011) · The Encyclopedia of Political Science · doi:10.4135/9781608712434.n1341 · Cited by 5,040
Cited by
Sample Size for Survey Research: Review and Recommendations
Memon, M. A., Ting, H., Cheah, J.-H., Thurasamy, R., Chuah, F., & Cham, T. H. (2020) · Journal of Applied Structural Equation Modeling · doi:10.47263/jasem.4(2)01 · Cited by 1,343
Representative learning design and functionality of research and practice in sport
Pinder, R. A., Davids, K., Renshaw, I., & Araújo, D. (2011) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.33.1.146 · Cited by 692
A survey of controlled experiments in software engineering
Sjoeberg, D. I. K., Hannay, J. E., Hansen, O., Kampenes, V. B., Karahasanovic, A., Liborg, N.-K., & Rekdal, A. C. (2005) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2005.97 · Cited by 682
Groups Reward Individual Sacrifice: The Status Solution to the Collective Action Problem
Willer, R. (2009) · American Sociological Review · doi:10.1177/000312240907400102 · Cited by 670
Debray, T. P. A., Vergouwe, Y., Koffijberg, H., Nieboer, D., Steyerberg, E. W., & Moons, K. G. M. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.06.018 · Cited by 597
Convenience samples of college students and research reproducibility
Peterson, R. A., & Merunka, D. R. (2014) · Journal of Business Research · doi:10.1016/j.jbusres.2013.08.010 · Cited by 567
Generalizing from Survey Experiments Conducted on Mechanical Turk: A Replication Approach
Coppock, A. (2019) · Political Science Research and Methods · doi:10.1017/psrm.2018.10 · Cited by 515
The Future of Empirical Methods in Software Engineering Research
Sjoberg, D. I. K., Dyba, T., & Jorgensen, M. (2007) · Future of Software Engineering (FOSE '07) · doi:10.1109/fose.2007.30 · Cited by 389
Overdoing Gender: A Test of the Masculine Overcompensation Thesis
Willer, R., Rogalin, C. L., Conlon, B., & Wojnowicz, M. T. (2013) · American Journal of Sociology · doi:10.1086/668417 · Cited by 366
Changes in US Parents’ Domestic Labor During the Early Days of the COVID‐19 Pandemic
Carlson, D. L., Petts, R. J., & Pepin, J. R. (2022) · Sociological Inquiry · doi:10.1111/soin.12459 · Cited by 320
Podsakoff, P. M., & Podsakoff, N. P. (2019) · The Leadership Quarterly · doi:10.1016/j.leaqua.2018.11.002 · Cited by 312
The use of sampling methods in advertising research: a gap between theory and practice
Sarstedt, M., Bengart, P., Shaltoni, A. M., & Lehmann, S. (2018) · International Journal of Advertising · doi:10.1080/02650487.2017.1348329 · Cited by 292
Karataş, F., Abedi, F. Y., Ozek Gunyel, F., Karadeniz, D., & Kuzgun, Y. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12574-6 · Cited by 252
Case Studies Nested in Fuzzy-set QCA on Sufficiency: Formalizing Case Selection and Causal Inference
Schneider, C. Q., & Rohlfing, I. (2016) · Sociological Methods & Research · doi:10.1177/0049124114532446 · Cited by 147
Levinson, C. A., Christian, C., Ram, S. S., Vanzhula, I., Brosof, L. C., Michelson, L. P., & Williams, B. M. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.07.075 · Cited by 79
González-Azcárate, M., Cruz Maceín, J. L., & Bardají, I. (2021) · Sustainable Production and Consumption · doi:10.1016/j.spc.2021.01.003 · Cited by 77
The Past, Present, and Future of Experimental Methods in the Social Sciences
Mize, T. D., & Manago, B. (2022) · Social Science Research · doi:10.1016/j.ssresearch.2022.102799 · Cited by 76
Shiu, J. Y., Liao, S. T., & Tzeng, S.-Y. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-01731-w · Cited by 48
Hill, T. D., Burdette, A. M., Taylor, J., & Angel, J. L. (2016) · Journal of Health and Social Behavior · doi:10.1177/0022146515627850 · Cited by 31
Certifications in short food supply chains in the region of Madrid. Part of the alternative?
González-Azcárate, M., Cruz-Maceín, J. L., & Bardají, I. (2022) · Ecological Economics · doi:10.1016/j.ecolecon.2022.107387 · Cited by 27
Metadata
- Authors
- Lucas, J. W.
- Venue
- Sociological Theory
- Publisher
- SAGE Publications
- Published
- 2003-09
- Volume
- 21
- Issue
- 3
- Pages
- 236-253
- ISSN
- 0735-2751 (ISSN-L)
- 1467-9558
- OpenAlex
- W2159064677
- Cited by
- 372
- References
- 75
- FWCI
- 14.13
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.