The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Model Uncertainty in Sociological Research: An Application to Religion and Economic Growth
Abstract
Model uncertainty is pervasive in quantitative research. Classical statistical theory assumes that only one (true) model is applied to a sample of data. In practice, however, researchers do not know which exact model specification is best. Modern computing power allows researchers to estimate a huge number of plausible models, yet only a few of these estimates are published. The result is a severe asymmetry of information between analyst and reader. The applied modeling process produces a much wider range of estimates than is suggested by the usual standard errors or confidence intervals. I demonstrate this using the work of Barro and McCleary on religion and economic growth. Small, sensible changes in their model specification produce large changes in the results: the results are inconsistent across time, and the instrumental variables strategy suffers from a weak instrument set. Also, the observed relationship between religiosity and economic growth does not hold in the West; it is largely a feature of Asian and African countries and of countries whose data is poor quality. In short, empirical findings should be evaluated not just by their significance but also by their robustness to model specification. I conclude with suggestions for incorporating model uncertainty into practice and improving the transparency of social science research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Testing for Weak Instruments in Linear IV Regression
Stock, J. H., & Yogo, M. (2005) · Identification and Inference for Econometric Models · doi:10.1017/cbo9780511614491.006 · Cited by 7,211
Instrumental Variables Regression with Weak Instruments
Staiger, D., & Stock, J. H. (1997) · Econometrica · doi:10.2307/2171753 · Cited by 7,081
Instrumental Variables Regression with Weak Instruments
Staiger, D., & Stock, J. (1994) · doi:10.3386/t0151 · Cited by 5,302
Hoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118 · cited 1×
“The general philosophy of the Bayesian approach is that reporting a single “best” estimate makes little sense (because one is never completely sure which model is “best”) (Hoeting et al. 1999; Western 1996).”
BackgroundHunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023
Model uncertainty, data mining and statistical inference
Chatfield, C. (1995) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983440 · Cited by 1,103
The Intergenerational Transmission of Spouse Abuse: A Meta‐Analysis
Stith, S. M., Rosen, K. H., Middleton, K. A., Busch, A. L., Lundeberg, K., & Carlton, R. P. (2000) · Journal of Marriage and Family · doi:10.1111/j.1741-3737.2000.00640.x · Cited by 691 · cited 1×
“The meta-analytic studies available, however, consistently comment on the high degree of excess variation—variance across studies that is not well explained by sampling error (Hsieh and Pugh 1993; Pinello 1999; Stith et al. 2000).”
BackgroundThe poor availability of psychological research data for reanalysis.
Wicherts, J. M., Borsboom, D., Kats, J., & Molenaar, D. (2006) · American Psychologist · doi:10.1037/0003-066x.61.7.726 · Cited by 543
Publication Selection Bias in Minimum‐Wage Research? A Meta‐Regression Analysis
Doucouliagos, H., & Stanley, T. D. (2009) · British Journal of Industrial Relations · doi:10.1111/j.1467-8543.2009.00723.x · Cited by 507
Vague Theory and Model Uncertainty in Macrosociology
Western, B. (1996) · Sociological Methodology · doi:10.2307/271022 · Cited by 133
Cited by
Does Religion Affect Economic Growth and Happiness? Evidence from Ramadan *
Campante, F., & Yanagizawa-Drott, D. (2015) · The Quarterly Journal of Economics · doi:10.1093/qje/qjv002 · Cited by 334
Freese, J., & Peterson, D. (2017) · Annual Review of Sociology · doi:10.1146/annurev-soc-060116-053450 · Cited by 310
Machine Learning for Sociology
Molina, M., & Garip, F. (2019) · Annual Review of Sociology · doi:10.1146/annurev-soc-073117-041106 · Cited by 295
Swedberg, R. (2020) · The Production of Knowledge · doi:10.1017/9781108762519.002 · Cited by 293
Common Sense and Sociological Explanations
Watts, D. J. (2014) · American Journal of Sociology · doi:10.1086/678271 · Cited by 176
Metadata
- Authors
- Young, C.
- Venue
- American Sociological Review
- Publisher
- SAGE Publications
- Published
- 2009-06
- Volume
- 74
- Issue
- 3
- Pages
- 380-397
- ISSN
- 0003-1224 (ISSN-L)
- 1939-8271
- OpenAlex
- W2028143485
- Cited by
- 168
- References
- 10
- FWCI
- 36.87
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Model Uncertainty in Sociological Research: An Application to Religion and Economic Growth. https://app.cochat.ai/papers/10.1177/000312240907400303
- The paper
- Young, C. (2009). Model Uncertainty in Sociological Research: An Application to Religion and Economic Growth. American Sociological Review. https://doi.org/10.1177/000312240907400303
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.