The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Bayesian Model Selection in Social Research
Abstract
It is argued that P-values and the tests based upon them give unsatisfactory results, especially in large samples. It is shown that, in regression, when there are many candidate independent variables, standard variable selection procedures can give very misleading results. Also, by selecting a single model, they ignore model uncertainty and so underestimate the uncertainty about quantities of interest. The Bayesian approach to hypothesis testing, model selection, and accounting for model uncertainty is presented. Implementing this is straightforward through the use of the simple and accurate BIC approximation, and it can be done using the output from standard software. Specific results are presented for most of the types of model commonly used in sociology. It is shown that this approach overcomes the difficulties with P-values and standard model selection procedures based on them. It also allows easy comparison of nonnested models, and permits the quantification of the evidence for a null hypothesis of interest, such as a convergence theory or a hypothesis about societal norms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The Laplace method (Tierney and Kadane, 1986) can provide an excellent approximation to pr lparenOSCASB D vertSHT Mk rparenOSCASB ; in certain circumstances this yields the very simple BIC approximation (Schwarz, 1978; Kass and Wasserman 1995; Raftery, 1995).”
From Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors (1999) · cites this paper as Raftery, 1995
In the citing paper
“Under regularity conditions, this yields the simple BIC approximation given by equation (13) in our paper (Kass and Wasserman, 1995; Raftery, 1995).”
From Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors (1999) · cites this paper as Raftery, 1995
In the citing paper
“The limitations of NHST methods are well documented and need not be rehashed here in their entirety”
From Reevaluating the effectiveness of n-back training on transfer through the Bayesian lens: Support for the null (2016) · cites this paper as Raftery (1995)
In the citing paper
“An advantage of the Bayesian approach is that it provides an opportunity to analytically determine whether the null hypothesis is more likely than the alternative(s) given the observed data (e.g., Raftery, 1995; Gallistel, 2009).”
From Cognitive Mapping Without Vision: Comparing Wayfinding Performance After Learning From Digital Touchscreen-Based Multimodal Maps vs. Embossed Tactile Overlays (2020) · cites this paper as Raftery, 1995
In the citing paper
“A change in 10 points or more suggests a significantly improved fit (Raftery, 1995).”
From Children overcoming picky eating (COPE) - A cluster randomised controlled trial. (2020) · cites this paper as Raftery, 1995
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
Structural Equations with Latent Variables.
Clogg, C. C., & Bollen, K. A. (1991) · Contemporary Sociology · doi:10.2307/2072165 · Cited by 17,442
Crime and Punishment: An Economic Approach
Becker, G. S. (1968) · Journal of Political Economy · doi:10.1086/259394 · Cited by 13,999
Beckman, R. J. (1987) · Technometrics · doi:10.1080/00401706.1987.10488195 · Cited by 2,835
Participation in Illegitimate Activities: A Theoretical and Empirical Investigation
Ehrlich, I. (1973) · Journal of Political Economy · doi:10.1086/260058 · Cited by 2,492
The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies
Ragin, C. C. (2014) · doi:10.1525/9780520957350 · Cited by 2,130
Accurate Approximations for Posterior Moments and Marginal Densities
Tierney, L., & Kadane, J. B. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478240 · Cited by 2,129
Discrete Multivariate Analysis
(1977) · Technometrics · doi:10.1080/00401706.1977.10489605 · Cited by 1,757
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
Assessment and Propagation of Model Uncertainty
Draper, D. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02015.x · Cited by 1,599
ON THE PROBLEM OF THE MOST EFFICIENT TESTS OF STATISTICAL HYPOTHESES
(1967) · Joint Statistical Papers · doi:10.1525/9780520339897-008 · Cited by 1,504
Subset Selection in Regression
(2003) · Technometrics · doi:10.1198/tech.2003.s144 · Cited by 1,463
Hassard, T. H., & Weisberg, S. (1981) · The Statistician · doi:10.2307/2987575 · Cited by 1,216
Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window
Madigan, D., & Raftery, A. E. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476894 · Cited by 1,205
Self-citationThe Optimum Enforcement of Laws
Stigler, G. J. (1970) · Journal of Political Economy · doi:10.1086/259646 · Cited by 1,147
Bayesian Statistics: An Introduction
Ziegel, E. R., & Lee, P. M. (1998) · Technometrics · doi:10.2307/1270551 · Cited by 1,115
Specification Searches: Ad Hoc Inference with Non-Experimental Data.
Richard, J.-F., & Leamer, E. E. (1981) · Economica · doi:10.2307/2553491 · Cited by 1,114
Further Results on Tests of Separate Families of Hypotheses
Cox, D. R. (1962) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1962.tb00468.x · Cited by 1,026
Tests of Separate Families of Hypotheses
Cox, D. (1961) · Project Euclid (Cornell University) · Cited by 885
Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence
Berger, J. O., & Sellke, T. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478397 · Cited by 775
Berger, J. O., & Delampady, M. (1987) · Statistical Science · doi:10.1214/ss/1177013238 · Cited by 664
More Universalism, Less Structural Mobility: The American Occupational Structure in the 1980s
Hout, M. (1988) · American Journal of Sociology · doi:10.1086/228904 · Cited by 643
Approximate Bayes factors and accounting for model uncertainty in generalised linear models
Raftery, A. (1996) · Biometrika · doi:10.1093/biomet/83.2.251 · Cited by 633
Self-citationSocial Mobility in Industrial Society
Lipset, S. M., & Bendix, R. (2018) · Routledge eBooks · doi:10.4324/9781351306362 · Cited by 616
Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence
Berger, J. O., & Sellke, T. (1987) · Journal of the American Statistical Association · doi:10.2307/2289131 · Cited by 548
The Significance Test Controversy.
Carter, L. F., Morrison, D. E., & Henkel, R. E. (1971) · Social Forces · doi:10.2307/2576949 · Cited by 437
Choosing Models for Cross-Classifications
Raftery, A. E. (1986) · American Sociological Review · doi:10.2307/2095483 · Cited by 428
Self-citationSome Tests of Significance, Treated by the Theory of Probability
Jeffreys, H. (1935) · Mathematical Proceedings of the Cambridge Philosophical Society · doi:10.1017/s030500410001330x · Cited by 418
A Note on Screening Regression Equations
Freedman, D. A. (1983) · The American Statistician · doi:10.1080/00031305.1983.10482729 · Cited by 395
Bayesian Model Selection in Structural Equation Models
Raftery, A. E. (1992) · Cited by 364
Self-citationBayesian Statistics: Principles, Models, and Applications.
Fearn, T., & Press, S. J. (1990) · Biometrics · doi:10.2307/2531460 · Cited by 350
Identification and Estimation of Age-Period-Cohort Models in the Analysis of Discrete Archival Data
Fienberg, S. E., & Mason, W. M. (1979) · Sociological Methodology · doi:10.2307/270764 · Cited by 314
Status, Autonomy, and Training in Occupational Mobility
Hout, M. (1984) · American Journal of Sociology · doi:10.1086/228020 · Cited by 290
Comparative Social Mobility Revisited: Models of Convergence and Divergence in 16 Countries
Grusky, D. B., & Hauser, R. M. (1984) · American Sociological Review · doi:10.2307/2095555 · Cited by 259
Ownership and Authority in the Earnings Function: Nonnested Tests of Alternative Specifications
Halaby, C. N., & Weakliem, D. L. (1993) · American Sociological Review · doi:10.2307/2096214 · Cited by 116
Demand or Ideation? Evidence from the Iranian Marital Fertility Decline
Raftery, A. E., Lewis, S. M., & Aghajanian, A. (1995) · Demography · doi:10.2307/2061738 · Cited by 81
Self-citationHazelrigg, L. E., & Garnier, M. A. (1976) · American Sociological Review · doi:10.2307/2094256 · Cited by 77
Recent Econometric Modeling of Crime and Punishment
Brier, S. S., & Fienberg, S. E. (1980) · Evaluation Review · doi:10.1177/0193841x8000400201 · Cited by 64
On the Impact of Variable Selection in Fitting Regression Equations
Freedman, D. A., Navidi, W., & Peters, S. C. (1988) · Lecture Notes in Economics and Mathematical Systems · doi:10.1007/978-3-642-61564-1_1 · Cited by 51
Log-Multiplicative Models for Discrete-Time, Discrete-Covariate Event-History Data
Xie, Y. (1994) · Sociological Methodology · doi:10.2307/270986 · Cited by 40
Event history modeling of world fertility survey data∗
Raftery, A. E., Lewis, S. M., Aghajanian, A., et al. (1996) · Mathematical Population Studies · doi:10.1080/08898489609525426 · Cited by 32
Self-citationThe Power Function of Conditional Log-Linear Model Tests
Fenech, A. P., & Westfall, P. H. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478587 · Cited by 16
INTERPRETING STATISTICAL INSIGNIFICANCE: A BAYESIAN PERSPECTIVE
Johnstone, D. J. (1990) · Psychological Reports · doi:10.2466/pr0.1990.66.1.115 · Cited by 7
Cited by
Multimodel Inference: Understanding AIC and BIC in Model Selection
Burnham, K. P., & Anderson, D. R. (2004) · Sociological Methods & Research · doi:10.1177/0049124104268644 · Cited by 11,648
“=1 (Raftery 1995).”
BackgroundApplied Longitudinal Data Analysis: Modeling Change and Event Occurrence
Singer, J. D., & Willett, J. B. (2003) · doi:10.1093/acprof:oso/9780195152968.001.0001 · Cited by 10,647
Model-Based Clustering, Discriminant Analysis, and Density Estimation
Fraley, C., & Raftery, A. E. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502760047131 · Cited by 4,257
Self-citationHoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118
Self-citationBayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
Metadata
- Authors
- Raftery, A. E.
- Affiliations
- University of Washington (US)
- Corresponding author
- Raftery, Adrian E.
- ORCID
- Raftery, Adrian E.
- Venue
- Sociological Methodology
- Publisher
- JSTOR
- Published
- 1995
- Volume
- 25
- Pages
- 111
- ISSN
- 0081-1750 (ISSN-L)
- OpenAlex
- W2089763487
- Cited by
- 6,823
- References
- 44
- Citations by year
- 2026: 219 · 2025: 305 · 2024: 321 · 2023: 344 · 2022: 383 · 2021: 423 · 2020: 433 · 2019: 447 · 2018: 430 · 2017: 351 · 2016: 372 · 2015: 363 · 2014: 307 · 2013: 305 · 2012: 251
- FWCI
- 27.28
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Sociological Methodology (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- Bayesian model selection, model uncertainty, p-values, feature selection, Bayesian information criterion, non-nested models, hypothesis testing, convergence theory, social norms, large-sample inference, regression analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.