Empirical Bayes MCMC estimation for modeling treatment processes, mechanisms of change, and clinical outcomes in small samples
Open accessThe DOI matches its Crossref record; 64 of the 66 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: The current analysis demonstrates the use of empirical Bayes (EB) estimation methods with data-derived prior parameters for studying clinically intricate process-mechanism-outcome linkages using structural equation modeling (SEM) with small samples. METHOD: The data were obtained from a small subsample of 23 families receiving Functional Family Therapy (FFT) for adolescent substance abuse during a completed randomized clinical trial. Two or 3 video-recorded FFT sessions were randomly selected for each family. The middle 20-min portion of each session was observed and coded. An SEM examining the influence of a select set of observed therapist behaviors on pre- to posttreatment change in mother reports of family functioning and, in turn, pre- to posttreatment change in adolescent reports of adolescent marijuana use and delinquent behavior was specified. The SEM was implemented using EB estimation with data-derived maximum likelihood (ML) prior parameters and Markov Chain Monte Carlo (MCMC) estimation of the joint posterior distribution. RESULTS: The EB SEM results indicated that a relatively high proportion of individually focused general interventions (i.e., seek information, acknowledge) as well as relationally focused meaning change interventions by therapists during sessions of FFT were predictive of pre- to posttreatment increases in levels of family functioning as reported by mothers in families of substance-abusing adolescents. In turn, increases in mother-reported family functioning were predictive of reductions in levels of adolescent-reported delinquent behavior. CONCLUSIONS: EB MCMC methods produced more stable results than did ML, especially regarding the variances on the change factors in the SEM. EB MCMC estimation is a viable alternative to ML estimation of SEMs in clinical research with prohibitively small samples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“we used the Bayesian estimation, which is advantageous to small sample sizes and that has point estimates and credible intervals (CIs) as the principal parameter estimates 33 .”
From Relationships between worry and depressive symptoms during two group therapies for generalized anxiety disorder (2022) · cites this paper as [33]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · cited 1×
“The level of agreement on the collapsed FFT CARS intervention codes was within the “substantial” range, whereas agreement on the FFT CARS frame-of-reference codes was within the “moderate” range as specified by Landis and Koch (1977).”
Structural equation modeling in practice: A review and recommended two-step approach
Anderson, J. C., & Gerbing, D. W. (1988) · Psychological Bulletin · doi:10.1037/0033-2909.103.3.411 · Cited by 41,941
Structural Equations with Latent Variables.
Clogg, C. C., & Bollen, K. A. (1991) · Contemporary Sociology · doi:10.2307/2072165 · Cited by 17,442
Inference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Sobell, L. C., & Sobell, M. B. (1992) · Measuring Alcohol Consumption · doi:10.1007/978-1-4612-0357-5_3 · Cited by 4,110
(1991) · Cited by 3,844
Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size.
Marsh, H. W., Balla, J. R., & McDonald, R. P. (1988) · Psychological Bulletin · doi:10.1037//0033-2909.103.3.391 · Cited by 3,824
Observing Interaction: An Introduction to Sequential Analysis
Willson, V. L., Bakeman, R., & Gottman, J. M. (1988) · Journal of Educational Statistics · doi:10.2307/1164658 · Cited by 2,301
Latent Variable Modeling of Differences and Changes with Longitudinal Data
McArdle, J. J. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163612 · Cited by 1,952 · cited 1×
“Figure 2 contains a latent change score model (LCSM) that estimates change in family functioning between the pretreatment and 4-month assessments (see McArdle, 2009, pp. 587–589).”
Bayesian Data Analysis, 2nd edn
Brix, A. (2005) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2004.00347_4.x · Cited by 1,767
Latent Curve Models: A Structural Equation Perspective
Bollen, K. A., & Curran, P. J. (2005) · Wiley Series in Probability and Statistics · doi:10.1002/0471746096 · Cited by 1,729
Prior distributions for variance parameters in hierarchical modelsPreprint
Gelman, A. (2004) · RePEc: Research Papers in Economics · Cited by 1,632
Bayesian structural equation modeling: A more flexible representation of substantive theory
Muthén, B., & Asparouhov, T. (2012) · Psychological Methods · doi:10.1037/a0026802 · Cited by 1,562 · cited 9×
“Draws from the posterior distribution, simulated using MCMC sampling methods, are thereby restricted to the same space (Chung et al., 2011; Gelman, 2006; Muthén & Asparouhov, 2012; Skrondal & RabeHesketh, 2004, p. 206).”
InfluentialGeneralized Latent Variable Modeling: Multilevel, Longitudinal, and Structural Equation Models
Skrondal, A., & Rabe‐Hesketh, S. (2004) · Thammasat University Digital Collections · Cited by 1,505
Bayesian Modeling Using WinBUGS
Ntzoufras, I. (2009) · Wiley eBooks · doi:10.1002/9780470434567 · Cited by 1,001
Bayesian Methods for Data Analysis
Carlin, B. P., & Louis, T. A. (2008) · Chapman & Hall/CRC eBooks · doi:10.1201/b14884 · Cited by 917
Feingold, A. (2009) · Psychological Methods · doi:10.1037/a0014699 · Cited by 851
Handbook of structural equation modeling
Hoyle, R. H. (2012) · Cited by 808
A First Course in Bayesian Statistical Methods
Hoff, P. D. (2009) · Springer Texts in Statistics · doi:10.1007/978-0-387-92407-6 · Cited by 781
(1999) · Cited by 751
Maxwell, S. E. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.2.147 · Cited by 654
Kazdin, A. E., Siegel, T. C., & Bass, D. (1992) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.60.5.733 · Cited by 651
Yuan, Y., & MacKinnon, D. P. (2009) · Psychological Methods · doi:10.1037/a0016972 · Cited by 637
Nonconvergence, Improper Solutions, and Starting Values in Lisrel Maximum Likelihood Estimation
Boomsma, A. (1985) · Psychometrika · doi:10.1007/bf02294248 · Cited by 621
Improper Solutions in Structural Equation Models: Causes, Consequences, and Strategies
CHEN, F., BOLLEN, K. A., PAXTON, P., CURRAN, P. J., & KIRBY, J. B. (2001) · Sociological Methods & Research · doi:10.1177/0049124101029004003 · Cited by 512
Lee, S.-Y., & Song, X.-Y. (2004) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3904_4 · Cited by 488 · cited 5×
“…the most commonly implemented estimation algorithm in SEM research, the method of maximum likelihood (ML), yields results that are asymptotically valid—meaning that a large sample is required for trustworthy inference (Lee & Song, 2004; Lei & Wu, 2012; Nevitt & Hancock, 2004; Song & Lee, 2012).”
Influential(2020) · Linear Algebra and Matrix Computations with MATLAB® · doi:10.1515/9783110666991-007 · Cited by 482
Family environment scale manual : Development,Applications,Research
Moos, R. H., & Moos, B. S. (2002) · Medical Entomology and Zoology · Cited by 475
Measurement of drinking behavior using the Form 90 family of instruments.
Miller, W. R., & Del Boca, F. K. (1994) · Journal of Studies on Alcohol, Supplement · doi:10.15288/jsas.1994.s12.112 · Cited by 449
Fit Indices Versus Test Statistics
Yuan, K.-H. (2005) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr4001_5 · Cited by 415 · cited 1×
“The LISREL fit indices and statistics indicated that the SEM fit the data well from a frequentist perspective (Satorra-Bentler scaled 2 48.76, df 76, p .9936; root-mean-square error of approximation 0.00; comparative fit index 1.00; see K. Yuan, 2005, for a discussion of these measures of fit).”
InfluentialInference and monitoring convergence
(1995) · Markov Chain Monte Carlo in Practice · doi:10.1201/b14835-13 · Cited by 412
Measurement Model Quality, Sample Size, and Solution Propriety in Confirmatory Factor Models
Gagne, P., & Hancock, G. R. (2006) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr4101_5 · Cited by 397
Treatment outcomes for adolescent substance abuse at 4- and 7-month assessments.
Barrett, H., Slesnick, N., Brody, J. L., Turner, C. W., & Peterson, T. R. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.69.5.802 · Cited by 391
Santisteban, D. A., Coatsworth, J. D., Perez-Vidal, A., Kurtines, W. M., Schwartz, S. J., LaPerriere, A., & Szapocznik, J. (2003) · Journal of Family Psychology · doi:10.1037//0893-3200.17.1.121 · Cited by 343
Bayesian Ideas and Data Analysis
Christensen, R., Johnson, W., Branscum, A., & Hanson, T. E. (2010) · CRC Press eBooks · doi:10.1201/9781439894798 · Cited by 291
Testing Negative Error Variances: Is a Heywood Case a Symptom of Misspecification?
Kolenikov, S., & Bollen, K. A. (2012) · Sociological Methods & Research · doi:10.1177/0049124112442138 · Cited by 253
Achenbach, T. M., Dumenci, L., & Rescorla, L. A. (2002) · Journal of Emotional and Behavioral Disorders · doi:10.1177/10634266020100040101 · Cited by 239
Evaluating Small Sample Approaches for Model Test Statistics in Structural Equation Modeling
Nevitt, J., & Hancock, G. R. (2004) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3903_3 · Cited by 233
Song, X., & Lee, S. (2012) · Wiley Series in Probability and Statistics · doi:10.1002/9781118358887 · Cited by 177
Bayesian structural equation modeling.
Kaplan, D. E., & Depaoli, S. A. (2012) · Cited by 176
Liddle, H. A., Rowe, C. L., Dakof, G. A., Ungaro, R. A., & Henderson, C. E. (2004) · Journal of Psychoactive Drugs · doi:10.1080/02791072.2004.10399723 · Cited by 175
Bayesian methods for the analysis of small sample multilevel data with a complex variance structure.
Baldwin, S. A., & Fellingham, G. W. (2012) · Psychological Methods · doi:10.1037/a0030642 · Cited by 174
To Bayes or Not to Bayes, From Whether to When: Applications of Bayesian Methodology to Modeling
Rupp, A. A., Dey, D. K., & Zumbo, B. D. (2004) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1207/s15328007sem1103_7 · Cited by 169
Bayesian analysis of longitudinal data using growth curve models
Zhang, Z., Hamagami, F., Lijuan Wang, L., Nesselroade, J. R., & Grimm, K. J. (2007) · International Journal of Behavioral Development · doi:10.1177/0165025407077764 · Cited by 143
Kazdin, A. E., & Whitley, M. K. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.2.346 · Cited by 139
Estimation in structural equation modeling.
Lei, P., & Wu, Q. (2012) · Cited by 127
Constrained versus unconstrained estimation in structural equation modeling.
Savalei, V., & Kolenikov, S. (2008) · Psychological Methods · doi:10.1037/1082-989x.13.2.150 · Cited by 114
Model checking and model improvement
Gilks, W. R., Richardson, S. T., & Spiegelhalter, D. J. (1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835-16 · Cited by 99
Dillon, F. R., Turner, C. W., Robbins, M. S., & Szapocznik, J. (2005) · Psychology of Addictive Behaviors · doi:10.1037/0893-164x.19.4.404 · Cited by 90
A Bayesian Approach for Estimating Mediation Effects With Missing Data
Enders, C. K., Fairchild, A. J., & MacKinnon, D. P. (2013) · Multivariate Behavioral Research · doi:10.1080/00273171.2013.784862 · Cited by 67
Donohue, B., Azrin, N. H., Strada, M. J., Silver, N. C., Teichner, G., & Murphy, H. (2004) · Psychology of Addictive Behaviors · doi:10.1037/0893-164x.18.2.184 · Cited by 63
Family conflict and communication in adolescence.
Foster, S. L., & Robin, A. L. (1997) · Cited by 52
Hierarchical modeling of sequential behavioral data: An empirical Bayesian approach.
Dagne, G. A., Howe, G. W., Brown, C. H., & Muthén, B. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.262 · Cited by 44
Functional Family Therapy for Adolescent Substance Use Disorders
Waldron, H. B., Brody, J. L., Robbins, M. S., & Alexander, J. F. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-398338-1.00012-9 · Cited by 39
Bayesian Evaluation of Inequality-Constrained Hypotheses in SEM Models Using M plus
van de Schoot, R., Hoijtink, H., Hallquist, M. N., & Boelen, P. A. (2012) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2012.713267 · Cited by 30
Rindskopf, D. (2012) · Psychological Methods · doi:10.1037/a0027130 · Cited by 23
A Bayesian Approach for Analyzing Longitudinal Structural Equation Models
Song, X.-Y., Lu, Z., Hser, Y., & Lee, S. (2011) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2011.557331 · Cited by 22
Bayesian estimation of a covariance matrix with flexible prior specification
Hsu, C.-W., Sinay, M. S., & Hsu, J. S. J. (2010) · Annals of the Institute of Statistical Mathematics · doi:10.1007/s10463-010-0314-5 · Cited by 22
Avoiding Boundary Estimates in Linear Mixed Models Through Weakly Informative Priors
Chung, Y., Rabe‐Hesketh, S., Gelman, A., Liu, J., & Dorie, V. (2012) · Collection of Biostatistics Research Archive · Cited by 17
Kronenberger, W. G., Thompson, R. J., & Morrow, C. (1997) · Assessment · doi:10.1177/107319119700400106 · Cited by 9
Clinical perspectives on the assessment of adolescent drug abuse
Winters, K. C. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511543968.012 · Cited by 6
Applying Structural Equation Models with Incomplete Data
Stern, H. S., & Jeon, Y.-S. (2004) · Wiley series in probability and statistics · doi:10.1002/0470090456.ch30 · Cited by 5
Bayesian Essentials with R (2nd ed.)
Marin, J., & Robert, C. P. (2014) · Base Institutionnelle de Recherche de l'université Paris-Dauphine (BIRD) (University Paris-Dauphine) · Cited by 4
Research works printed but not linked: 20
- Achenbach TM, Rescorla LA. Manual for the ASEBA school-age forms & profiles. Burlington, VT: University of Vermont Research Center for Children, Youth, & Families; 2001. [Google Scholar]
- Alexander JF, Parsons BV. Functional Family Therapy: Principles and procedures. Carmel, CA: Brooks/Cole; 1982. [Google Scholar]
- Alexander JF, Waldron HB, Robbins MS, Neeb A. Functional Family Therapy: A journey of discovery. Washington, D.C: American Psychological Association; 2013. [Google Scholar]
- Barnard J, McCulloch R, Meng X. Modeling covariance matrices in terms of standard deviations and correlations, with applications to shrinkage. Statistica Sinica. 2000;10:1281–1311. [Google Scholar]
- Boomsma A, Hoogland JJ. The robustness of LISREL modeling revisited. In: Cudeck R, du Toit S, Sorbom D, editors. Structural equation modeling: Present and future. A festschrift in honor of Karl Joreskog. Lincolnwood, IL: Scientific Software International; 2001. pp. 139–168. [Google Scholar]
- Congdon P. Bayesian statistical modeling. 2. Hoboken, NJ: Wiley; 2006. [Google Scholar]
- Duncan TE, Duncan SC, Stryker LA. An introduction to latent variable growth curve modeling: Concepts, issues, and applications. 2. Mahwah, NJ: Lawrence Erlbaum Associates; 2006. [Google Scholar]
- Gelman A, Carlin JB, Stern HS, Rubin DB. Bayesian data analysis. 2. New York: Chapman & Hall/CRC; 2004. [Google Scholar]
- Gilks WR, Richardson S, Spiegrlhalter DJ, editors. Markov chain Monte Carlo in practice. New York: Chapman & Hall; 1996. [Google Scholar]
- Gill J. Bayesian methods: A social and behavioral sciences approach. 2. Boca Raton, FL: Chapman & Hall/CRC; 2008. [Google Scholar]
- Jöreskog K, Sörbom D. LISREL 8: Users reference guide. Chicago, IL: Scientific Software International; 1996–2001. [Google Scholar]
- Kline RB. Principles and practice of structural equation modeling. 3. New York: Guilford; 2011. [Google Scholar]
- Lee S. Structural equation modeling: A Bayesian approach. Hobeken, NJ: Wiley; 2007. [Google Scholar]
- Leon SJ. Linear algebra with applications. 8. Upper Saddle River, NJ: Pearson Prentice Hall; 2009. [Google Scholar]
- MacKinnon DP. Introduction to statistical mediation analysis. New York: Erlbaum; 2008. [Google Scholar]
- Robert CP. The Bayesian choice: From decision-theoretic foundations to computational implementation. 2. New York: Springer; 2007. [Google Scholar]
- Robert CP, Casella G. Monte Carlo statistical methods. 2. New York: Spinger-Verlag; 2004. [Google Scholar]
- SAS Institute, Inc. SAS/STAT® 12.1 User’s Guide. Cary, NC: SAS Institute Inc; 2012. [Google Scholar]
- Winters KC. Screening and assessing youth for drug involvement. In: Allen J, Columbus M, editors. NIAAA handbook on assessment instruments for alcohol researchers. 2. Rockville, MD: National Institutes on Alcohol Abuse and Alcoholism; 2003. [Google Scholar]
- Wothke W. Nonpositive definite matrices in structural modeling. In: Bollen KA, Long JS, editors. Testing structural equation models. Newbury Park, CA: Sage; 1993. pp. 256–293. [Google Scholar]
Cited by
A systematic review of Bayesian articles in psychology: The last 25 years.
van de Schoot, R., Winter, S. D., Ryan, O., Zondervan-Zwijnenburg, M., & Depaoli, S. (2017) · Psychological Methods · doi:10.1037/met0000100 · Cited by 374
Victor, S. E., Scott, L. N., Stepp, S. D., & Goldstein, T. R. (2019) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12513 · Cited by 111
Robbins, M. S., Alexander, J. F., Turner, C. W., & Hollimon, A. (2016) · Family Process · doi:10.1111/famp.12230 · Cited by 105
Bayesian Structural Equation Modeling in Sport and Exercise Psychology
Stenling, A., Ivarsson, A., Johnson, U., & Lindwall, M. (2015) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.2014-0330 · Cited by 82
Carayon, P., Hoonakker, P., Hundt, A. S., Salwei, M., Wiegmann, D., Brown, R. L., Kleinschmidt, P., Novak, C., Pulia, M., Wang, Y., et al. (2020) · BMJ Quality & Safety · doi:10.1136/bmjqs-2019-009857 · Cited by 62
Metadata
- Authors
- Ozechowski, T. J.
- Affiliations
- Oregon Research Institute (US)
- Corresponding author
- Ozechowski, Timothy J.
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2014-10
- Volume
- 82
- Issue
- 5
- Pages
- 854-867
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- PMC
- PMC4327978
- OpenAlex
- W2327902964
- Cited by
- 42
- References
- 66
- Citations by year
- 2025: 1 · 2024: 4 · 2023: 2 · 2022: 8 · 2021: 5 · 2020: 8 · 2019: 4 · 2018: 4 · 2017: 1 · 2016: 3 · 2015: 1 · 2014: 1
- FWCI
- 2.11
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (R03DA017181 and R03DA021221, R01DA09422)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Clinical Psychology › Counseling, Therapy, and Family Dynamics
- Keywords
- empirical Bayes, structural equation modeling, small sample size, Markov chain Monte Carlo, therapist behavior, functional family therapy, adolescent substance abuse, family functioning, delinquency, cannabis use, maximum likelihood estimation comparison
- MeSH terms
- Adolescent, Adolescent Behavior, Bayes Theorem, Family Therapy, Female, Humans, Male, Markov Chains, Monte Carlo Method, Randomized Controlled Trials as Topic, Substance-Related Disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.