The relative benefits of meta-analysis conducted with individual participant data versus aggregated data
The DOI matches its Crossref record; 42 of the 43 references it cites were found in a registry or an index.
Abstract
The authors describe the relative benefits of conducting meta-analyses with (a) individual participant data (IPD) gathered from the constituent studies and (b) aggregated data (AD), or the group-level statistics (in particular, effect sizes) that appear in reports of a study's results. Given that both IPD and AD are equally available, meta-analysis of IPD is superior to meta-analysis of AD. IPD meta-analysis permits synthesists to perform subgroup analyses not conducted by the original collectors of the data, to check the data and analyses in the original studies, to add new information to the data sets, and to use different statistical methods. However, the cost of IPD meta-analysis and the lack of available IPD data sets suggest that the best strategy currently available is to use both approaches in a complementary fashion such that the first step in conducting an IPD meta-analysis would be to conduct an AD meta-analysis. Regardless of whether a meta-analysis is conducted with IPD or AD, synthesists must remain vigilant in how they interpret their results. They must avoid ecological fallacies, Simpson's paradox, and interpretation of synthesis-generated evidence as supporting causal inferences.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While the majority of published meta-analyses compare group means and yield only a single estimate of an intervention effect (Alemayehu, 2011), meta-analyses of the rich individual-level data from single case experiments can provide detailed knowledge of individual patient, therapist, and context variables that influence treatment effectiveness (Cooper & Patall, 2009; Iwakabe & Gazzola, 2009; Th”
From Acceptance and Commitment Therapy modules: Differential impact on treatment processes and outcomes (2016) · cites this paper as Cooper & Patall, 2009
Citations
Cites
Ecological Correlations and the Behavior of Individuals
Robinson, W. S. (1950) · American Sociological Review · doi:10.2307/2087176 · Cited by 4,513
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,642
Self-citationFixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
The interpretation of interaction in contingency tables
Simpson, E. H. (1951) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1951.tb00088.x · Cited by 2,301 · cited 1×
“Related to the ecological fallacy is another phenomenon called “Simpson’s paradox” (Simpson, 1951).”
BackgroundMeta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033 · cited 3×
“Mathew and Nordström (1999) then relaxed some of Olkin and Sampson’s assumptions and demonstrated that the estimate of the treatment main effect also was the same for IPD meta-analysis and AD meta-analysis even when observations were not independent within studies and the observations had different covariation matrice…”
MethodResultResearch Synthesis and Meta-Analysis: A Step-by-Step Approach
Cooper, H. (2017) · doi:10.4135/9781071878644 · Cited by 1,716
Self-citationHow Many Studies Do You Need?: A Primer on Statistical Power for Meta-Analysis
Valentine, J. C., Pigott, T. D., & Rothstein, H. R. (2010) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998609346961 · Cited by 1,294
Interpersonal expectancy effects: the first 345 studies
Rosenthal, R., & Rubin, D. B. (1978) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00075506 · Cited by 1,158
Cited by
Items 201–300 of 339
Hogue, A., Henderson, C. E., & Schmidt, A. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0724-7 · Cited by 14
“2012) found no substantial predictor effects for any demographic variable, although it should be pointed out that meta-analyses are typically underpowered for testing such moderator effects (Cooper and Patall 2009).”
BackgroundJewish Population in the United States, 2014
Sheskin, I. M., & Dashefsky, A. (2014) · American Jewish year book · doi:10.1007/978-3-319-09623-0_17 · Cited by 11
Integrative Data Analysis for Research in Developmental Psychopathology
Mun, E., Jiao, Y., & Xie, M. (2016) · Wiley eBooks · doi:10.1002/9781119125556.devpsy123 · Cited by 11
“The need for ensuring commensurate measures across studies is widely discussed as a notable barrier for IDA or meta-analysis using IPD, especially in psychological research (Cooper & Patall, 2009; Curran & Hussong, 2009).”
BackgroundInterpretation of meta-analyses
Clephas, P. R. D., & Heesen, M. A. (2022) · Interventional Pain Medicine · doi:10.1016/j.inpm.2022.100120 · Cited by 17
Mistiaen, P., Jolley, D. J., McGowan, S., Hickey, M. B., Spreeuwenberg, P. M. M., & Francke, A. L. (2011) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2011.tb04185.x · Cited by 10
Joo, S., Wang, Y., Ferron, J. M., Beretvas, S. N., Moeyaert, M., & Noortgate, W. V. D. (2021) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986211035507 · Cited by 10
“The relative advantages of meta-analyses based on aggregated data versus individual participant data have been discussed in the literature on meta-analyzing group studies (Cooper & Patall, 2009; Riley et al., 2010), but not studied for meta-analysis of single-case studies.”
BackgroundSchettino, M., Tarmati, V., Castellano, P., Gigli, V., Carnevali, L., Cabib, S., Ottaviani, C., & Orsini, C. (2024) · Neurobiology of Stress · doi:10.1016/j.ynstr.2024.100647 · Cited by 14
“Each rodent/participant was included only once in each meta-analysis (Cooper and Patall, 2009).”
McDaniel, H. L., Budavari, A. C., Tonigan, A. T., Michael, A. E., West, S. G., Gottfredson, N. C., Powell, N. P., Qu, L., Saavedra, L. M., Yaros, A., et al. (2025) · JAACAP Open · doi:10.1016/j.jaacop.2025.01.005 · Cited by 10
“Our approach leveraged IDA, 24,28 meta-analysis of individual patient data, 29 and propensity score weighting.”
Single paper meta‐analysis is unavoidable
McShane, B. B., & Böckenholt, U. (2025) · Journal of Consumer Psychology · doi:10.1002/jcpy.1462 · Cited by 12
Religious Giving and the Boundedness of Rationality
Hoffmann, J. P., Lott, B., & Jeppsen, C. E. (2010) · Sociology of Religion · doi:10.1093/socrel/srq047 · Cited by 9
Moore, S. (2014) · Ubiquity Press eBooks · doi:10.5334/ban · Cited by 20
Analyzing Families of Experiments in SE: A Systematic Mapping Study
Santos, A., Gómez, O. S., & Juristo, N. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2864633 · Cited by 47
Does an Increase in the Minimum Wage Decrease Employment? A Meta-Analysis of Canadian Studies
Campolieti, M. (2020) · Canadian Public Policy · doi:10.3138/cpp.2019-070 · Cited by 16
Hornburg, C. B., Wang, L., & McNeil, N. M. (2018) · Child Development · doi:10.1111/cdev.13058 · Cited by 10
Individual Participant Data Meta-Analysis Including Moderators: Empirical Validation
Moeyaert, M., Yang, P., & Xue, Y. (2023) · The Journal of Experimental Education · doi:10.1080/00220973.2023.2208062 · Cited by 9
“The existing meta-analytic techniques in SCED studies can be broadly categorized into two types: the aggregated data (AD) and the individual patient/participant-level data (IPD) meta-analyses (Cooper & Patall, 2009; Declercq et al., 2022; Moeyaert & Fingerhut, 2022).”
Groot, L. J., Kan, K., & Jak, S. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1735 · Cited by 11
“The use of IPD is regarded as superior to using aggregated data in meta-analysis, 83,84 among other reasons, as a way to defend oneself against ecological and atomistic fallacies.”
Doherty, R., Weber, N., Hillier, C., Ross, R. M., & Balzan, R. P. (2025) · Clinical Psychology Review · doi:10.1016/j.cpr.2025.102618 · Cited by 12
Onuigbo, M. A. C. (2013) · Nephron Extra · doi:10.1159/000351044 · Cited by 7
Gautam, N., Verma, M., & Ray, B. (2024) · Journal of Islamic marketing · doi:10.1108/jima-06-2023-0194 · Cited by 21
Meyer-Baron, M., Schäper, M., Knapp, G., Lucchini, R. G., Albini, E., Bast‐Pettersen, R., He, S., Hong, Y., Niu, Q. L., Wang, X., et al. (2011) · Toxicology Letters · doi:10.1016/j.toxlet.2011.07.003 · Cited by 8
Kirk, A. H. P., Jin-ling, Y., Sim, W. C., Chia, L. Y. X., & Lau, Y. (2019) · Journal of Obstetric, Gynecologic & Neonatal Nursing · doi:10.1016/j.jogn.2018.12.004 · Cited by 14
Domhardt, M., Grund, S., Mayer, A., Büscher, R., Ebert, D. D., Sander, L., Karyotaki, E., Cuijpers, P. J., & Baumeister, H. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.899115 · Cited by 9
“, imputation strategies), facilitating investigations on multiple levels not possible in conventional meta-analyses (40).”
BackgroundMansolf, M. A., Blackwell, C. K., Chandran, A., Colicino, E., Geiger, S. D., Harold, G. T., McEvoy, C. T., Junior, H. P. D. O. S., Sherlock, P., Bose, S., et al. (2023) · Journal of Child and Family Studies · doi:10.1007/s10826-023-02624-x · Cited by 10
“In this study, we conducted within-cohort item response theory (IRT) analysis followed by individual participant data meta-analysis (Cooper & Patall, 2009; Stewart & Tierney, 2002; Hedges, 1992) to assess the relationship between caregiver perceived stress and child sleep disturbance across ECHO…”
MethodHartman, H. J., & Sheskin, I. M. (2013) · Review of Religious Research · doi:10.1007/s13644-013-0112-7 · Cited by 8
Systematic reviews and meta-analysis in rheumatology: a gentle introduction for clinicians
Kelley, G. A., & Kelley, K. S. (2019) · Clinical Rheumatology · doi:10.1007/s10067-019-04590-6 · Cited by 8
“However, others estimated the costs for the same study to be at least 8 times greater given that the research team continued to work on the study after funding for the project ended [14].”
BackgroundJewish Population in the United States, 2013
Sheskin, I. M., & Dashefsky, A. (2013) · American Jewish year book · doi:10.1007/978-3-319-01658-0_5 · Cited by 8
Han, H., & Graham, M. (2024) · Theory and Research in Education · doi:10.1177/14778785241233541 · Cited by 19
“…o b - s e r v e d p o w e r f o r D a t a s e t s 4 a n d 5 w e r e c a l c u l a t e d t o g e t h e r a s t h e y w e r e f r o m t h e s a m e e xp e r i m e n t . a feasible way to boost the overall statistical power in our study as expected (Cooper and Patall, 2009; Curran and Hussong, 2009).”
BackgroundInfluentialHien, D. A., Gette, J. A., Blakey, S. M., Piccirillo, M. L., Back, S. E., Bauer, A. G., Ebrahimi, C. T., Ellis, R. A., Killeen, T. K., Lehinger, E. A., et al. (2025) · Addiction · doi:10.1111/add.70126 · Cited by 8
“…of individual patient data and integrative data analysis (MIPD/IDA), which has several methodological advantages over prior meta-analyses [22, 23], including comparability in measurement of outcomes under IDA [24, 25] and the evaluation of head-to-head comparative effectiveness of…”
Amsterdam, J. D., & Xu, C. (2023) · Bipolar Disorders · doi:10.1111/bdi.13378 · Cited by 7
Mun, E., Atkins, D. C., & Walters, S. T. (2015) · Psychology of Addictive Behaviors · doi:10.1037/adb0000100 · Cited by 8
Kelley, G. A., & Kelley, K. S. (2016) · BioMed Research International · doi:10.1155/2016/5059041 · Cited by 10
Sun, X., Xu, D., Luo, F., Wei, Z., Wei, C., & Xue, G. (2015) · PLoS ONE · doi:10.1371/journal.pone.0124170 · Cited by 8
“Due to the diversification of studies in regards to participant characteristics and study materials, one stage random effect meta-analyses were applied to the IPD collected by these seventeen studies with restricted maximum likelihood estimation [9–15].”
BackgroundMethodMorgan‐López, A. A., Bradshaw, C. P., & Musci, R. J. (2023) · Prevention Science · doi:10.1007/s11121-023-01600-7 · Cited by 7
“…with a defined study universe for study selection (e.g., Mun et al., this issue; Schweer-Collins et al., 2023), whereas others did not (i.e., “pseudo-MIPDs”; Morgan-López et al., 2022a); however, they used the statistical methodology associated with MIPD analysis (e.g., Cooper & Patall, 2009).”
BackgroundMethodO'Neil, M. E., de Haan, A., Sadeh, Y., Marsac, M. L., Kassam‐Adams, N., Morgan‐López, A. A., Hamblen, J. L., Clauss, K. E., & Hien, D. A. (2025) · Journal of Traumatic Stress · doi:10.1002/jts.70006 · Cited by 6
“…2018 by the NIH’s National Institute on Alcohol Abuse and Alcoholism (NIAAA), conducted an individual participant-level data meta-analysis (IPD-MA; Cooper & Patall, 2009; Stewart & Parmar, 1993) of studies identified by a systematic review of the published and gray literature up to 2019 to…”
Eldevik, S., Strømgren, B., Eikeseth, S., Fields, A., Goetz, C. M., & Titlestad, K. B. (2026) · Autism Research · doi:10.1002/aur.70169 · Cited by 9
“An alternative and often superior approach is to conduct an Individual Participant Data (IPD) meta-analysis (Cooper and Patall 2009; Riley and Steyerberg 2010).”
Schweer‐Collins, M. L., Parr, N. J., Saitz, R., & Tanner‐Smith, E. E. (2023) · Prevention Science · doi:10.1007/s11121-023-01525-1 · Cited by 9
“Other advantages of IPD meta-analysis compared with AD meta-analysis can include greater precision of effect size estimates, and improved consistency and rigor of treatment-covariate (i.e., moderation) models through direct re-analysis of primary study data (Cooper & Patall, 2009).”
MethodChen, L., Miočević, M., & Falk, C. F. (2024) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2023.2300079 · Cited by 8
“…pooling is a powerful and flexible strategy that forms the basis of a wide range of data analytic approaches, such as integrative data analysis (Curran & Hussong, 2009; Kush et al., 2023; Marcoulides, 2023) and individual participant data meta-analysis (Cooper & Patall, 2009; Riley et al., 2010).”
Wu, I. X. Y., Xiao, F., Wang, H., Chen, Y., Zhang, Z., Lin, Y., & Tam, W. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.10.011 · Cited by 6
Reconstructing patient level survival data from published Kaplan-Meier curves
Kim, J., Chalise, P., & He, J. (2025) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2025.101542 · Cited by 11
“Notwithstanding that acquiring IPD is laborious, the benefit of IPD meta-analysis can be described as more versatile since sub-group analysis or different analysis methods can be implemented [3].”
A Bayesian hierarchical model for individual participant data meta‐analysis of demand curves
Zhang, S., Chu, H., Bickel, W. K., Le, C. T., Smith, T. T., Thomas, J., Donny, E. C., Hatsukami, D. K., & Luo, X. (2022) · Statistics in Medicine · doi:10.1002/sim.9354 · Cited by 5
Test position effects on hit and false alarm rates in recognition memory for paintings and words
Fallow, K. M., & Lindsay, D. S. (2021) · Memory & Cognition · doi:10.3758/s13421-021-01227-5 · Cited by 5
Meta-Analysis of Single-Case Data: A Monte Carlo Investigation of a Three Level Model
Owens, C. M. (2011) · Digital Commons - University of South Florida (University of South Florida) · Cited by 12
Does Learning Agility Vary Primarily at the Between- or Within-Person Level of Analysis?
Beck, J. W. (2012) · Industrial and Organizational Psychology · doi:10.1111/j.1754-9434.2012.01453.x · Cited by 5
“This method is used when data are collected at multiple levels of analysis (Cooper & Patall, 2009). models shown in Figure 1.”
MethodA Bayesian Synthesis Approach to Data Fusion Using Augmented Data-Dependent Priors
Marcoulides, K. M. (2017) · Cited by 5
Comparing techniques for aggregating interrelated replications in software engineering
Santos, A., & Juristo, N. (2018) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1145/3239235.3239239 · Cited by 5
“IPD involves the central collection, processing and analysis of all experiments’ raw-data into a joint conclusion [9].”
BackgroundMethodResultInfluentialAn Algorithm for Creating Virtual Controls Using Integrated and Harmonized Longitudinal Data
Hansen, W. B., Chen, S., Saldana, S. J., & Ip, E. H. (2018) · Evaluation & the Health Professions · doi:10.1177/0163278718772882 · Cited by 5
“Adopting a “big data” and an “integrated data” approach allows the various measures to be harmonized, allowing investigators to then work with similar and comparable constructs (Cooper & Patall, 2009; Curran & Hussong, 2009).”
Are Nonhuman Animals Averse to Inequity? A Meta-Analysis [Pre-Print]Preprint
Ritov, O., Völter, C. J., Raihani, N., & Engelmann, J. M. (2023) · doi:10.31234/osf.io/86vkf · Cited by 5
Onuigbo, M. A. C. (2010) · QJM · doi:10.1093/qjmed/hcq053 · Cited by 4
“In particular, the magnitude and even the direction of relationships between variables found by comparing group-level statistics may not be indicative of the same relationships tested with individual participant data.(2,3) Consequently, proof of association must not always be assumed to be proof of causation.”
ResultSantos, A., Järvinen, J., Partanen, J. O., Oivo, M., & Juristo, N. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-03673-7_17 · Cited by 6
Moeyaert, M., & Fingerhut, J. (2022) · Harvard Data Science Review · doi:10.1162/99608f92.3574f1dc · Cited by 5
“See Cooper and Patall (2009) for an introduction into AD and IPD meta-analysis.”
van den Bos, W., Jenny, M. A., & Wulff, D. U. (2014) · Ubiquity Press eBooks · doi:10.5334/ban.g · Cited by 4
Meta-Analysis Using Individual Participant Data Is the Gold Standard for Diagnostic Studies Δ
Zheng, M., Shi, K., Fan, Y., & Chen, Y. (2011) · Hepatology · doi:10.1002/hep.24188 · Cited by 4
Campos, D., Cheung, M. W. ‐., & Scherer, R. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/r9p62 · Cited by 4
Becker, B. J., & Thompson, C. G. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-818630-5.10092-2 · Cited by 7
Han, H., & Graham, M. (2023) · doi:10.31234/osf.io/n6mkp · Cited by 4
O'Neil, M. E., Krushnic, D., Walker, W. C., Cameron, D., Baker‐Robinson, W., Hannon, S. A., Clauss, K. E., Cheney, T. P., Cook, L. J., Niederhausen, M., et al. (2024) · Brain Sciences · doi:10.3390/brainsci14090921 · Cited by 4
R′biaa, O., & Dextras-Gauthier, J. (2025) · Cogent Business & Management · doi:10.1080/23311975.2025.2546560 · Cited by 10
“…this specific protocol, the aim is to establish the cumulative effect between variables to ensure the generalizability of their causal associations (cooper & Patall, 2009). in line with the methodology used in previous meta-analytical studies (e.g. Özkan, 2009), only variables for which prior…”
Integration of Historical Data for the Analysis of Multiple Assessment Studies
Marcoulides, K. M. (2023) · Measurement Interdisciplinary Research and Perspectives · doi:10.1080/15366367.2022.2115250 · Cited by 3
“Synthesizing results from many different studies has recently been shown to be an effective tool for researchers interested in tackling longitudinal processes that are often difficult to model (Cooper & Patall, 2009; Curran & Hussong, 2009; Marcoulides & Grimm, 2017).”
MethodShen, W. (2011) · University of Minnesota Digital Conservancy (University of Minnesota) · Cited by 6
Jaja, N. R. B. (2014) · TSpace (University of Toronto) · Cited by 4
Modern Meta-Analytic Methods in Prevention Science: Introduction to the Special Issue
Tanner‐Smith, E. E., Grant, S., & Mayo‐Wilson, E. (2022) · Prevention Science · doi:10.1007/s11121-022-01354-8 · Cited by 3
Xue, Y., Moeyaert, M., Baek, E., Solomon, B. G., & Noortgate, W. V. D. (2025) · Journal of Behavioral Education · doi:10.1007/s10864-025-09603-w · Cited by 3
“Either the traditional aggregated data (AD) meta-analysis (MA) or the individual participant data (IPD) MA can be applied for this synthesis (Cooper & Patall, 2009; Declercq et al., 2022; Moeyaert et al., 2023).”
An Individual Participant Data Meta-Analysis Method Primer for Psychology
Fritz, T., & Göritz, A. S. (2026) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000614 · Cited by 2
Savage, W., & Harel, N. Y. (2022) · Neurorehabilitation and neural repair · doi:10.1177/15459683221124112 · Cited by 2
Haeny, A. M., McCuistian, C. L., Burlew, A. K., Ruglass, L. M., Espinosa, A., Jordan, A., Roundtree, C., Lopez, J., & Morgan‐López, A. A. (2023) · Contemporary Clinical Trials · doi:10.1016/j.cct.2023.107329 · Cited by 2
Meta‐Analysis of PISA Creative Thinking Assessment Data: A Guide for Creativity Researchers
Said‐Metwaly, S., Fernández‐Castilla, B., & Noortgate, W. V. D. (2025) · The Journal of Creative Behavior · doi:10.1002/jocb.70046 · Cited by 2
Individual patient data meta-analysis of prognostic factor studies
Abo-Zaid, G. (2011) · UPT. Syiah Kuala University Library (Syiah Kuala University) · Cited by 2
Sheble, L. (2014) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/j9w4-6429 · Cited by 7
Changing approaches to research synthesis affect social and intellectual structures of science
Sheble, L. (2016) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.2016.14505301076 · Cited by 2
“…knowledge occurs through collaboration (Sonnenwald, 2007), interdisciplinary research (Wagner et al., 2011), integration of findings (Cooper & Hedges, 1994) and data (Cooper & Patall, 2009) across studies, implementation of simultaneous, or multi-site studies, and through theory development.”
BackgroundEfficient integration of aggregate data and individual participant data in one‐way mixed models
Agarwala, N., Park, J., & Roy, A. (2022) · Statistics in Medicine · doi:10.1002/sim.9307 · Cited by 2
Onuigbo, M. A. C. (2022) · Journal of the American Society of Nephrology · doi:10.7759/cureus.30794 · Cited by 2
“These concerns include the looming large probability that such analyses will result in the phenomenon of ecologic fallacy and Simpson’s paradox [31,34-36].”
BackgroundThe persistence of common-ratio effects in multiple-play decisions
DeKay, M. L., Schley, D. R., Miller, S. A., Erford, B. M., Sun, J., Karim, M. N., & Lanyon, M. B. (2016) · Judgment and Decision Making · doi:10.1017/s193029750000379x · Cited by 2
“…these within-participants studies had essentially identical designs, we used individual participant data rather than aggregated data for these meta-analyses (Cooper & Patall, 2009). significant, overall b = 0.47, CI [–0.42, 1.36], OR = 1.60, t(5) = 1.36, p = .23 (see the right panel of Figure 6).”
MethodInfluentialTackman, A. M., Sbarra, D. A., Carey, A. L., Donnellan, B. M., Horn, A. B., Holtzman, N. S., Edwards, T. S., Pennebaker, J. W., & Mehl, M. R. (2018) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/27r94 · Cited by 2
Liebst, L. S., Ejbye‐Ernst, P., de Bruin, M., Thomas, J., & Lindegaard, M. R. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/u6wcp · Cited by 2
Luhmann, M., Necka, E. A., Schönbrodt, F. D., & Hawkley, L. C. (2016) · doi:10.31219/osf.io/wcgk9 · Cited by 2
Brunner, M., Preckel, F., Goetz, T., Lüdtke, O., & Keller, L. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/6pmhr · Cited by 3
A Taxonomy of Data Synthesis: A TutorialPreprint
Beck, E. D., Willroth, E. C., Delius, J. A. M., Bennett, D. A., Barnes, L. L., James, B. D., Lipton, R. B., Katz, M. J., Hassing, L. B., Huisman, M. A., et al. (2024) · doi:10.31234/osf.io/m3ywe · Cited by 2
The Relationship of Sex Steroid Hormones and Clinical Outcomes Is Complex
Anawalt, B. D. (2024) · Annals of Internal Medicine · doi:10.7326/m24-0875 · Cited by 2
Tcherni‐Buzzeo, M. (2023) · Journal of Developmental and Life-Course Criminology · doi:10.1007/s40865-023-00223-4 · Cited by 1
O'Neil, M. E., Cameron, D., Krushnic, D., Baker‐Robinson, W., Hannon, S. A., Clauss, K. E., Cheney, T. P., Cook, L. J., Niederhausen, M., & Pugh, M. J. (2024) · Applied Neuropsychology Adult · doi:10.1080/23279095.2024.2401974 · Cited by 3
“…in the FITBIR database which were reviewed for relevance and inclusion, in a manner akin to an individual participant level data systematic review, but limited to studies contained in the FITBIR database (Cooper & Patall, 2009; Simmonds et al., 2015; Stewart & Tierney, 2002; Tierney et al., 2022).”
Stannah, J., Knight, J., Sandfort, T. G. M., Laurent, C., Otieno, F., Larmarange, J., Coulaud, P.-J., Mudhune, V., Hamilton, E. L., Cummings, V., et al. (2025) · AIDS and Behavior · doi:10.1007/s10461-025-04799-4 · Cited by 1
Yang, L., Llanos‐Paez, C., Yang, S., Ambery, C. L., Berges, A., Kjellsson, M. C., & Karlsson, M. O. (2025) · CPT Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.70059 · Cited by 1
“Compared to using AD alone, the inclusion of IPD has been reported to have benefits in improving ecological inference [2] and parameter estimation [3–5].”
Meta-analysis shows a malleable rightward bias in the expectations of objects in space
Zhao, Z. L., Pike, E., Deouell, L. Y., Lin, C., & Garrido, M. I. (2025) · Scientific Reports · doi:10.1038/s41598-025-04590-4 · Cited by 1
“Given this, an individual participant data (IPD) or retrospective pooled analysis was selected as the most appropriate meta-analytic method 30,31 .”
Titensor, S., Ebbert, J. L., Corte, K. W. D., & Corte, D. D. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02645-8 · Cited by 2
“In the absence of raw participant-level data, researchers—especially those conducting meta-analy-ses—frequently rely on these figures and reported effect measures as the only available representation of a study’s time-dependent outcomes [10–14].”
Focusing on Inclusion (vs. Leadership) Boosts Gender Bias Recognition and Intended Action
Bergsieker, H. B., Trickey, J., Jansen, E. J., Huynh, A. C., & Schmader, T. (2025) · Journal of Applied Social Psychology · doi:10.1111/jasp.70037 · Cited by 1
Including Individual Participant Data in Meta-analysis
Pigott, T. (2011) · Springer eBooks · doi:10.1007/978-1-4614-2278-5_8 · Cited by 1
A Practical Guide to Interpret Individual Participant Data Meta-analysis of Observational Studies
Ballew, S. H., Mok, Y., & Matsushita, K. (2021) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2021.02.333 · Cited by 2
Secondary Analysis of Individual Patient-Level Clinical Trial Data: A Primer
Kim, D. (2021) · Munich studies on innovation and competition · doi:10.1007/978-3-030-86778-2_3 · Cited by 1
Sweet, D. M., Quigley‐McBride, A., Meissner, C. A., & Ringstad, K. (2022) · Criminal Justice and Behavior · doi:10.1177/00938548221140360 · Cited by 1
“The approach is conceptually similar to a meta-analysis, but rather than analyzing the results of similar studies to estimate an overall effect, a megaanalysis pools the raw data from exact or conceptual replications of studies to arrive at an aggregate estimate of effects (Cooper & Patall, 2009).”
MethodBeh, E. J., Tran, D., & Hudson, I. L. (2023) · Metrika · doi:10.1007/s00184-023-00919-z · Cited by 1
“Likewise for the growing areas of synthetic studies in general (Sutton et al. 2008; Cooper and Patall 2009), and specifically for drug discovery cheminformatics (Zafar et al. 2013) and importantly for climate change meta-analytic studies, as reviewed by Hudson (2011) within the framework of…”
Inspiratory Muscle Training in Chronic Obstructive Pulmonary Disease Patients: A Scoping Review
Safei, I., & Zulfahmidah, Z. (2023) · Green Medical Journal · doi:10.33096/gmj.v5i2.144 · Cited by 3
“If patients are not chosen at random from the same population, which is difficult to verify, inferences from the research to the patient level may be misleading.(30) This reasoning supports the validity of those findings, as does the large sample size of our study.”
Marçal, I. R., de Abreu, R. M., Cornelis, N., Leicht, A. S., Forjaz, C. L. M., Cucato, G. G., Brenner, I., Novaković, M., Ritti‐Dias, R. M., Ciolac, E. G., et al. (2023) · Journal of Vascular Nursing · doi:10.1016/j.jvn.2023.09.002 · Cited by 5
Rejoinder to the discussion on “Bayesian meta-analysis of penetrance for cancer risk”
Ruberu, T. L. M., Braun, D., Parmigiani, G., & Biswas, S. (2024) · Biometrics · doi:10.1093/biomtc/ujae040 · Cited by 1
Green, K. (2013) · ScholarsArchive (Brigham Young University) · Cited by 1
Idris, N. R. N., & Misran, N. A. (2015) · Journal of Applied Sciences · doi:10.3923/jas.2015.1231.1238 · Cited by 1
Idris, N. R. N., & Misran, N. A. (2015) · Modern Applied Science · doi:10.5539/mas.v9n13p237 · Cited by 1
The relationship between satisfaction, motivation, and caseload and teacher retention
Hawks, C. R. (2016) · Digital Commons (Liberty University) · Cited by 1
The Motivational Benefits and Limits of Choice
Patall, E. A. (2009) · DukeSpace (Duke University) · Cited by 2
Self-citationDavis, S. M. (2018) · The Research Repository @ WVU (West Virginia University) · doi:10.33915/etd.5448
Francis, Z. L., Milyavskaya, M., Lin, H., & Inzlicht, M. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/xcnfk · Cited by 2
Metadata
- Authors
- Cooper, H., & Patall, E. A.
- Affiliations
- Duke University (US)
- Venue
- Psychological Methods
- Published
- 2009
- Volume
- 14
- Issue
- 2
- Pages
- 165-176
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2003323761
- Semantic Scholar
- ea908786103694ec9857ffd3dd31530573436cdc
- Cited by
- 339
- References
- 43
- Citations by year
- 2026: 10 · 2025: 25 · 2024: 18 · 2023: 21 · 2022: 30 · 2021: 22 · 2020: 22 · 2019: 20 · 2018: 24 · 2017: 16 · 2016: 26 · 2015: 32 · 2014: 17 · 2013: 16 · 2012: 14
- FWCI
- 16.13
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- individual patient data, aggregated data, meta-analysis, subgroup analysis, ecological fallacy, Simpson's paradox, causal inference, effect size, data availability
- MeSH terms
- Data Collection, Data Interpretation, Statistical, Humans, Meta-Analysis as Topic, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.