Differences in Overlapping Meta-Analyses of Vitamin D Supplements and Falls
The DOI matches its Crossref record; 50 of the 51 references it cites were found in a registry or an index.
Abstract
CONTEXT: Overlapping meta-analyses on the same topic are common and often report discordant results. An Endocrine Society (ES) meta-analysis reported that vitamin D with calcium reduced the risk of falls, whereas vitamin D monotherapy had no effect. Despite meta-analyzing an overlapping set of trials, we concluded that vitamin D with or without calcium had no effect on falls. OBJECTIVE: The objective of the study was to determine the reasons for the different conclusions from the two meta-analyses. METHODS: We extracted raw data from the 25 randomized controlled trials included in the ES meta-analysis, calculated the treatment effect for each trial, compared them with the published ES meta-analysis, and determined the reason for any differences. RESULTS: Of the 25 trials, there were differences in 14 results (56%) between the two meta-analyses. In the ES meta-analysis, data were used from a subset of falls or participants (four trials), from trial completers (three trials), or were imputed from fracture data (one trial). Other differences resulted from use of adjusted results from original papers (two trials), differences in incorporating data from multiarm and factorial studies (three trials), and inconsistent group numbers reported in original papers (two trials). In a reanalysis of the ES meta-analysis using unadjusted analyses and all randomized participants, there was a marginal effect of vitamin D with or without calcium on falls [relative risk (RR) 0.95, 95% confidence interval (CI) 0.90-1.00], with the subgroup analysis showing no effect of vitamin D monotherapy (RR 1.00, 95% CI 0.92-1.08) or vitamin D with calcium vs the placebo/controls (RR 0.95, 95% CI 0.88-1.02), but a modest effect of vitamin D with calcium vs calcium (RR 0.84, 95% CI 0.76-0.92) was shown. CONCLUSIONS: Methodological differences in utilizing data from the same trials directly led to substantially different conclusions between meta-analyses about the efficacy of vitamin D supplements on falls. More detailed reporting of meta-analyses is necessary to allow readers to understand the discordant results from overlapping meta-analyses.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Two non-statistical methods for resolving overlap in primary studies were identified in the MOoR framework: Select the result of one (or a subset of) systematic reviews with or without meta-analysis using a decision rule or a published algorithm [39–41]Identify systematic reviews with or without meta-analysis with 25% or more of their research in common and eliminate the one with the fewer studies”
From Managing overlap of primary study results across systematic reviews: practical considerations for authors of overviews of reviews (2021) · cites this paper as [41]
Citations
Cites
1 retracted
Sato, Y., Iwamoto, J., Kanoko, T., & Satoh, K. (2005) · Cerebrovascular Diseases · doi:10.1159/000087203 · Cited by 410
RetractedCochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Holick, M. F., Binkley, N. C., Bischoff-Ferrari, H. A., Gordon, C. M., Hanley, D. A., Heaney, R. P., Murad, M. H., & Weaver, C. M. (2011) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2011-0385 · Cited by 10,538
Cochrane Handbook for Systematic Reviews of Interventions
Higgins, J. P. T., Green, S., & Ben Van Den, A. (2020) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2020.15.2.123 · Cited by 5,670
Interventions for preventing falls in older people living in the community
Gillespie, L. D., Robertson, M. C., Gillespie, W. J., Sherrington, C., Gates, S., Clemson, L., & Lamb, S. E. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007146.pub3 · Cited by 3,966
Vitamin D3and Calcium to Prevent Hip Fractures in Elderly Women
Chapuy, M. C., Arlot, M. E., Duboeuf, F., Brun, J., Crouzet, B., Arnaud, S., Delmas, P. D., & Meunier, P. J. (1992) · New England Journal of Medicine · doi:10.1056/nejm199212033272305 · Cited by 2,950
Dietary Reference Intakes for Calcium and Vitamin D
(2018) · Pediatric Clinical Practice Guidelines & Policies · doi:10.1542/9781610021494-part06-dietary_reference_int · Cited by 2,709
Dietary Reference Intakes for Calcium and Vitamin D
(2011) · National Academies Press eBooks · doi:10.17226/13050 · Cited by 2,551
Sanders, K. M., Stuart, A. L., Williamson, E. J., Simpson, J. A., Kotowicz, M. A., Young, D., & Nicholson, G. C. (2010) · JAMA · doi:10.1001/jama.2010.594 · Cited by 1,381
Bischoff-Ferrari, H. A., Dawson-Hughes, B., Staehelin, H. B., Orav, J. E., Stuck, A. E., Theiler, R., Wong, J. B., Egli, A., Kiel, D. P., & Henschkowski, J. (2009) · BMJ · doi:10.1136/bmj.b3692 · Cited by 1,280
Cited by
Bolland, M. J., Grey, A., & Avenell, A. (2018) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(18)30265-1 · Cited by 436
Self-citationGuirguis-Blake, J. M., Michael, Y. L., Perdue, L. A., Coppola, E. L., & Beil, T. L. (2018) · JAMA · doi:10.1001/jama.2017.21962 · Cited by 400
Rationale and Plan for Vitamin D Food Fortification: A Review and Guidance Paper
Pilz, S., März, W., Cashman, K. D., Kiely, M. E., Whiting, S. J., Holick, M. F., Grant, W. B., Pludowski, P., Hiligsmann, M., Trummer, C., et al. (2018) · Frontiers in Endocrinology · doi:10.3389/fendo.2018.00373 · Cited by 360
Beck, B. R., Daly, R. M., Singh, M. A. F., & Taaffe, D. R. (2017) · Journal of Science and Medicine in Sport · doi:10.1016/j.jsams.2016.10.001 · Cited by 366
“Whether vitamin D supplementation will prevent falls or fracture is controversial 75 .”
Vitamin D and cardiovascular disease prevention
Pilz, S., Verheyen, N., Grübler, M. R., Tomaschitz, A., & März, W. (2016) · Nature Reviews Cardiology · doi:10.1038/nrcardio.2016.73 · Cited by 326
Vitamin D testing and treatment: a narrative review of current evidence
Pilz, S., Zittermann, A., Trummer, C., Theiler-Schwetz, V., Lerchbaum, E., Keppel, M. H., Grübler, M. R., März, W., & Pandis, M. (2019) · Endocrine Connections · doi:10.1530/ec-18-0432 · Cited by 276
“Regarding the effects of vitamin D supplementation on falls and fractures, the current meta-analyses of RCTs draw inconsistent conclusions with either a neutral or a small beneficial effect (46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57).”
BackgroundLunny, C., Pieper, D., Thabet, P., & Kanji, S. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01269-y · Cited by 252
Khaw, K.-T., Stewart, A. W., Waayer, D., Lawes, C. M. M., Toop, L., Camargo, C. A., & Scragg, R. (2017) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(17)30103-1 · Cited by 210
Lunny, C., Brennan, S. E., McDonald, S., & McKenzie, J. E. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0617-1 · Cited by 184
“1 Extract all data, recording discrepancies Becker 2008 [1]; Bolland 2014 [30]; Caird 2015 [31]; Kovacs 2014 [42]; Pieper 2012 [6, 45]; Pieper 2014 [46]; Smith 2011 [57]; Thomson 2010 [58] 2.”
BackgroundInfluentialGlucocorticoid-induced osteoporosis: who to treat with what agent?
Rizzoli, R., & Biver, E. (2015) · Nature Reviews Rheumatology · doi:10.1038/nrrheum.2014.188 · Cited by 165
Smith, L. M., Gallagher, J. C., & Suiter, C. (2017) · The Journal of Steroid Biochemistry and Molecular Biology · doi:10.1016/j.jsbmb.2017.03.015 · Cited by 152
“In a later meta-analysis discrepancies in results were analyzed further and showed that selection of subjects and the use of raw data or imputed data could cause issues in interpretation (13).”
Stubbs, B., Brefka, S., & Denkinger, M. D. (2015) · Physical Therapy · doi:10.2522/ptj.20140461 · Cited by 140
Tessier, A.-J., & Chevalier, S. (2018) · Nutrients · doi:10.3390/nu10081099 · Cited by 132
“However, due to substantial differences in selection criteria between meta-analyses [93], conflicting results remain.”
Lunny, C., Brennan, S. E., McDonald, S., & McKenzie, J. E. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0784-8 · Cited by 139
“…SRs§ 1.1 Determine how to assess RoB in the included SRs 1.1.1 Select an existing RoB assessment tool for SRs Baker 2014 [43]; Becker 2008 [4]; Bolland 2014 [5]; Büchter 2011 [45, 65]; Caird 2015 [1]; Chen 2014 [46]; CMIMG 2012 [47]; Cooper 2012 [6]; Flodgren 2011 [49]; Foisy 2011 [50];…”
InfluentialNew horizons in falls prevention
Lord, S. R., & Close, J. (2018) · Age and Ageing · doi:10.1093/ageing/afy059 · Cited by 94
Vitamin-D concentrations, cardiovascular risk and events - a review of epidemiological evidence
Grübler, M. R., März, W., Pilz, S., Grammer, T. B., Trummer, C., Müllner, C., Theiler‐Schwetz, V., Pandis, M., Verheyen, N., Tomaschitz, A., et al. (2017) · Reviews in Endocrine and Metabolic Disorders · doi:10.1007/s11154-017-9417-0 · Cited by 82
Vitamin D status and hypertension: a review
Brock, K. E., Ke, L., Mason, R. S., Kariuki, M., & Mpofu, E. (2015) · Integrated Blood Pressure Control · doi:10.2147/ibpc.s49958 · Cited by 72
“The other authors report no conflict of interest in this work.”
Vitamin D and falls — the dosage conundrum
Gallagher, J. C. (2016) · Nature Reviews Endocrinology · doi:10.1038/nrendo.2016.123 · Cited by 66
Should we prescribe calcium or vitamin D supplements to treat or prevent osteoporosis?
Bolland, M. J., Grey, A. B., & Reid, I. R. (2015) · Climacteric · doi:10.3109/13697137.2015.1098266 · Cited by 57
Self-citationPilz, S., Grübler, M. R., Gaksch, M., Theiler‐Schwetz, V., Trummer, C., Hartaigh, B. Ó., Verheyen, N., Tomaschitz, A., & März, W. (2016) · Pure Amsterdam UMC · Cited by 58
Cummings, S. R., Kiel, D. P., & Black, D. M. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2015.7568 · Cited by 41
Should adults take vitamin D supplements to prevent disease?
Bolland, M. J., Avenell, A., & Grey, A. B. (2016) · BMJ · doi:10.1136/bmj.i6201 · Cited by 34
Self-citationBeneficial Effects of UV-Radiation: Vitamin D and beyond
Trummer, C., Pandis, M., Verheyen, N., Grübler, M. R., Gaksch, M., Obermayer-Pietsch, B. M., Tomaschitz, A., Pieber, T. R., Pilz, S., & Theiler‐Schwetz, V. (2016) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph13101028 · Cited by 36
Prediction of insufficient serum vitamin D status in older women: a validated model
Merlijn, T., Swart, K. M. A., Lips, P. T. A. M., Heymans, M. W., Sohl, E., van Schoor, N. M., Netelenbos, J. C., & Elders, P. J. M. (2018) · Osteoporosis International · doi:10.1007/s00198-018-4410-3 · Cited by 27
Vitamin D in preventive medicine.
Pilz, S., Gaksch, M., Hartaigh, B. Ó., Tomaschitz, A., & März, W. (2015) · PubMed · Cited by 27
Massé, O., Mercurio, C. M., Dupuis, S., Sahwi, M. A., Arruda, A., Dallaire, G., Desforges, K., Dugré, N., & Williamson, D. R. (2026) · BMJ · doi:10.1136/bmj-2025-088050 · Cited by 24
Association between vitamin D status and long‐term falls‐related hospitalization risk in older women
Sim, M., Zhu, K., Lewis, J. R., Hodgson, J. M., & Prince, R. L. (2021) · Journal of the American Geriatrics Society · doi:10.1111/jgs.17442 · Cited by 20
“Such results may be attributed to methodological issues relating to data extraction and study inclusion criteria.(39,40) Nonetheless, similar to our findings, better physical function has also been associated with higher 25OHD levels.”
ResultVitamin D Megadose: Definition, Efficacy in Bone Metabolism, Risk of Falls and Fractures
Narvaez, J., Maldonado, G., Guerrero, R., Messina, O. D., & Ríos, C. (2020) · Open Access Rheumatology Research and Reviews · doi:10.2147/oarrr.s252245 · Cited by 22
Penner, J., Ferrand, R. A., Richards, C., Ward, K. A., Burns, J. E., & Gregson, C. L. (2018) · PLoS ONE · doi:10.1371/journal.pone.0207022 · Cited by 18
The vitamin D and calcium controversy: an update
Lewis, J. R., Sim, M., & Daly, R. M. (2018) · Current Opinion in Rheumatology · doi:10.1097/bor.0000000000000584 · Cited by 16
Calcium supplements do not prevent fractures
Michaëlsson, K. (2015) · BMJ · doi:10.1136/bmj.h4825 · Cited by 16
Burt, L. A., Gabel, L., Billington, E. O., Hanley, D. A., & Boyd, S. K. (2020) · Nutrients · doi:10.3390/nu12020527 · Cited by 11
“For example, vitamin D combined with calcium supplementation reduced the risk of falls [27], while vitamin D with or without calcium had no effect on falls [28].”
BackgroundSystematic Reviews and Meta‐Analysis
Crombie, I. (2021) · Wiley eBooks · doi:10.1002/9781394322183.ch5 · Cited by 9
Replication of systematic reviews: is it to the benefit or detriment of methodological quality?
Chapelle, C., Ollier, É., Bonjean, P., Locher, C., Zufferey, P. J., Cucherat, M., & Laporte, S. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.08.012 · Cited by 8
Inconsistent data in text and tables
Bolland, M. J., & Grey, A. B. (2015) · Osteoporosis International · doi:10.1007/s00198-015-3181-3 · Cited by 6
“Recently, we compared meta-analyses of vitamin D on falls and fractures [1, 2] and found that different meta-analysts had used different results from a trial by Pfeiffer and colleagues [3].”
ResultSelf-citationDifferent outcomes of meta-analyses and data inconsistency: response to comments by Pfeifer
Bolland, M. J., & Grey, A. B. (2015) · Archives of Osteoporosis · doi:10.1007/s11657-015-0247-y · Cited by 5
“reported that overlapping meta-analyses of vitamin D on falls and fractures often used different treatment effects from the same study, usually in favour of benefits for vitamin D [4, 5].”
ResultSelf-citationVitamin D testing and treatment: a narrative review of current evidence
Pilz, S., Zittermann, A., Trummer, C., Theiler‐Schwetz, V., Lerchbaum, E., Keppel, M. H., Grübler, M. R., März, W., & Pandis, M. (2021) · Laboratory Service · doi:10.17116/labs20211002155 · Cited by 5
Vitamin D Supplements and the Risk of Falls
Bolland, M. J., Grey, A. B., & Reid, I. R. (2015) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2015.3962 · Cited by 4
Self-citationAspray, T. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-802168-2.00005-1 · Cited by 3
Chapelle, C., Teuff, G. L., Zufferey, P. J., Laporte, S., & Ollier, É. (2023) · Research Synthesis Methods · doi:10.1002/jrsm.1676 · Cited by 3
Vitamin D supplements do not prevent falls
Bolland, M. J., Grey, A. B., & Reid, I. R. (2016) · BMJ · doi:10.1136/bmj.i3005 · Cited by 3
Self-citationAbrahamsen, B. (2017) · Maturitas · doi:10.1016/j.maturitas.2017.06.001 · Cited by 3
The Role of Vitamin D in Orthopedic Surgery
Unnanuntana, A., Dvorzhinskiy, A., Rebolledo, B. J., Doyle, S. M., Andreopoulou, P., & Lane, J. M. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809965-0.00056-2 · Cited by 2
Screening for Vitamin D Deficiency
Bolland, M. J., Grey, A. B., & Reid, I. R. (2015) · Annals of Internal Medicine · doi:10.7326/l15-5094
Self-citationRecomanacions nutricionals en el tractament amb corticoides
Llorens, M. P. (2015) · Dipòsit Digital de la Universitat de Barcelona (Universitat de Barcelona)
Vitamin D, Cardiovascular Disease, and Hypertension
Pilz, S. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-809963-6.00111-5
NÍVEIS SANGUÍNEOS DE VITAMINA D EM UMA POPULAÇÃO COM DOENÇA DE CROHN NO DISTRITO FEDERAL
do Nascimento, D. Á., Lourenço, S. M., & Tajra, J. B. M. (2018) · Programa de Iniciação Científica - PIC/UniCEUB - Relatórios de Pesquisa · doi:10.5102/pic.n2.2016.5605 · Cited by 1
The role of vitamin D in orthopedic surgery
Unnanuntana, A., Haseltine, K., Tutaworn, T., Dvorzhinskiy, A., & Lane, J. M. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-91386-7.00014-3
Lunny, C., Pieper, D., Thabet, P., & Kanji, S. (2021) · Figshare · doi:10.6084/m9.figshare.14926906
Metadata
- Authors
- Bolland, M. J., Grey, A., & Reid, I. R.
- Affiliations
- University of Auckland (NZ)
- Corresponding author
- Bolland, Mark J.
- Venue
- The Journal of Clinical Endocrinology & Metabolism
- Publisher
- The Endocrine Society
- Published
- 2014-11
- Volume
- 99
- Issue
- 11
- Pages
- 4265-4272
- ISSN
- 0021-972X (ISSN-L)
- 1945-7197
- OpenAlex
- W2000719274
- Cited by
- 49
- References
- 51
- Citations by year
- 2026: 1 · 2023: 3 · 2021: 5 · 2020: 2 · 2019: 1 · 2018: 11 · 2017: 6 · 2016: 9 · 2015: 9 · 2014: 2
- FWCI
- 6.44
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Journal of Clinical Endocrinology & Metabolism (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Health Research Council of New Zealand
- Faculty of Medical and Health Sciences, University of Auckland
- Topics
- Health Sciences › Medicine › Endocrinology, Diabetes and Metabolism › Vitamin D Research Studies
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › Physical Therapy, Sports Therapy and Rehabilitation › Balance, Gait, and Falls Prevention
- Keywords
- vitamin D supplements, falls, calcium supplementation, meta-analysis methodology, missing data imputation, subgroup analysis, meta-analysis reporting quality, fracture prevention
- MeSH terms
- Accidental Falls, Calcium, Humans, Risk Factors, Vitamin D, Vitamins, Meta-Analysis as Topic, Dietary Supplements, Fractures, Bone
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.