Differences in Overlapping Meta-Analyses of Vitamin D Supplements and Falls
The DOI matches its Crossref record; 50 of the 51 references it cites were found in a registry or an index.
Abstract
CONTEXT: Overlapping meta-analyses on the same topic are common and often report discordant results. An Endocrine Society (ES) meta-analysis reported that vitamin D with calcium reduced the risk of falls, whereas vitamin D monotherapy had no effect. Despite meta-analyzing an overlapping set of trials, we concluded that vitamin D with or without calcium had no effect on falls. OBJECTIVE: The objective of the study was to determine the reasons for the different conclusions from the two meta-analyses. METHODS: We extracted raw data from the 25 randomized controlled trials included in the ES meta-analysis, calculated the treatment effect for each trial, compared them with the published ES meta-analysis, and determined the reason for any differences. RESULTS: Of the 25 trials, there were differences in 14 results (56%) between the two meta-analyses. In the ES meta-analysis, data were used from a subset of falls or participants (four trials), from trial completers (three trials), or were imputed from fracture data (one trial). Other differences resulted from use of adjusted results from original papers (two trials), differences in incorporating data from multiarm and factorial studies (three trials), and inconsistent group numbers reported in original papers (two trials). In a reanalysis of the ES meta-analysis using unadjusted analyses and all randomized participants, there was a marginal effect of vitamin D with or without calcium on falls [relative risk (RR) 0.95, 95% confidence interval (CI) 0.90-1.00], with the subgroup analysis showing no effect of vitamin D monotherapy (RR 1.00, 95% CI 0.92-1.08) or vitamin D with calcium vs the placebo/controls (RR 0.95, 95% CI 0.88-1.02), but a modest effect of vitamin D with calcium vs calcium (RR 0.84, 95% CI 0.76-0.92) was shown. CONCLUSIONS: Methodological differences in utilizing data from the same trials directly led to substantially different conclusions between meta-analyses about the efficacy of vitamin D supplements on falls. More detailed reporting of meta-analyses is necessary to allow readers to understand the discordant results from overlapping meta-analyses.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Two non-statistical methods for resolving overlap in primary studies were identified in the MOoR framework: Select the result of one (or a subset of) systematic reviews with or without meta-analysis using a decision rule or a published algorithm [39–41]Identify systematic reviews with or without meta-analysis with 25% or more of their research in common and eliminate the one with the fewer studies”
From Managing overlap of primary study results across systematic reviews: practical considerations for authors of overviews of reviews (2021) · cites this paper as [41]
Citations
Cites
1 retracted
Sato, Y., Iwamoto, J., Kanoko, T., & Satoh, K. (2005) · Cerebrovascular Diseases · doi:10.1159/000087203 · Cited by 410
RetractedCochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Holick, M. F., Binkley, N. C., Bischoff-Ferrari, H. A., Gordon, C. M., Hanley, D. A., Heaney, R. P., Murad, M. H., & Weaver, C. M. (2011) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2011-0385 · Cited by 10,538
Cochrane Handbook for Systematic Reviews of Interventions
Higgins, J. P. T., Green, S., & Ben Van Den, A. (2020) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2020.15.2.123 · Cited by 5,670
Interventions for preventing falls in older people living in the community
Gillespie, L. D., Robertson, M. C., Gillespie, W. J., Sherrington, C., Gates, S., Clemson, L., & Lamb, S. E. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007146.pub3 · Cited by 3,966
Vitamin D3and Calcium to Prevent Hip Fractures in Elderly Women
Chapuy, M. C., Arlot, M. E., Duboeuf, F., Brun, J., Crouzet, B., Arnaud, S., Delmas, P. D., & Meunier, P. J. (1992) · New England Journal of Medicine · doi:10.1056/nejm199212033272305 · Cited by 2,950
Dietary Reference Intakes for Calcium and Vitamin D
(2018) · Pediatric Clinical Practice Guidelines & Policies · doi:10.1542/9781610021494-part06-dietary_reference_int · Cited by 2,709
Dietary Reference Intakes for Calcium and Vitamin D
(2011) · National Academies Press eBooks · doi:10.17226/13050 · Cited by 2,551
Sanders, K. M., Stuart, A. L., Williamson, E. J., Simpson, J. A., Kotowicz, M. A., Young, D., & Nicholson, G. C. (2010) · JAMA · doi:10.1001/jama.2010.594 · Cited by 1,381
Bischoff-Ferrari, H. A., Dawson-Hughes, B., Staehelin, H. B., Orav, J. E., Stuck, A. E., Theiler, R., Wong, J. B., Egli, A., Kiel, D. P., & Henschkowski, J. (2009) · BMJ · doi:10.1136/bmj.b3692 · Cited by 1,280
Trivedi, D. P., Doll, R., & Khaw, K. T. (2003) · BMJ · doi:10.1136/bmj.326.7387.469 · Cited by 1,270
Effects of Vitamin D and Calcium Supplementation on Falls: A Randomized Controlled Trial
Bischoff, H. A., Stähelin, H. B., Dick, W., Akos, R., Knecht, M., Salis, C., Nebiker, M., Theiler, R., Pfeifer, M., Begerow, B., et al. (2003) · Journal of Bone and Mineral Research · doi:10.1359/jbmr.2003.18.2.343 · Cited by 980
Interventions for preventing falls in older people in care facilities and hospitals
Cameron, I. D., Gillespie, L. D., Robertson, M. C., Murray, G. R., Hill, K. D., Cumming, R. G., & Kerse, N. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005465.pub3 · Cited by 928
Falls in the Elderly: A Prospective Study of Risk Factors and Risk Profiles
Graafmans, W. C., Ooms, M. E., Hofstee, H. M. A., Bezemer, P. D., Bouter, L. M., & Lips, P. (1996) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a008690 · Cited by 788
Interventions for preventing falls in older people in nursing care facilities and hospitals
Cameron, I. D., Murray, G. R., Gillespie, L. D., Robertson, M. C., Hill, K. D., Cumming, R. G., & Kerse, N. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005465.pub2 · Cited by 682
Stress Ulcer Prophylaxis in Critically III Patients: Resolving Discordant Meta-analyses
Cook, D. J. (1996) · JAMA · doi:10.1001/jama.1996.03530280060038 · Cited by 608
Guidelines for Preventing and Treating Vitamin D Deficiency and Insufficiency Revisited
Holick, M. F., Binkley, N. C., Bischoff-Ferrari, H. A., Gordon, C. M., Hanley, D. A., Heaney, R. P., Murad, M. H., & Weaver, C. M. (2012) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2011-2601 · Cited by 596
Pfeifer, M., Begerow, B., Minne, H. W., Abrams, C., Nachtigall, D., & Hansen, C. (2000) · Journal of Bone and Mineral Research · doi:10.1359/jbmr.2000.15.6.1113 · Cited by 591
IOM Committee Members Respond to Endocrine Society Vitamin D Guideline
Rosen, C. J., Abrams, S. A., Aloia, J. F., Brannon, P. M., Clinton, S. K., Durazo-Arvizu, R. A., Gallagher, J. C., Gallo, R. L., Jones, G., Kovacs, C. S., et al. (2012) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2011-2218 · Cited by 591
Interventions for preventing falls in older people in care facilities and hospitals
Cameron, I. D., Dyer, S. M., Panagoda, C. E., Murray, G. R., Hill, K. D., Cumming, R. G., & Kerse, N. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005465.pub4 · Cited by 555
Chapuy, M. C., Pamphile, R., Paris, E., Kempf, C., Schlichting, M., Arnaud, S., Garnero, P., Garnero, P., & Meunier, P. J. (2002) · Osteoporosis International · doi:10.1007/s001980200023 · Cited by 549
Porthouse, J., Cockayne, S., King, C., Saxon, L., Steele, E., Aspray, T., Baverstock, M., Birks, Y., Dumville, J., Francis, R., et al. (2005) · BMJ · doi:10.1136/bmj.330.7498.1003 · Cited by 535
Pfeifer, M., Begerow, B., Minne, H. W., Suppan, K., Fahrleitner-Pammer, A., & Dobnig, H. (2009) · Osteoporosis International · doi:10.1007/s00198-008-0662-7 · Cited by 510
Latham, N. K., Anderson, C. S., Lee, A., Bennett, D. A., Moseley, A., Cameron, I. D., & For The Fitness Collaborative Group (2003) · Journal of the American Geriatrics Society · doi:10.1046/j.1532-5415.2003.51101.x · Cited by 463
Broe, K. E., Chen, T. C., Weinberg, J., Bischoff‐Ferrari, H. A., Holick, M. F., & Kiel, D. P. (2007) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2007.01048.x · Cited by 424
Vitamin D supplementation improves neuromuscular function in older people who fall
Dhesi, J. K. (2004) · Age and Ageing · doi:10.1093/ageing/afh209 · Cited by 411
Smith, H., Anderson, F., Raphael, H., Maslin, P., Crozier, S., & Cooper, C. (2007) · Rheumatology · doi:10.1093/rheumatology/kem240 · Cited by 400
The Effect of Vitamin D on Falls: A Systematic Review and Meta-Analysis
Murad, M. H., Elamin, K. B., Abu Elnour, N. O., Elamin, M. B., Alkatib, A. A., Fatourechi, M. M., Almandoz, J. P., Mullan, R. J., Lane, M. A., Liu, H., et al. (2011) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2011-1193 · Cited by 390
Michael, Y. L., Whitlock, E. P., Lin, J. S., Fu, R., O'Connor, E. A., & Gold, R. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-153-12-201012210-00008 · Cited by 309
Flicker, L., MacInnis, R. J., Stein, M. S., Scherer, S. C., Mead, K. E., Nowson, C. A., Thomas, J., Lowndes, C., Hopper, J. L., & Wark, J. D. (2005) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2005.00468.x · Cited by 305
Overlapping meta-analyses on the same topic: survey of published studies
Siontis, K. C., Hernandez-Boussard, T., & Ioannidis, J. P. A. (2013) · BMJ · doi:10.1136/bmj.f4501 · Cited by 248
Bischoff-Ferrari, H. A., Orav, E. J., & Dawson-Hughes, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.4.424 · Cited by 246
Harwood, R. H., Sahota, O., Gaynor, K., Masud, T., & Hosking, D. J. (2004) · Age and Ageing · doi:10.1093/ageing/afh002 · Cited by 225
Witham, M. D., Crighton, L. J., Gillespie, N. D., Struthers, A. D., & McMurdo, M. E. T. (2010) · Circulation Heart Failure · doi:10.1161/circheartfailure.109.907899 · Cited by 224
Effects of Ergocalciferol Added to Calcium on the Risk of Falls in Elderly High-Risk Women
Prince, R. L. (2008) · Archives of Internal Medicine · doi:10.1001/archinternmed.2007.31 · Cited by 215
Law, M., Withers, H., Morris, J., & Anderson, F. (2006) · Age and Ageing · doi:10.1093/ageing/afj080 · Cited by 191
Bischoff-Ferrari, H. A. (2006) · Archives of Internal Medicine · doi:10.1001/.424 · Cited by 159
Vitamin D supplementation and falls: a trial sequential meta-analysis
Bolland, M. J., Grey, A., Gamble, G. D., & Reid, I. R. (2014) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(14)70068-3 · Cited by 158
Self-citationVitamin D and Calcium to Prevent Hip Fractures in Elderly Women
Chapuy, M. C., ARLOT, M. E., Duboeuf, F., Brun, J., Crouzet, B., Arnaud, S. B., Delmas, P. D., & Meunier, P. J. (1993) · The Endocrinologist · doi:10.1097/00019616-199303000-00021 · Cited by 145
Vitamin D3 and Calcium to Prevent Hip Fractures in Elderly Women
CHAPUY, M. C., ARLOT, M. E., DUBOEUF, F., BRUN, J., CROUZET, B., ARNAUD, S., DELMAS, P. D., & MEUNIER, P. J. (1993) · Obstetrical & Gynecological Survey · doi:10.1097/00006254-199305000-00026 · Cited by 107
Poolman, R. W., Abouali, J. A. K., Conter, H. J., & Bhandari, M. (2007) · The Journal of Bone & Joint Surgery · doi:10.2106/jbjs.f.01292 · Cited by 96
Campbell, J., Bellamy, N., & Gee, T. (2007) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2007.01.022 · Cited by 93
Does vitamin D stop inpatients falling? A randomised controlled trial
Burleigh, E., McColl, J., & Potter, J. (2007) · Age and Ageing · doi:10.1093/ageing/afm087 · Cited by 77
Berggren, M., Stenvall, M., Olofsson, B., & Gustafson, Y. (2007) · Osteoporosis International · doi:10.1007/s00198-007-0507-9 · Cited by 75
Kärkkäinen, M., Tuppurainen, M. T., Salovaara, K., Sandini, L., Rikkonen, T., Sirola, J. P., Honkanen, R., Arokoski, J. P., Alhava, E. M., & Kröger, H. (2010) · Maturitas · doi:10.1016/j.maturitas.2009.12.018 · Cited by 63
Larsen, E. R., Mosekilde, L., & Foldspang, A. (2005) · Aging Clinical and Experimental Research · doi:10.1007/bf03324585 · Cited by 62
Thorlund, K., Druyts, E., Aviña-Zubieta, J. A., Wu, P., & Mills, E. J. (2012) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2012-201574 · Cited by 44
Hernández, A. V., Walker, E., Ioannidis, J. P. A., & Kattan, M. W. (2008) · American Heart Journal · doi:10.1016/j.ahj.2008.03.002 · Cited by 40
Morrey, B. F. (2008) · Yearbook of Orthopedics · doi:10.1016/s0276-1092(08)79270-8 · Cited by 27
Cited by
Bolland, M. J., Grey, A., & Avenell, A. (2018) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(18)30265-1 · Cited by 436
Self-citationGuirguis-Blake, J. M., Michael, Y. L., Perdue, L. A., Coppola, E. L., & Beil, T. L. (2018) · JAMA · doi:10.1001/jama.2017.21962 · Cited by 400
Rationale and Plan for Vitamin D Food Fortification: A Review and Guidance Paper
Pilz, S., März, W., Cashman, K. D., Kiely, M. E., Whiting, S. J., Holick, M. F., Grant, W. B., Pludowski, P., Hiligsmann, M., Trummer, C., et al. (2018) · Frontiers in Endocrinology · doi:10.3389/fendo.2018.00373 · Cited by 360
Beck, B. R., Daly, R. M., Singh, M. A. F., & Taaffe, D. R. (2017) · Journal of Science and Medicine in Sport · doi:10.1016/j.jsams.2016.10.001 · Cited by 366
“Whether vitamin D supplementation will prevent falls or fracture is controversial 75 .”
Vitamin D and cardiovascular disease prevention
Pilz, S., Verheyen, N., Grübler, M. R., Tomaschitz, A., & März, W. (2016) · Nature Reviews Cardiology · doi:10.1038/nrcardio.2016.73 · Cited by 326
Metadata
- Authors
- Bolland, M. J., Grey, A., & Reid, I. R.
- Affiliations
- University of Auckland (NZ)
- Corresponding author
- Bolland, Mark J.
- Venue
- The Journal of Clinical Endocrinology & Metabolism
- Publisher
- The Endocrine Society
- Published
- 2014-11
- Volume
- 99
- Issue
- 11
- Pages
- 4265-4272
- ISSN
- 0021-972X (ISSN-L)
- 1945-7197
- OpenAlex
- W2000719274
- Cited by
- 49
- References
- 51
- Citations by year
- 2026: 1 · 2023: 3 · 2021: 5 · 2020: 2 · 2019: 1 · 2018: 11 · 2017: 6 · 2016: 9 · 2015: 9 · 2014: 2
- FWCI
- 6.44
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Journal of Clinical Endocrinology & Metabolism (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Health Research Council of New Zealand
- Faculty of Medical and Health Sciences, University of Auckland
- Topics
- Health Sciences › Medicine › Endocrinology, Diabetes and Metabolism › Vitamin D Research Studies
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › Physical Therapy, Sports Therapy and Rehabilitation › Balance, Gait, and Falls Prevention
- Keywords
- vitamin D supplements, falls, calcium supplementation, meta-analysis methodology, missing data imputation, subgroup analysis, meta-analysis reporting quality, fracture prevention
- MeSH terms
- Accidental Falls, Calcium, Humans, Risk Factors, Vitamin D, Vitamins, Meta-Analysis as Topic, Dietary Supplements, Fractures, Bone
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.