Evaluation of Complementary and Integrative Health Approaches Among US Veterans with Musculoskeletal Pain Using Propensity Score Methods
Open accessThe DOI matches its Crossref record; 40 of the 41 references it cites were found in a registry or an index.
Abstract
Objectives: To examine the treatment effectiveness of complementary and integrative health approaches (CIH) on chronic pain using Propensity Score (PS) methods. Design, Settings, and Participants: A retrospective cohort of 309,277 veterans with chronic musculoskeletal pain assessed over three years after initial diagnosis. Methods: CIH exposure was defined as one or more clinical visits for massage, acupuncture, or chiropractic care. The treatment effect of CIH on self-rated pain intensity was examined using a longitudinal model. PS-matching and inverse probability of treatment weighting (IPTW) were used to account for potential selection and confounding biases. Results: At baseline, veterans with (7,621) and without (301,656) CIH exposure differed significantly in 21 out of 35 covariates. During the follow-up period, on average CIH recipients had 0.83 (95% confidence interval [CI] = 0.77 to 0.89) points higher pain intensity ratings (range = 0-10) than nonrecipients. This apparent unfavorable effect size was reduced to 0.37 (95% CI = 0.28 to 0.45) after PS matching, 0.36 (95% CI = 0.29 to 0.44) with IPTW on the treated (IPTW-T) weighting, and diminished to null when integrating IPTW-T with PS matching (0.004, 95% CI = -0.09 to 0.10). An alternative IPTW model and conventional covariate adjustment appeared least powerful in terms of potential bias reduction. Sensitivity analyses restricting the follow-up period to one year after CIH initiation derived consistent results. Conclusions: PS-based causal methods successfully eliminated baseline difference between exposure groups in all measured covariates, yet they did not detect a significant difference in the self-rated pain intensity outcome between veterans who received CIHs and those who did not during the follow-up period.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Austin, P. C., & Stuart, E. A. (2015) · Statistics in Medicine · doi:10.1002/sim.6607 · Cited by 4,495
Generalized, Linear, and Mixed Models
McCulloch, C. E., & Searle, S. R. (2000) · Wiley Series in Probability and Statistics · doi:10.1002/0471722073 · Cited by 2,994
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score
Hirano, K., Imbens, G. W., & Ridder, G. (2003) · Econometrica · doi:10.1111/1468-0262.00442 · Cited by 2,355
Rubin, D. B. (2007) · Statistics in Medicine · doi:10.1002/sim.2739 · Cited by 1,047
Chou, R., & Huffman, L. H. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-7-200710020-00007 · Cited by 1,045
Acupuncture for Chronic Pain: Individual Patient Data Meta-analysis
Vickers, A. J., Cronin, A. M., Maschino, A. C., Lewith, G., MacPherson, H., Foster, N. E., Sherman, K. J., Witt, C. M., Linde, K., & Acupuncture Trialists' Collaboration, F. T. (2012) · Archives of Internal Medicine · doi:10.1001/archinternmed.2012.3654 · Cited by 985
Clarke, R., Shipley, M., Lewington, S., Youngman, L., Collins, R., Marmot, M., & Peto, R. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a010013 · Cited by 877
For objective causal inference, design trumps analysis
Rubin, D. B. (2008) · The Annals of Applied Statistics · doi:10.1214/08-aoas187 · Cited by 831
Harder, V. S., Stuart, E. A., & Anthony, J. C. (2010) · Psychological Methods · doi:10.1037/a0019623 · Cited by 802
Stürmer, T., Joshi, M., Glynn, R. J., Avorn, J., Rothman, K. J., & Schneeweiss, S. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.07.004 · Cited by 670
Lew, H. L., Otis, J. D., Tun, C., Kerns, R. D., Clark, M. E., & Cifu, D. X. (2009) · The Journal of Rehabilitation Research and Development · doi:10.1682/jrrd.2009.01.0006 · Cited by 655
Self-citationIndications for propensity scores and review of their use in pharmacoepidemiology
Glynn, R. J., Schneeweiss, S., & Stürmer, T. (2006) · Basic & Clinical Pharmacology & Toxicology · doi:10.1111/j.1742-7843.2006.pto_293.x · Cited by 541
Shah, B. R., Laupacis, A., Hux, J. E., & Austin, P. C. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.10.016 · Cited by 493
Austin, P. C. (2009) · Medical Decision Making · doi:10.1177/0272989x09341755 · Cited by 454
Austin, P. C. (2010) · Statistics in Medicine · doi:10.1002/sim.3854 · Cited by 356
Causality and causal inference in epidemiology: the need for a pluralistic approach
Vandenbroucke, J. P., Broadbent, A., & Pearce, N. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyv341 · Cited by 327
Stürmer, T., Wyss, R., Glynn, R. J., & Brookhart, M. A. (2014) · Journal of Internal Medicine · doi:10.1111/joim.12197 · Cited by 302
Furlan, A. D., Yazdi, F., Tsertsvadze, A., Gross, A., Van Tulder, M., Santaguida, L., Gagnier, J., Ammendolia, C., Dryden, T., Doucette, S., et al. (2012) · Evidence-Based Complementary and Alternative Medicine · doi:10.1155/2012/953139 · Cited by 270
Nahin, R. L., Boineau, R., Khalsa, P. S., Stussman, B. J., & Weber, W. J. (2016) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2016.06.007 · Cited by 250
Analysis of Observational Health Care Data Using SAS
Faries, D. E., Leon, A. C., Haro, J. M., & Obenchain, R. L. (2010) · Cited by 239
Causal Models and Learning from Data: Integrating Causal Modeling and Statistical Estimation
Petersen, M. L., & van der Laan, M. J. (2014) · Epidemiology · doi:10.1097/ede.0000000000000078 · Cited by 231
Kerns, R. D., Otis, J., Rosenberg, R., & Reid, M. C. (2003) · The Journal of Rehabilitation Research and Development · doi:10.1682/jrrd.2003.09.0371 · Cited by 224
Self-citationA Meta-Analysis of Acupuncture for Chronic Pain
PATEL, M., GUTZWILLER, F., PACCAUD, F., & MARAZZI, A. (1989) · International Journal of Epidemiology · doi:10.1093/ije/18.4.900 · Cited by 179
Otis, J. D., Keane, T. M., Kerns, R. D., Monson, C., & Scioli, E. (2009) · Pain Medicine · doi:10.1111/j.1526-4637.2009.00715.x · Cited by 178
Self-citationThe musculoskeletal diagnosis cohort: examining pain and pain care among veterans
Goulet, J. L., Kerns, R. D., Bair, M., Becker, W. C., Brennan, P., Burgess, D. J., Carroll, C. M., Dobscha, S., Driscoll, M. A., Fenton, B. T., et al. (2016) · Pain · doi:10.1097/j.pain.0000000000000567 · Cited by 174
Self-citationDo Users of Regularly Prescribed Opioids Have Higher Rates of Substance Use Problems Than Nonusers?
Edlund, M. J., Sullivan, M., Steffick, D., Harris, K. M., & Wells, K. B. (2007) · Pain Medicine · doi:10.1111/j.1526-4637.2006.00200.x · Cited by 152
Stepped Care for Back Pain: Activating Approaches for Primary Care
Von Korff, M., & Moore, J. C. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-9_part_2-200105011-00016 · Cited by 140
Implementation of the Veterans Health Administration National Pain Management Strategy
Kerns, R. D., Philip, E. J., Lee, A. W., & Rosenberger, P. H. (2011) · Translational Behavioral Medicine · doi:10.1007/s13142-011-0094-3 · Cited by 98
Self-citationLinden, A. (2014) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12254 · Cited by 83
Optimizing matching and analysis combinations for estimating causal effects
Colson, K. E., Rudolph, K. E., Zimmerman, S. C., Goin, D. E., Stuart, E. A., van der Laan, M. J., & Ahern, J. (2016) · Scientific Reports · doi:10.1038/srep23222 · Cited by 61
Garrido, M. M. (2014) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2014.05.014 · Cited by 48
On the use of propensity scores in case of rare exposure
Hajage, D., Tubach, F., Steg, P. G., Bhatt, D. L., & Rycke, Y. D. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0135-1 · Cited by 48
Carney, B. T., West, P., Neily, J. B., Mills, P. D., & Bagian, J. P. (2010) · American Journal of Medical Quality · doi:10.1177/1062860610368427 · Cited by 38
Sinnott, P. L., & Wagner, T. H. (2009) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.201 · Cited by 35
Weeks, W. B., Tosteson, T. D., Whedon, J. M., Leininger, B. D., Lurie, J. D., Swenson, R. S., Goertz, C., & O’Malley, A. J. (2015) · Journal of Manipulative and Physiological Therapeutics · doi:10.1016/j.jmpt.2015.10.005 · Cited by 14
Johnson, E. S., Dickerson, J. F., Vollmer, W. M., Rowley, A. M., Ritenbaugh, C., Deyo, R. A., & DeBar, L. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0318-4 · Cited by 14
Han, L., Kim, N. V., Brandt, C., & Allore, H. G. (2011) · Annals of Epidemiology · doi:10.1016/j.annepidem.2011.10.004 · Cited by 7
Self-citationD’Agostino (1998) · doi:10.1002/(sici)1097-0258(19981015)17:19<2265::aid-sim918>3.0.co;2-b
Research works printed but not linked: 3
- 1. Institute of Medicine. Relieving Pain in America: A Blueprint for Transforming Pain Prevention, Care, Education and Research. Washington, DC: The National Academies Press; 2011. [PubMed] [Google Scholar] 2.Office of the Assistant Secretary for Health, US Department of Health and Human Services. National Pain Strategy; 2016.
- 3. Veterans Health Administration. VA Pain Management Directive (2009-053). Washington, DC: Department of Veterans Affairs; 2009. [Google Scholar]
- 8. Veterans Health Administration. Analysis of VA Health Care Utilization Among Operation Enduring Freedom (OEF), Operation Iraqi Freedom (OIF), and Operation New Dawn (OND) Veterans. Washington, DC: Department of Veterans Affairs; 2013. [Google Scholar]
Cited by
Opioids and Chronic Pain: An Analytic Review of the Clinical Evidence
Nadeau, S. E., Wu, J. K., & Lawhern, R. A. (2021) · Frontiers in Pain Research · doi:10.3389/fpain.2021.721357 · Cited by 136
“A recent retrospective analysis assessed the impact of massage, acupuncture, and chiropractic care administered over 3 years in a population of 309,277 veterans with chronic musculoskeletal pain, 7,621 of whom received one or more of the therapies (87).”
BackgroundMeerwijk, E. L., Larson, M. J., Schmidt, E. M., Adams, R. S., Bauer, M. R., Ritter, G. A., Buckenmaier, C. C., & Harris, A. H. S. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-019-05450-4 · Cited by 48
Zeliadt, S. B., Douglas, J. H., Gelman, H. M., Coggeshall, S. S., Taylor, S. L., Kligler, B., & Bokhour, B. G. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08388-2 · Cited by 43
“A similar quasi-experimental study of CIH therapies in VHA found that IPTW methods, similar to methods used in our study, were successful in accounting for confounding bias by eliminating baseline differences across exposure groups [29].”
MethodManagement of Chronic Non-Cancer Pain: a Framework
Nadeau, S. E., & Lawhern, R. A. (2022) · Pain Management · doi:10.2217/pmt-2022-0017 · Cited by 27
Neuromodulation in chronic pain management: addressing persistent doubts in spinal cord stimulation
Bianco, G. L., Al-Kaisy, A. A., Natoli, S., Abd-Elsayed, A. A., Matis, G., Papa, A., Kapural, L., & Staats, P. S. (2025) · Journal of Anesthesia Analgesia and Critical Care · doi:10.1186/s44158-024-00219-6 · Cited by 26
Metadata
- Authors
- Han, L., Goulet, J. L., Skanderson, M., Bathulapalli, H., Luther, S. L., Kerns, R. D., & Brandt, C. A.
- Affiliations
- VA Connecticut Healthcare System (US)
- Yale University (US)
- James A. Haley Veterans' Hospital (US)
- Corresponding author
- Han, Ling
- ORCID
- Venue
- Pain Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-03-23
- Volume
- 20
- Issue
- 1
- Pages
- 90-102
- ISSN
- 1526-2375 (ISSN-L)
- 1526-4637
- PMC
- PMC6329442
- OpenAlex
- W2790534133
- Cited by
- 18
- References
- 41
- Citations by year
- 2025: 1 · 2024: 2 · 2023: 5 · 2022: 6 · 2021: 2 · 2020: 1 · 2019: 1
- FWCI
- 1.37
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Pain Medicine (publishedVersion, public-domain)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health
- National Center for Complementary and Integrative Health (R01 AT008448)
- Veterans Health Administration
- Health Services Research and Development Service (HSR&D)
- Yale University School of Medicine (P30AG021342)
- Topics
- Health Sciences › Medicine › Complementary and alternative medicine › Complementary and Alternative Medicine Studies
- Health Sciences › Health Professions › Physical Therapy, Sports Therapy and Rehabilitation › Musculoskeletal pain and rehabilitation
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- complementary and integrative health, chronic musculoskeletal pain, veterans, massage, acupuncture, chiropractic, treatment effectiveness, confounding, selection bias, inverse probability of treatment weighting, propensity score matching
- MeSH terms
- Adolescent, Adult, Aged, Aged, 80 and over, Complementary Therapies, Female, Humans, Male, Middle Aged, Retrospective Studies, United States, Veterans, Treatment Outcome, Young Adult, Propensity Score, Chronic Pain, Musculoskeletal Pain
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.