Validation of a Screening Risk Index for Serious Prescription Opioid-Induced Respiratory Depression or Overdose in a US Commercial Health Plan Claims Database
Open accessThe DOI matches its Crossref record; 39 of the 40 references it cites were found in a registry or an index.
Abstract
Objective: To validate a risk index that estimates the likelihood of overdose or serious opioid-induced respiratory depression (OIRD) among medical users of prescription opioids. Subjects and Methods: A case-control analysis of 18,365,497 patients with an opioid prescription from 2009 to 2013 in the IMS PharMetrics Plus commercially insured health plan claims database (CIP). An OIRD event occurred in 7,234 cases. Four controls were selected per case. Validity of the Risk Index for Overdose or Serious Opioid-induced Respiratory Depression (RIOSORD), developed previously using Veterans Health Administration (VHA) patient data, was assessed. Multivariable logistic regression was used within the CIP study population to develop a slightly refined RIOSORD. The composition and performance of the CIP-based RIOSORD was evaluated and compared with VHA-based RIOSORD. Results: VHA-RIOSORD performed well in discriminating OIRD events in CIP (C-statistic = 0.85). Additionally, re-estimation of logistic model coefficients in CIP yielded a 0.90 C-statistic. The resulting comorbidity and pharmacotherapy variables most highly associated with OIRD and retained in the CIP-RIOSORD were largely concordant with VHA-RIOSORD. These variables included neuropsychiatric and cardiopulmonary disorders, impaired drug excretion, opioid characteristics, and concurrent psychoactive medications. The average predicted probability of OIRD ranged from 2% to 83%, with excellent agreement between predicted and observed incidence across risk classes. Conclusions: RIOSORD had excellent predictive accuracy in a large population of US medical users of prescription opioids, similar to its performance in VHA. This practical risk index is designed to support clinical decision-making for safer opioid prescribing, and its clinical utility should be evaluated prospectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The Risk Index for Overdose or Serious Opioid-induced Respiratory Depression (RIOSORD) is a tool that can be used for this purpose (see Box 7).135,136”
From Joint Clinical Practice Guideline on Benzodiazepine Tapering: Considerations When Risks Outweigh Benefits (2025) · cites this paper as [136]
The cited source says what the claim attributes to it.
In the citing paper
“According to the RIOSORD, the most significant risk factors include having an SUD, a bipolar spectrum disorder, or schizophrenia and/or taking fentanyl, morphine, or methadone.135,136”
From Joint Clinical Practice Guideline on Benzodiazepine Tapering: Considerations When Risks Outweigh Benefits (2025) · cites this paper as [136]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. (2013) · Encyclopedia of Social Work · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,519
Charlson, M. E., Pompei, P., Ales, K. L., & MacKenzie, C. R. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90171-8 · Cited by 49,742
Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases
DEYO, R. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90133-8 · Cited by 10,452
Le Gall, J.-R. (1993) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.270.24.2957 · Cited by 7,773
Increases in drug and opioid-involved overdose deaths – United States, 2010-2015
Rudd, R. A., Seth, P., David, F., & Scholl, L. (2016) · MMWR. Morbidity and Mortality Weekly Report · doi:10.15585/mmwr.mm655051e1 · Cited by 2,194
Vital signs: overdoses of prescription opioid pain relievers---United States, 1999--2008.
Paulozzi, L. J., Jones, C. M., Mack, K. A., & Rudd, R. A. (2011) · PubMed · Cited by 1,540
The Prescription Opioid and Heroin Crisis: A Public Health Approach to an Epidemic of Addiction
Kolodny, A., Courtwright, D. T., Hwang, C. S., Kreiner, P., Eadie, J. L., Clark, T. W., & Alexander, G. C. (2015) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031914-122957 · Cited by 1,388
Charlson, M. E., Charlson, R. E., Peterson, J. C., Marinopoulos, S. S., Briggs, W. M., & Hollenberg, J. P. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.01.006 · Cited by 894
Arozullah, A. M., Khuri, S. F., Henderson, W. G., Daley, J., & Program, F. T. P. I. T. N. V. A. S. Q. I. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-135-10-200111200-00005 · Cited by 731
Vital signs: overdoses of prescription opioid pain relievers---United States, 1999--2008.
(2011) · PubMed · Cited by 640
Wide-ranging Online Data for Epidemiologic Research (WONDER)
(2017) · Cited by 415
ASIPP, A. (2012) · Pain Physician · doi:10.36076/ppj.2012/15/s67 · Cited by 386
Development and Validation of a Risk Calculator Predicting Postoperative Respiratory Failure
Gupta, H., Gupta, P. K., Fang, X., Miller, W. J., Cemaj, S., Forse, R. A., & Morrow, L. E. (2011) · Chest · doi:10.1378/chest.11-0466 · Cited by 260
Manchikanti, L., Abdi, S., Atluri, S. L., Balog, C. C., Benyamin, R. M., Boswell, M. V., Brown, K. R., Bruel, B. M., Bryce, D. A., Burks, P. A., et al. (2012) · PubMed · Cited by 243
Zedler, B., Xie, L., Wang, L., Joyce, A., Vick, C., Kariburyo, F., Rajan, P., Baser, O., & Murrelle, L. (2014) · Pain Medicine · doi:10.1111/pme.12480 · Cited by 229
Self-citationPrinciples of addiction medicine
Ries, R. R., Fiellin, D. A., Miller, S. C., & Saitz, R. (2009) · Cited by 218
Principles of Addiction Medicine
Rukstalis, M. R., & Weinrieb, R. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-131-8-199910190-00034 · Cited by 218
Project Lazarus: community-based overdose prevention in rural North Carolina
Albert, S., Brason, F. W., Sanford, C. K., Dasgupta, N., Graham, J., & Lovette, B. (2011) · Pain Medicine · doi:10.1111/j.1526-4637.2011.01128.x · Cited by 210
The Use of Opioids for the Treatment of Chronic Pain*
&NA; (1997) · The Clinical Journal of Pain · doi:10.1097/00002508-199703000-00003 · Cited by 208
Prescription opioid analgesic use among adults: United States, 1999-2012.
Frenk, S. M., Porter, K. S., & Paulozzi, L. J. (2015) · PubMed · Cited by 205
The Effectiveness and Risks of Long-Term Opioid Treatment of Chronic Pain
Chou, R., Deyo, R., Devine, B., Hansen, R., Sullivan, S., Jarvik, J. G., Blazina, I., Dana, T., Bougatsos, C., & Turner, J. (2014) · doi:10.23970/ahrqepcerta218 · Cited by 185
Hospitalizations for Poisoning by Prescription Opioids, Sedatives, and Tranquilizers
Coben, J. H., Davis, S. M., Furbee, P. M., Sikora, R. D., Tillotson, R. D., & Bossarte, R. M. (2010) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2010.01.022 · Cited by 173
Jamison, P., Sheehan, B., Scanlan, N., Matthews, P., & Ross, M. (2014) · Journal of Opioid Management · doi:10.5055/jom.2014.0234 · Cited by 171
Administrative database research infrequently used validated diagnostic or procedural codes
van Walraven, C., Bennett, C., & Forster, A. J. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.01.001 · Cited by 170
Wermeling, D. P. (2015) · Therapeutic Advances in Drug Safety · doi:10.1177/2042098614564776 · Cited by 164
Zedler, B., Xie, L., Wang, L., Joyce, A., Vick, C., Brigham, J., Kariburyo, F., Baser, O., & Murrelle, L. (2015) · Pain Medicine · doi:10.1111/pme.12777 · Cited by 138
Self-citationEpidemiology of Emergency Department Visits for Opioid Overdose: A Population-Based Study
Hasegawa, K., Brown, D., Tsugawa, Y., & Camargo, C. A. (2014) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2013.12.008 · Cited by 117
Prevention of Fatal Opioid Overdose
Beletsky, L., Rich, J. D., & Walley, A. Y. (2012) · JAMA · doi:10.1001/jama.2012.14205 · Cited by 102
Prevalence of Diagnosed Opioid Abuse and its Economic Burden in the Veterans Health Administration
Baser, O., Xie, L., Mardekian, J., Schaaf, D., Wang, L., & Joshi, A. V. (2014) · Pain Practice · doi:10.1111/papr.12097 · Cited by 82
Keller, C. E., Ashrafioun, L., Neumann, A. M., Van Klein, J., Fox, C. H., & Blondell, R. D. (2012) · Substance Abuse · doi:10.1080/08897077.2011.630944 · Cited by 69
Informed Consent in Opioid Therapy: A Potential Obligation and Opportunity
Cheatle, M. D., & Savage, S. R. (2012) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2011.06.015 · Cited by 59
Nadpara, P. A., Joyce, A. R., Murrelle, E. L., Carroll, N. W., Carroll, N. V., Barnard, M., & Zedler, B. K. (2017) · Pain Medicine · doi:10.1093/pm/pnx038 · Cited by 58
Self-citationWang, L., Porter, B., Maynard, C. C., Bryson, C. L., Sun, H., Lowy, E., McDonell, M. B., Frisbee, K. L., Nielson, C., & Fihn, S. D. (2012) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2012.06.038 · Cited by 41
Batzlaff, C. M., Karpman, C., Afessa, B., & Benzo, R. P. (2014) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2013.12.004 · Cited by 26
Xie, L., Joshi, A. V., Schaaf, D. T., Mardekian, J., Harnett, J., Shah, N. D., & Başer, O. (2013) · Pain Practice · doi:10.1111/papr.12098 · Cited by 17
Paton, M. B., Large, M. M. B., & Ryan, C. J. (2014) · Australasian Psychiatry · doi:10.1177/1039856213510579 · Cited by 14
O’Connor, N., Allan, J., & Scott, C. L. (2014) · Australasian Psychiatry · doi:10.1177/1039856213510580 · Cited by 4
Research works printed but not linked: 2
- SAMHSA. Opioid Overdose Prevention Toolkit: Information for Prescribers. Rockville, MD: Substance Abuse and Mental Health Services Administration; 2016.
- Abraham M, Ahlman JT, Boudreau AJ, Connelly JL. Current Procedural Terminology CPT 2011 Professional Edition. Chicago, IL: American Medical Association Press; 2011.
Cited by
Risk Factors for Opioid-Use Disorder and Overdose
Webster, L. R. (2017) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000002496 · Cited by 498
Lo-Ciganic, W.-H., Huang, J. L., Zhang, H. H., Weiss, J. C., Wu, Y., Kwoh, C. K., Donohue, J. M., Cochran, G., Gordon, A. J., Malone, D. C., et al. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.0968 · Cited by 229
Gupta, K., Nagappa, M., Prasad, A., Abrahamyan, L., Wong, J., Weingarten, T. N., & Chung, F. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-024086 · Cited by 176
Yamamoto, A., Needleman, J., Gelberg, L., Kominski, G., Shoptaw, S., & Tsugawa, Y. (2019) · Social Science & Medicine · doi:10.1016/j.socscimed.2019.112585 · Cited by 163
Babu, K. M., Brent, J. A., & Juurlink, D. N. (2019) · New England Journal of Medicine · doi:10.1056/nejmra1807054 · Cited by 133
“In areas without a legislative mandate, PDMP inquiries are infrequently completed; recognized obstacles include time, workload, and poor integration into existing electronic medical records.19 However, PDMPs can identify doctor shopping, concomitant benzodiazepine prescriptions, and evidence of an undisclosed opioid u…”
MethodInfluential
Metadata
- Authors
- Zedler, B. K., Saunders, W. B., Joyce, A. R., Vick, C. C., & Murrelle, E. L.
- Affiliations
- Venebio (United States) (US)
- University of North Carolina at Charlotte (US)
- Corresponding author
- Zedler, Barbara K
- Venue
- Pain Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-03-06
- Volume
- 19
- Issue
- 1
- Pages
- 68-78
- ISSN
- 1526-2375 (ISSN-L)
- 1526-4637
- PMC
- PMC5939826
- OpenAlex
- W2594736572
- Cited by
- 119
- References
- 40
- Citations by year
- 2026: 7 · 2025: 7 · 2024: 19 · 2023: 10 · 2022: 16 · 2021: 20 · 2020: 13 · 2019: 16 · 2018: 6 · 2017: 4
- FWCI
- 10.02
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc-nd
- Locations
- Pain Medicine (publishedVersion, cc-by-nc-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Opioid Use Disorder Treatment
- Health Sciences › Medicine › Anesthesiology and Pain Medicine › Pain Management and Opioid Use
- Health Sciences › Medicine › Geriatrics and Gerontology › Pharmaceutical Practices and Patient Outcomes
- Keywords
- opioid-induced respiratory depression, opioid overdose, prescription opioids, commercially insured patients, comorbidities, psychotropic drugs, risk prediction
- MeSH terms
- Adult, Analgesics, Opioid, Female, Humans, Insurance Claim Review, Male, Middle Aged, Predictive Value of Tests, Respiratory Insufficiency, Risk Factors, United States, United States Department of Veterans Affairs, Case-Control Studies, Databases, Factual, Decision Support Systems, Clinical, Drug Overdose
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.