Using electronic health records data to identify patients with chronic pain in a primary care setting
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To develop and validate an accurate method to identify patients with chronic pain using electronic health records (EHR) data at a multisite community health center. MATERIALS AND METHODS: We identified patients with chronic pain in our EHR system using readily available data elements pertaining to pain: diagnostic codes (International Classification of Disease, revision 9; ICD-9), patient-reported pain scores, and opioid prescription medications. Medical chart reviews were used to evaluate the accuracy of these data elements in all of their combinations. We developed an algorithm to identify chronic pain patients more accurately based on these evaluations. The algorithm's results were validated for accuracy by comparing them with the documentation of chronic pain by the patient's treating clinician in 381 random patient charts. RESULTS: The new algorithm, which combines pain scores, prescription medications, and ICD-9 codes, has a sensitivity and specificity of 84.8% and 97.7%, respectively. The algorithm was more accurate (95.0%) than pain scores (88.7%) or ICD-9 codes (93.2%) alone. The receiver operating characteristic was 0.981. DISCUSSION: A straightforward method for identifying chronic pain patients solely using structured electronic data does not exist because individual data elements, such as pain scores or ICD-9 codes, are not sufficiently accurate. We developed and validated an algorithm that uses a combination of elements to identify chronic pain patients accurately. CONCLUSIONS: We derived a useful method that combines readily available elements from an EHR to identify chronic pain with high accuracy. This method should prove useful to those interested in identifying chronic pain patients in large datasets for research, evaluation or quality improvement purposes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The american college of rheumatology 1990 criteria for the classification of fibromyalgia
Wolfe, F., Smythe, H. A., Yunus, M. B., Bennett, R. M., Bombardier, C., Goldenberg, D. L., Tugwell, P., Campbell, S. M., Abeles, M., Clark, P., et al. (1990) · Arthritis & Rheumatism · doi:10.1002/art.1780330203 · Cited by 9,563
Increasing deaths from opioid analgesics in the United States
Paulozzi, L. J., Budnitz, D. S., & Xi, Y. (2006) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1276 · Cited by 696
Alleviating Suffering 101 — Pain Relief in the United States
Pizzo, P. A., & Clark, N. M. (2012) · New England Journal of Medicine · doi:10.1056/nejmp1109084 · Cited by 231
Validity of electronic health record-derived quality measurement for performance monitoring
Parsons, A., McCullough, C., Wang, J., & Shih, S. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000557 · Cited by 137
Cited by
Methods for identifying 30 chronic conditions: application to administrative data
Tonelli, M., Wiebe, N., Fortin, M., Guthrie, B., Hemmelgarn, B. R., James, M. T., Klarenbach, S. W., Lewanczuk, R., Manns, B. J., Ronksley, P., et al. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-015-0155-5 · Cited by 400
“Second, to improve mapping of ICD-9 codes from the original (published) algorithm into ICD-10, we combined the ‘highly likely’ and the ‘likely’ codes from the original algorithm for chronic pain [18].”
MethodElectronic health records-driven phenotyping: challenges, recent advances, and perspectives
Pathak, J., Kho, A. N., & Denny, J. C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002428 · Cited by 274
Wei, W.-Q., Teixeira, P. L., Mo, H., Cronin, R. M., Warner, J. L., & Denny, J. C. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv130 · Cited by 230
Overprescribing of opioids to adults by dentists in the U.S., 2011-2015
Suda, K. J., Zhou, J., Rowan, S. A., McGregor, J. C., Perez, R. I., Evans, C. T., Gellad, W. F., & Calip, G. S. (2020) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2019.11.006 · Cited by 55
“…7 days prior; (2) patients with any hospice encounter in the last year 17 ; (3) any baseline diagnoses for chronic pain conditions, sickle cell disease or trait, and same day diagnosis of oral pain 18–21 ; and (4) cancer patients receiving chemotherapy within 30 days before the dental visit.”
Increased Nonopioid Chronic Pain Treatment in the Veterans Health Administration, 2010–2016
Frank, J. W., Carey, E., Nolan, C., Kerns, R. D., Sandbrink, F., Gallagher, R., & Ho, P. M. (2019) · Pain Medicine · doi:10.1093/pm/pny149 · Cited by 28
Metadata
- Authors
- Tian, T. Y., Zlateva, I., & Anderson, D. R.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-12
- Volume
- 20
- Issue
- e2
- Pages
- e275-e280
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2155703276
- Cited by
- 161
- References
- 4
- FWCI
- 9.24
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using electronic health records data to identify patients with chronic pain in a primary care setting. https://app.cochat.ai/papers/10.1136/amiajnl-2013-001856
- The paper
- Tian, T. Y., Zlateva, I., & Anderson, D. R. (2013). Using electronic health records data to identify patients with chronic pain in a primary care setting. Journal of the American Medical Informatics Association. https://doi.org/10.1136/amiajnl-2013-001856
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.