The Risk of Severe Postoperative Pain: Modification and Validation of a Clinical Prediction Rule
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
In Brief BACKGROUND: Recently, a prediction rule was developed to preoperatively predict the risk of severe pain in the first postoperative hour in surgical inpatients. We aimed to modify the rule to enhance its use in both surgical inpatients and outpatients (ambulatory patients). Subsequently, we prospectively tested the modified rule in patients who underwent surgery later in time and in another hospital (external validation). METHODS: The rule was originally developed from the data of 1395 adult inpatients. We modified the rule with the data of 549 outpatients who underwent surgery between 1997 and 1999 in the same center (Academic Medical Center Amsterdam, The Netherlands). Furthermore, we tested the performance of the modified rule in 1035 in- and outpatients who underwent surgery in 2004, in the University Medical Center Utrecht, The Netherlands (external validation). Performance was quantified by the rule's calibration (agreement between observed frequencies and predicted risks) and discrimination (ability to distinguish between patients at high and low risk). RESULTS: Modification of the original rule to enhance prediction in outpatients included reclassification of the predictor “type of surgery,” addition of the predictor “surgical setting” (ambulatory surgery: yes/no) and addition of interaction terms between surgical setting and the other predictors. One-third of the patients in the Utrecht cohort reported severe postoperative pain (36%), compared to 62% of the patients in the Amsterdam cohort. The distribution of most predictors was similar in the two cohorts, although the patients in the Utrecht cohort were slightly older, more often underwent ambulatory surgery and had large expected incision sizes less often than patients in the Amsterdam cohort. The modified prediction rule showed good calibration, when an adjusted intercept was used for the lower incidence in the Utrecht cohort. The discrimination was reasonable (area under the Receiver Operating Characteristic curve 0.65 [95% confidence interval 0.57–0.73]). CONCLUSIONS: A previously developed prediction rule to predict severe postoperative pain was modified to allow use in both inpatients and outpatients. By validating the rule in patients who underwent surgery several years later in another hospital, it was shown that the rule could be generalized in time and place. We demonstrated that, instead of deriving new prediction rules for new populations, a simple adjustment may be enough to recalibrate prediction rules for new populations. This is in line with the perception that external validation and updating of prediction rules is a continuing and multistage process. IMPLICATIONS: A prediction rule that was previously developed to preoperatively predict the risk of severe pain in the first postoperative hour in surgical inpatients was modified for use in both inpatients and outpatients. By validating the modified rule in patients that underwent surgery several years later in another hospital, it was shown that the rule could be generalized in time and place. We demonstrated that an originally developed prediction rule can be modified and simply adjusted for new groups of patients rather than developing a new rule.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Harrell (2015) · Springer Series in Statistics · doi:10.1007/978-3-319-19425-7 · Cited by 6,878
Internal validation of predictive models
Steyerberg, E. W., Harrell, F. E., Borsboom, G. J. J. M., Eijkemans, M. J. C., Vergouwe, Y., & Habbema, J. D. F. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00341-9 · Cited by 2,746
Self-citationAssessing the Generalizability of Prognostic Information
Justice, A. C., Covinsky, K. E., & Berlin, J. A. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-6-199903160-00016 · Cited by 1,160
Acute Pain after Thoracic Surgery Predicts Long-Term Post-Thoracotomy Pain
Katz, J., Jackson, M., Kavanagh, B. P., & Sandler, A. N. (1996) · The Clinical Journal of Pain · doi:10.1097/00002508-199603000-00009 · Cited by 915 · cited 1×
“Moreover, it can promote delirium in the elderly(6) and may develop into chronic pain syndromes.(7)”
BackgroundReilly, B. M., & Evans, A. T. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-3-200602070-00009 · Cited by 794
Preoperative prediction of severe postoperative pain
Kalkman, J. C., Visser, K., Moen, J., Bonsel, J. G., Grobbee, E. D., & Moons, M. K. G. (2003) · Pain · doi:10.1016/s0304-3959(03)00252-5 · Cited by 616 · cited 3×
“A multivariable prediction rule (including only predictors that are easy to obtain during a preoperative visit) was developed to preoperatively predict the risk of severe pain in the first postoperative hour in surgical inpatients.(9) It would be useful if this rule could also predict severe acute postoperative pain i…”
BackgroundMethodInfluentialSteyerberg, E. W., Borsboom, G. J. J. M., van Houwelingen, H. C., Eijkemans, M. J. C., & Habbema, J. D. F. (2004) · Statistics in Medicine · doi:10.1002/sim.1844 · Cited by 552
Sex- and Age-related Differences in Morphine Requirements for Postoperative Pain Relief
Aubrun, F., Salvi, N., Coriat, P., & Riou, B. (2005) · Anesthesiology · doi:10.1097/00000542-200507000-00023 · Cited by 268
Cited by
Gerbershagen, H. J., Rothaug, J., Kalkman, C. J., & Meissner, W. (2011) · British Journal of Anaesthesia · doi:10.1093/bja/aer195 · Cited by 527
Self-citationPrediction of Postoperative Pain: A Systematic Review of Predictive Experimental Pain Studies
Werner, M. U., Mjöbo, H. N., Nielsen, P. R., Rudin, Å., & Warner, D. S. (2010) · Anesthesiology · doi:10.1097/aln.0b013e3181dcd5a0 · Cited by 262
Schreiber, K. L., Martel, M. O., Shnol, H., Shaffer, J. R., Greco, C., Viray, N., Taylor, L. N., McLaughlin, M., Brufsky, A., Ahrendt, G., et al. (2013) · Pain · doi:10.1016/j.pain.2012.11.015 · Cited by 188
“However, studies of prediction of acute pain after surgery have revealed that retrospectively identified psychological variables [43] may then predict acute pain in a subsequent prospective study [39].”
BackgroundEdwards, R. R., Mensing, G., Cahalan, C., Greenbaum, S., Narang, S., Belfer, I., Schreiber, K. L., Campbell, C., Wasan, A. D., & Jamison, R. N. (2013) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2012.06.016 · Cited by 150
A review of statistical updating methods for clinical prediction models
Su, T.-L., Jaki, T., Hickey, G. L., Buchan, I., & Sperrin, M. (2018) · Statistical Methods in Medical Research · doi:10.1177/0962280215626466 · Cited by 147
Predicting acute pain after cesarean delivery using three simple questions
Pan, P. H., Tonidandel, A. M., Aschenbrenner, C. A., Houle, T. T., Harris, L. C., & Eisenach, J. C. (2013) · Anesthesiology · doi:10.1097/aln.0b013e31828e156f · Cited by 113
Prolonged Opioid Use After Knee Arthroscopy in Military Veterans
Rozet, I., Nishio, I., Robbertze, R., Rotter, D., Chansky, H., & Hernandez, A. V. (2014) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000000292 · Cited by 69
“surgery as a surrogate for CPP and (2) specifically character-”
BackgroundMethodInfluentialKraychete, D. C., Sakata, R. K., Lannes, L. D. O. C., Bandeira, I. D., & Sadatsune, E. J. (2016) · Brazilian Journal of Anesthesiology · doi:10.1016/j.bjan.2014.12.002 · Cited by 32
Metadata
- Authors
- Janssen, K. J. M., Kalkman, C. J., Grobbee, D. E., Bonsel, G. J., Moons, K. G. M., & Vergouwe, Y.
- Venue
- Anesthesia & Analgesia
- Published
- 2008-10
- Volume
- 107
- Issue
- 4
- Pages
- 1330-1339
- ISSN
- 0003-2999 (ISSN-L)
- OpenAlex
- W2117557843
- Cited by
- 110
- References
- 8
- FWCI
- 6.46
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.