The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
The “surprise question” for predicting death in seriously ill patients: a systematic review and meta-analysis
Open accessAbstract
BACKGROUND: The surprise question — “Would I be surprised if this patient died in the next 12 months?” — has been used to identify patients at high risk of death who might benefit from palliative care services. Our objective was to systematically review the performance characteristics of the surprise question in predicting death. METHODS: We searched multiple electronic databases from inception to 2016 to identify studies that prospectively screened patients with the surprise question and reported on death at 6 to 18 months. We constructed models of hierarchical summary receiver operating characteristics (sROCs) to determine prognostic performance. RESULTS: Sixteen studies (17 cohorts, 11 621 patients) met the selection criteria. For the outcome of death at 6 to 18 months, the pooled prognostic characteristics were sensitivity 67.0% (95% confidence interval [CI] 55.7%–76.7%), specificity 80.2% (73.3%–85.6%), positive likelihood ratio 3.4 (95% CI 2.8–4.1), negative likelihood ratio 0.41 (95% CI 0.32–0.54), positive predictive value 37.1% (95% CI 30.2%–44.6%) and negative predictive value 93.1% (95% CI 91.0%–94.8%). The surprise question had worse discrimination in patients with noncancer illness (area under sROC curve 0.77 [95% CI 0.73–0.81]) than in patients with cancer (area under sROC curve 0.83 [95% CI 0.79–0.87; p = 0.02 for difference]). Most studies had a moderate to high risk of bias, often because they had a low or unknown participation rate or had missing data. INTERPRETATION: The surprise question performs poorly to modestly as a predictive tool for death, with worse performance in noncancer illness. Further studies are needed to develop accurate tools to identify patients with palliative care needs and to assess the surprise question for this purpose.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Early Palliative Care for Patients with Metastatic Non–Small-Cell Lung Cancer
Temel, J. S., Greer, J. A., Muzikansky, A., Gallagher, E. R., Admane, S., Jackson, V. A., Dahlin, C. M., Blinderman, C. D., Jacobsen, J., Pirl, W. F., et al. (2010) · New England Journal of Medicine · doi:10.1056/nejmoa1000678 · Cited by 7,482
Assessing Bias in Studies of Prognostic Factors
Hayden, J. A., van der Windt, D. A., Cartwright, J. L., Côté, P., & Bombardier, C. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-4-201302190-00009 · Cited by 3,287
Deeks, J. J., Macaskill, P., & Irwig, L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.016 · Cited by 2,910
Early palliative care for patients with advanced cancer: a cluster-randomised controlled trial
Zimmermann, C., Swami, N., Krzyzanowska, M., Hannon, B., Leighl, N., Oza, A., Moore, M., Rydall, A., Rodin, G., Tannock, I., et al. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62416-2 · Cited by 1,781
A hierarchical regression approach to meta‐analysis of diagnostic test accuracy evaluations
Rutter, C. M., & Gatsonis, C. A. (2001) · Statistics in Medicine · doi:10.1002/sim.942 · Cited by 1,505
Evaluation of the Quality of Prognosis Studies in Systematic Reviews
Hayden, J. A., Côté, P., & Bombardier, C. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-6-200603210-00010 · Cited by 1,452
Smith, T. J., Temin, S., Alesi, E. R., Abernethy, A. P., Balboni, T. A., Basch, E. M., Ferrell, B. R., Loscalzo, M., Meier, D. E., Paice, J. A., et al. (2012) · Journal of Clinical Oncology · doi:10.1200/jco.2011.38.5161 · Cited by 1,319
Properties of the summary receiver operating characteristic (SROC) curve for diagnostic test data
Walter, S. D. (2002) · Statistics in Medicine · doi:10.1002/sim.1099 · Cited by 672
Highet, G., Crawford, D., Murray, S. A., & Boyd, K. (2014) · BMJ Supportive & Palliative Care · doi:10.1136/bmjspcare-2013-000488 · Cited by 511
Profiles of Older Medicare Decedents
Lunney, J. R., Lynn, J., & Hogan, C. (2002) · Journal of the American Geriatrics Society · doi:10.1046/j.1532-5415.2002.50268.x · Cited by 492
Predicting Six-Month Mortality for Patients Who Are on Maintenance Hemodialysis
Cohen, L. M., Ruthazer, R., Moss, A. H., & Germain, M. J. (2010) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.03860609 · Cited by 391
Byrt, T. (1996) · Epidemiology · doi:10.1097/00001648-199609000-00030 · Cited by 390
Prognostic Significance of the “Surprise” Question in Cancer Patients
Moss, A. H., Lunney, J. R., Culp, S., Auber, M., Kurian, S., Rogers, J., Dower, J., & Abraham, J. (2010) · Journal of Palliative Medicine · doi:10.1089/jpm.2010.0018 · Cited by 365
Utility of the “Surprise” Question to Identify Dialysis Patients with High Mortality
Moss, A. H., Ganjoo, J., Sharma, S., Gansor, J., Senft, S., Weaner, B., Dalton, C., MacKay, K., Pellegrino, B., Anantharaman, P., et al. (2008) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.00940208 · Cited by 345
Early Palliative Care for Patients with Metastatic Non–Small-Cell Lung Cancer
Tanoue, L. T. (2011) · Yearbook of Pulmonary Disease · doi:10.1016/j.ypdi.2011.02.002 · Cited by 282
Gómez-Batiste, X., Martínez-Muñoz, M., Blay, C., Amblàs, J., Vila, L., Costa, X., Espaulella, J., Espinosa, J., Constante, C., & Mitchell, G. K. (2014) · Palliative Medicine · doi:10.1177/0269216313518266 · Cited by 264
Defining the palliative care patient: A systematic review
Van Mechelen, W., Aertgeerts, B., De Ceulaer, K., Thoonsen, B., Vermandere, M., Warmenhoven, F., Van Rijswijk, E., & De Lepeleire, J. (2013) · Palliative Medicine · doi:10.1177/0269216311435268 · Cited by 198
Gómez-Batiste, X., Martínez-Muñoz, M., Blay, C., Amblàs, J., Vila, L., Costa, X., Villanueva, A., Espaulella, J., Espinosa, J., Figuerola, M., et al. (2013) · BMJ Supportive & Palliative Care · doi:10.1136/bmjspcare-2012-000211 · Cited by 193
Wachterman, M. W., Marcantonio, E. R., Davis, R. B., Cohen, R. A., Waikar, S. S., Phillips, R. S., & McCarthy, E. P. (2013) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.6036 · Cited by 180
The ‘surprise’ question in advanced cancer patients: A prospective study among general practitioners
Moroni, M., Zocchi, D., Bolognesi, D., Abernethy, A., Rondelli, R., Savorani, G., Salera, M., Dall’Olio, F. G., Galli, G., Biasco, G., et al. (2014) · Palliative Medicine · doi:10.1177/0269216314526273 · Cited by 179
Strategic Targeting of Advance Care Planning Interventions: The Goldilocks Phenomenon
Billings, J. A., & Bernacki, R. (2014) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.14384 · Cited by 154
Prognostic Significance of the Surprise Question in Cancer Patients
Moss, A. H., Lunney, J. R., Culp, S., & Abraham, J. (2010) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2009.11.265 · Cited by 115
Gardiner, C., Gott, M., Ingleton, C., Seymour, J. E., Cobb, M., Noble, B., Bennett, M., & Ryan, T. (2012) · Palliative Medicine · doi:10.1177/0269216312447592 · Cited by 110
Improving Care Through the End of Life: Launching a Primary Care Clinic-Based Program
Pattison, M., & Romer, A. L. (2001) · Journal of Palliative Medicine · doi:10.1089/109662101750290335 · Cited by 82
van Walraven, C., McAlister, F. A., Bakal, J. A., Hawken, S., & Donzé, J. D. (2015) · Canadian Medical Association Journal · doi:10.1503/cmaj.150209 · Cited by 81
Hamano, J., Morita, T., Inoue, S., Ikenaga, M., Matsumoto, Y., Sekine, R., Yamaguchi, T., Hirohashi, T., Tajima, T., Tatara, R., et al. (2015) · The Oncologist · doi:10.1634/theoncologist.2015-0015 · Cited by 78
Kersun, L. S., Gyi, L., & Morrison, W. E. (2009) · Journal of Palliative Medicine · doi:10.1089/jpm.2008.0251 · Cited by 67
Estimating 1-Year Mortality for High-Risk Primary Care Patients Using the “Surprise” Question
Lakin, J. R., Robinson, M. G., Bernacki, R., Powers, B. W., Block, S. D., Cunningham, R. J., & Obermeyer, Z. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2016.5928 · Cited by 63
Mitchell, G. K., Zhang, J., Burridge, L. H., Senior, H., Miller, E., Young, S., Donald, M., & Jackson, C. L. (2014) · BMC Palliative Care · doi:10.1186/1472-684x-13-24 · Cited by 58
Predicting 12-Month Mortality for Peritoneal Dialysis Patients Using the “Surprise” Question
Pang, W., Kwan, B. C., Chow, K., Leung, C., Li, P. K., & Szeto, C. (2012) · Peritoneal Dialysis International · doi:10.3747/pdi.2011.00204 · Cited by 56
Amro, O. W., Ramasamy, M., Strom, J. A., Weiner, D. E., & Jaber, B. L. (2016) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2015.11.024 · Cited by 53
Elliott, M., & Nicholson, C. J. (2014) · BMJ Supportive & Palliative Care · doi:10.1136/bmjspcare-2014-000679 · Cited by 51
Carey, I., Shouls, S., Bristowe, K., Morris, M., Briant, L., Robinson, C., Caulkin, R., Griffiths, M., Clark, K., Koffman, J., et al. (2014) · BMJ Supportive & Palliative Care · doi:10.1136/bmjspcare-2013-000634 · Cited by 49
Gane, M. D. S., Braun, A., Stott, D. J., Wellsted, D. M., & Farrington, K. (2013) · Nephron Clinical Practice · doi:10.1159/000353735 · Cited by 42
Predicting mortality among a general practice-based sample of older people with heart failure
Barnes, S., Gott, M., Payne, S. A., Parker, C., Seamark, D., Gariballa, S., & Small, N. (2008) · Chronic Illness · doi:10.1177/1742395307083783 · Cited by 39
Palliative care for frail older people
Pal, L., & Manning, L. S. (2014) · Clinical Medicine · doi:10.7861/clinmedicine.14-3-292 · Cited by 37
Johnson, M. J. (2012) · British Journal of Cardiology · doi:10.5837/bjc.2012.014 · Cited by 34
Feyi, K., Klinger, S., Pharro, G., Mcnally, L., James, A., Gretton, K., & Almond, M. K. (2013) · BMJ Supportive & Palliative Care · doi:10.1136/bmjspcare-2011-000165 · Cited by 23
Carey, I., Shouls, S., Bristowe, K., Morris, M., Briant, L., Robinson, C., Caulkin, R., Griffiths, M., Clark, K., Koffman, J., et al. (2015) · BMJ Supportive & Palliative Care · doi:10.1136/bmjspcare-2013-000634rep · Cited by 12
Cited by
White, N., Kupeli, N., Vickerstaff, V., & Stone, P. (2017) · BMC Medicine · doi:10.1186/s12916-017-0907-4 · Cited by 315
Wang, L., Sha, L., Lakin, J. R., Bynum, J., Bates, D. W., Hong, P., & Zhou, L. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.6972 · Cited by 105
Abe, A., Kobayashi, M., Kohno, T., Takeuchi, M., Hashiguchi, S., Mimura, M., & Fujisawa, D. (2021) · BMC Palliative Care · doi:10.1186/s12904-020-00698-8 · Cited by 18
Tuesen, L. D., Ågård, A. S., Bülow, H.-H., Fromme, E. K., & Jensen, H. I. (2022) · Scandinavian Journal of Primary Health Care · doi:10.1080/02813432.2022.2036481 · Cited by 19
Individualizing diabetes care in older persons with multimorbidity
Sloane, P. D., & Pandya, N. (2021) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2021.07.019 · Cited by 8
Metadata
- Authors
- Downar, J., Goldman, R., Pinto, R., Englesakis, M., & Adhikari, N. K. J.
- Venue
- Canadian Medical Association Journal
- Publisher
- CMA Joule Inc.
- Published
- 2017-04-02
- Volume
- 189
- Issue
- 13
- Pages
- E484-E493
- ISSN
- 0820-3946 (ISSN-L)
- 1488-2329
- OpenAlex
- W2605249189
- Cited by
- 403
- References
- 42
- FWCI
- 29.93
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.