The DOI matches its Crossref record; 20 of the 21 references it cites were found in a registry or an index.
Failure to Validate the San Francisco Syncope Rule in an Independent Emergency Department Population
Abstract
Study objective We conduct a prospective independent validation of the San Francisco Syncope Rule to identify emergency department (ED) syncope patients with short-term serious outcomes.Methods This was a prospective observational cohort study of adult patients presenting to a university hospital ED with acute syncope or near syncope. Patients meeting inclusion criteria as defined in the San Francisco Syncope Rule derivation were evaluated for 5 previously derived predictor variables: abnormal ECG result, shortness of breath, hematocrit level less than 30%, triage systolic blood pressure less than 90 mm Hg, and history of congestive heart failure. Hospital admission occurred at the discretion of the emergency physician, independent of the decision rule. Follow-up occurred through contact with the inpatient attending physician for admitted patients and by telephone contact with patients not hospitalized or those hospitalized and discharged before day 7. Predetermined outcome measures as defined by the San Francisco Syncope Rule were death, myocardial infarction, arrhythmia, pulmonary embolism, stroke, subarachnoid hemorrhage, significant hemorrhage, or any condition causing or likely to cause a return ED visit and hospitalization for a related event.Results Complete predictor and follow-up data were available for 713 of 743 (96%) enrolled patients. Sixty-one of 713 (9%) patients met predetermined criteria for serious outcome. Sixteen of 61 (26%; 95% confidence interval [CI] 16% to 39%) patients with a serious outcome were not identified as high risk by the rule. Rule performance to predict serious outcomes was sensitivity 74% (95% CI 61% to 84%), specificity 57% (95% CI 53% to 61%); negative likelihood ratio 0.5 (95% CI 0.3 to 0.7) and positive likelihood ratio 1.7 (95% CI 1.4 to 2.0).Conclusion In this independent validation study, sensitivity and negative likelihood ratio of the San Francisco Syncope Rule were substantially lower than reported in the original studies and suggest that the rule has limited generalizability.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“None of these rules are used widely in EDs due to poor sensitivity and specificity reported from external validation, or due to a lack of external validation. 70,78-85”
From 2018 ESC Guidelines for the diagnosis and management of syncope (2018) · cites this paper as [85]
Citations
Cites
High agreement but low Kappa: I. the problems of two paradoxes
Feinstein, A. R., & Cicchetti, D. V. (1990) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(90)90158-l · Cited by 3,034
Clinical Prediction Rules: Applications and Methodological Standards
Wasson, J. H., Sox, H. C., Neff, R. K., & Goldman, L. (1985) · New England Journal of Medicine · doi:10.1056/nejm198509263131306 · Cited by 1,357
Methodologic Standards for the Development of Clinical Decision Rules in Emergency Medicine
STIELL, I., & WELLS, G. (1999) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(99)70309-4 · Cited by 571
Derivation of the San Francisco Syncope Rule to predict patients with short-term serious outcomes
Quinn, J. V., Stiell, I. G., McDermott, D. A., Sellers, K. L., Kohn, M. A., & Wells, G. A. (2004) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(03)00823-0 · Cited by 432
Kapoor, W. N. (2000) · New England Journal of Medicine · doi:10.1056/nejm200012213432507 · Cited by 322
Prospective validation of the San Francisco Syncope Rule to predict patients with serious outcomes
Quinn, J., McDermott, D., Stiell, I., Kohn, M., & Wells, G. (2006) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2005.11.019 · Cited by 309
Direct medical costs of syncope-related hospitalizations in the United States
Sun, B. C., Emond, J. A., & Camargo, C. A. (2005) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2004.11.013 · Cited by 305
Clinical Utility of Likelihood Ratios
Gallagher, E. J. (1998) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(98)70352-x · Cited by 218
Why Predictive Indexes Perform Less Well in Validation Studies
Charlson, M. E. (1987) · Archives of Internal Medicine · doi:10.1001/archinte.147.12.2155 · Cited by 203
Sun, B. C., Emond, J. A., & Camargo, C. A. (2004) · Academic Emergency Medicine · doi:10.1197/j.aem.2004.05.032 · Cited by 193
Agreement Between Peripheral Venous and Arterial Lactate Levels
Gallagher, E. J., Rodriguez, K., & Touger, M. (1997) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(97)70220-8 · Cited by 144
The Importance of Disease Prevalence in Transporting Clinical Prediction Rules
Poses, R. M., CEBUL, R. D., COLLINS, M., & FAGER, S. S. (1986) · Annals of Internal Medicine · doi:10.7326/0003-4819-105-4-586 · Cited by 143
External validation of the San Francisco Syncope Rule
Sun, B. C., Mangione, C. M., Merchant, G., Weiss, T., Shlamovitz, G. Z., Zargaraff, G., Shiraga, S., Hoffman, J. R., & Mower, W. R. (2007) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2006.11.012 · Cited by 128
Transportability of a Decision Rule for the Diagnosis of Streptococcal Pharyngitis
Wigton, R. S. (1986) · Archives of Internal Medicine · doi:10.1001/archinte.1986.00360130103014 · Cited by 99
(2001) · Annals of Emergency Medicine · doi:10.1067/mem.2001.114838 · Cited by 89
Sun, B., Emond, J. A., & Camargo, C. A. (2004) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2004.07.016 · Cited by 36
Griffith, J. L. (2000) · Medical Decision Making · doi:10.1177/0272989x0002000210 · Cited by 17
Gallagher, E. J. (2004) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2003.09.014 · Cited by 7
Thirty-Day Versus 7-Day Outcomes in the San Francisco Syncope Rule
Everett, W. W., & Pines, J. M. (2006) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2006.06.055 · Cited by 1
Quinn, J. (2006) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2006.06.054 · Cited by 1
Research works printed but not linked: 1
- Gallagher, 1997, Hospitalization for fainting: high stakes, low yield, Ann Emerg Med, 29, 540
Cited by
Sorted by citations
2018 ESC Guidelines for the diagnosis and management of syncope
Brignole, M., Moya, A., de Lange, F. J., Deharo, J.-C., Elliott, P. M., Fanciulli, A., Fedorowski, A., Furlan, R., Kenny, R. A., Martín, A., et al. (2018) · European Heart Journal · doi:10.1093/eurheartj/ehy037 · Cited by 1,951
2018 ESC Guidelines for the diagnosis and management of syncope
Brignole, M., Moya‐Mitjans, À., de Lange, F. J., Deharo, J., Elliot, P. M., Fanciulli, A., Fedorowski, A., Furlan, R., Kenny, R. A., Martiın, A., et al. (2018) · Kardiologia Polska · doi:10.5603/kp.2018.0161 · Cited by 475
The ROSE (Risk Stratification of Syncope in the Emergency Department) Study
Reed, M. J., Newby, D. E., Coull, A. J., Prescott, R. J., Jacques, K. G., & Gray, A. J. (2010) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2009.09.049 · Cited by 272
Yield of Diagnostic Tests in Evaluating Syncopal Episodes in Older Patients
(2009) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.204 · Cited by 192
Carpenter, C. R., DesPain, B., Keeling, T. N., Shah, M., & Rothenberger, M. (2010) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2010.06.560 · Cited by 169
Metadata
- Authors
- Birnbaum, A., Esses, D., Bijur, P., Wollowitz, A., & Gallagher, E. J.
- Affiliations
- Albert Einstein College of Medicine (US)
- Corresponding author
- Birnbaum, Adrienne
- ORCID
- Bijur, Polly
- Venue
- Annals of Emergency Medicine
- Publisher
- Elsevier BV
- Published
- 2008-08
- Volume
- 52
- Issue
- 2
- Pages
- 151-159
- ISSN
- 0196-0644 (ISSN-L)
- OpenAlex
- W2025968703
- Cited by
- 148
- References
- 21
- Citations by year
- 2026: 5 · 2025: 3 · 2024: 4 · 2023: 6 · 2022: 2 · 2021: 3 · 2020: 5 · 2019: 6 · 2018: 13 · 2017: 5 · 2016: 7 · 2015: 10 · 2014: 18 · 2013: 12 · 2012: 10
- FWCI
- 13.70
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Annals of Emergency Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Cardiovascular Syncope and Autonomic Disorders
- Health Sciences › Medicine › Emergency Medicine › Emergency and Acute Care Studies
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Keywords
- San Francisco Syncope Rule, syncope, presyncope, emergency department, generalizability, risk stratification, myocardial infarction, cardiac arrhythmias, stroke, subarachnoid hemorrhage, pulmonary embolism, hemorrhage
- MeSH terms
- Adult, Decision Support Techniques, Emergency Service, Hospital, Heart Diseases, Hemorrhage, Humans, Pulmonary Embolism, Sensitivity and Specificity, Syncope, Cohort Studies, Observation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review