Predicting risk of emergency admission to hospital using primary care data: derivation and validation of QAdmissions score
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Objective: To develop and externally validate a risk algorithm (QAdmissions) to estimate the risk of emergency hospital admission for patients aged 18–100 years in primary care. Design: Prospective open cohort study using routinely collected data from general practice linked to hospital episode data during the 2-year study period 1 January 2010 to 31 December 2011. Setting: 405 general practices in England contributing to the national QResearch database to develop the algorithm. Two validation cohorts to validate the algorithm (1) 202 different QResearch practices and (2) 343 practices in England contributing to the Clinical Practice Research DataLink (CPRD). All general practices had data linked to hospital episode statistics at the individual patient level. Participants: We studied 2 849 381 patients aged 18–100 years in the derivation cohort with over 4.6 million person-years of follow-up. 265 573 of these patients had one or more emergency admissions during follow-up. For the QResearch validation cohort, we identified 1 340 622 patients aged 18–100 years with over 2.2 million person-years of follow-up. Of these patients, 132 723 had one or more emergency admissions during follow-up. The CPRD cohort included 2 475 360 patients aged 18–100 years with over 3.8 million person-years of follow-up. 234 204 of these patients had one or more emergency admissions during follow-up. We excluded patients without a valid NHS number and a valid Townsend score. Endpoint: First (ie, incident) emergency admission to hospital in the next 2 years as recorded on the linked hospital episodes records. Risk factors: Candidate variables recorded on the general practitioner computer system including (1) demographic variables (age, sex, strategic health authority, Townsend deprivation score, ethnicity); (2) lifestyle variables (smoking, alcohol intake); (3) chronic diseases; (4) prescribed medication; (5) clinical values (body mass index, systolic blood pressure); (6) laboratory test results (haemoglobin, platelets, erythrocyte sedimentation rate, ratio of total serum cholesterol to high density lipoprotein cholesterol concentrations, liver function tests). We also included the number of emergency admissions in the preceding year based on information recorded on the linked hospital episodes records. Results: The final QAdmissions algorithm incorporated 30 variables. When applied to the QResearch validation cohort, it explained 41% of the variation in women and 43% of that in men. The D statistic for QAdmissions was 1.7 in women and 1.8 in men. The receiver operating curve statistic was 0.78 for men and 0.77 for women. QAdmissions had good performance on all measures of discrimination and calibration. The positive predictive value for emergency admissions for the top tenth of patients at highest risk was 42% and the sensitivity was 39%. The results for the CPRD validation cohort were similar. Conclusions: The QAdmissions model provided a valid measure of absolute risk of emergency admission to hospital in the general population as shown by its performance in a separate validation cohort. Further research is needed to evaluate the cost-effectiveness of using these algorithms in primary care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating
Steyerberg, E. W. (2019) · Statistics for Biology and Health · doi:10.1007/978-3-030-16399-0 · Cited by 3,281
Multiple Imputation of Missing Values
Royston, P. (2004) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0400400301 · Cited by 2,340 · cited 1×
“Our final model was fitted based on five multiply imputed datasets using Rubin’s rules to combine estimates and standard errors to allow for the uncertainty due to imputing missing data.(20) We took the logarithm of HR for each variable from the final model and used these as weights for the risk equations.”
MethodSteyerberg, E. W. (2009) · Statistics for Biology and Health · doi:10.1007/978-0-387-77244-8 · Cited by 1,491
Predicting cardiovascular risk in England and Wales: prospective derivation and validation of QRISK2
Hippisley-Cox, J., Coupland, C., Vinogradova, Y., Robson, J., Minhas, R., Sheikh, A., & Brindle, P. (2008) · BMJ · doi:10.1136/bmj.39609.449676.25 · Cited by 1,459
Self-citationThe use of fractional polynomials to model continuous risk variables in epidemiology
Royston, P., Ambler, G., & Sauerbrei, W. (1999) · International Journal of Epidemiology · doi:10.1093/ije/28.5.964 · Cited by 1,066 · cited 1×
“We used fractional polynomials to model non-linear risk relationships with age and body mass index where appropriate.(19) We tested for interactions between each variable and age and included significant interactions in the final model where they improved the model fit.”
MethodJick, H., Jick, S. S., & Derby, L. E. (1991) · BMJ · doi:10.1136/bmj.302.6779.766 · Cited by 839 · cited 1×
“UK general practices have good levels of accuracy and completeness in recording clinical diagnoses and prescribed medications.(32) 33 We think our study has good face validity since it has been conducted in a setting where the majority of patients in the UK are assessed, treated and followed up.”
BackgroundDonzé, J., Aujesky, D., Williams, D., & Schnipper, J. L. (2013) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.3023 · Cited by 553 · cited 1×
“71), although their risk prediction model was designed to identify patients at high risk of 30 day readmission to hospital, which is an outcome different from the one in our study.(27) We have not provided definite comment on the threshold of absolute risk that should be used for intervention, as that would require co…”
ResultA new measure of prognostic separation in survival data
Royston, P., & Sauerbrei, W. (2004) · Statistics in Medicine · doi:10.1002/sim.1621 · Cited by 450
Cited by
Hippisley-Cox, J., Coupland, C., & Brindle, P. (2017) · BMJ · doi:10.1136/bmj.j2099 · Cited by 1,703
Self-citationClegg, A., Bates, C., Young, J., Ryan, R., Nichols, L., Ann Teale, E., Mohammed, M. A., Parry, J., & Marshall, T. (2016) · Age and Ageing · doi:10.1093/ageing/afw039 · Cited by 1,303
Goldstein, B. A., Navar, A. M., Pencina, M. J., & Ioannidis, J. P. A. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw042 · Cited by 936
Ayala Solares, J. R., Diletta Raimondi, F. E., Zhu, Y., Rahimian, F., Canoy, D., Tran, J., Pinho Gomes, A. C., Payberah, A. H., Zottoli, M., Nazarzadeh, M., et al. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103337 · Cited by 247
“More recently, however, statistical machine learning techniques such as logistic regression [16], support vector machines (SVM) [17], Cox proportional hazard model [18], and random forest [19] have also been employed for mining reliable predictive patterns in EHR data.”
MethodA Bayesian Hierarchical Network for Combining Heterogeneous Data Sources in Medical Diagnoses
Donnat, C., Miolane, N., Bunbury, F., & Kreindler, J. (2020) · arXiv · doi:10.48550/arxiv.2007.13847 · Cited by 7
Metadata
- Authors
- Hippisley-Cox, J., & Coupland, C.
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2013-08
- Volume
- 3
- Issue
- 8
- Pages
- e003482
- ISSN
- 2044-6055 (ISSN-L)
- OpenAlex
- W1968633584
- Cited by
- 122
- References
- 8
- FWCI
- 7.38
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Predicting risk of emergency admission to hospital using primary care data: derivation and validation of QAdmissions score. https://app.cochat.ai/papers/10.1136/bmjopen-2013-003482
- The paper
- Hippisley-Cox, J., & Coupland, C. (2013). Predicting risk of emergency admission to hospital using primary care data: derivation and validation of QAdmissions score. BMJ Open. https://doi.org/10.1136/bmjopen-2013-003482
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.