Prediction of Global Functional Outcome and Post-Concussive Symptoms after Mild Traumatic Brain Injury: External Validation of Prognostic Models in the Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI) Study
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
The majority of traumatic brain injuries (TBIs) are categorized as mild, according to a baseline Glasgow Coma Scale (GCS) score of 13-15. Prognostic models that were developed to predict functional outcome and persistent post-concussive symptoms (PPCS) after mild TBI have rarely been externally validated. We aimed to externally validate models predicting 3-12-month Glasgow Outcome Scale Extended (GOSE) or PPCS in adults with mild TBI. We analyzed data from the Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI) project, which included 2862 adults with mild TBI, with 6-month GOSE available for 2374 and Rivermead Post-Concussion Symptoms Questionnaire (RPQ) results available for 1605 participants. Model performance was evaluated based on calibration (graphically and characterized by slope and intercept) and discrimination (C-index). We validated five published models for 6-month GOSE and three for 6-month PPCS scores. The models used different cutoffs for outcome and some included symptoms measured 2 weeks post-injury. Discriminative ability varied substantially (C-index between 0.58 and 0.79). The models developed in the Corticosteroid Randomisation After Significant Head Injury (CRASH) trial for prediction of GOSE <5 discriminated best (C-index 0.78 and 0.79), but were poorly calibrated. The best performing models for PPCS included 2-week symptoms (C-index 0.75 and 0.76). In conclusion, none of the prognostic models for early prediction of GOSE and PPCS has both good calibration and discrimination in persons with mild TBI. In future studies, prognostic models should be tailored to the population with mild TBI, predicting relevant end-points based on readily available predictors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
mice: Multivariate Imputation by Chained Equations in R
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870
Traumatic brain injury: integrated approaches to improve prevention, clinical care, and research
Maas, A. I. R., Menon, D. K., Adelson, P. D., Andelic, N., Bell, M. J., Belli, A., Bragge, P., Brazinova, A., Büki, A., Chesnut, R. M., et al. (2017) · The Lancet Neurology · doi:10.1016/s1474-4422(17)30371-x · Cited by 2,609
Self-citationBovin, M. J., Marx, B. P., Weathers, F. W., Gallagher, M. W., Rodriguez, P., Schnurr, P. P., & Keane, T. M. (2016) · Psychological Assessment · doi:10.1037/pas0000254 · Cited by 2,532
WILSON, J. T. L., PETTIGREW, L. E. L., & TEASDALE, G. M. (1998) · Journal of Neurotrauma · doi:10.1089/neu.1998.15.573 · Cited by 2,386 · cited 1×
“27 The GOSE was assessed 6 months post–injury, and when outside the time window (range 5–8 months), it was imputed based on GOSE measurements at other time points ( * 30%, described in Steyerberg and coworkers).”
Policy: NIH to balance sex in cell and animal studies
Clayton, J. A., & Collins, F. S. (2014) · Nature · doi:10.1038/509282a · Cited by 1,816
King, N. S., Crawford, S., Wenden, F. J., Moss, N. E. G., & Wade, D. T. (1995) · Journal of Neurology · doi:10.1007/bf00868811 · Cited by 1,460
Carroll, L., Cassidy, J. D., Peloso, P., Borg, J., von Holst, H., Holm, L., Paniak, C., & Pépin, M. (2004) · Journal of Rehabilitation Medicine · doi:10.1080/16501960410023859 · Cited by 1,326
Predictors of clinical recovery from concussion: a systematic review
Iverson, G. L., Gardner, A. J., Terry, D. P., Ponsford, J. L., Sills, A. K., Broshek, D. K., & Solomon, G. S. (2017) · British Journal of Sports Medicine · doi:10.1136/bjsports-2017-097729 · Cited by 917
A calibration hierarchy for risk models was defined: from utopia to empirical data
Van Calster, B., Nieboer, D., Vergouwe, Y., De Cock, B., Pencina, M. J., & Steyerberg, E. W. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.12.005 · Cited by 910 · cited 1×
“2 function.(40) The study was conducted and reported according to the criteria of the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) statement.”
Self-citationCollins, G. S., de Groot, J. A., Dutton, S., Omar, O., Shanyinde, M., Tajar, A., Voysey, M., Wharton, R., Yu, L.-M., Moons, K. G., et al. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-40 · Cited by 729
Acquadro, C., Conway, K., Hareendran, A., & Aaronson, N. (2008) · Value in Health · doi:10.1111/j.1524-4733.2007.00292.x · Cited by 715 · cited 1×
“29 The linguistic validation procedure consisted of multiple steps, including forward translation, cognitive debriefing, backward translation, harmonization, and finalization of translated versions.”
Recommendations for the Use of Common Outcome Measures in Traumatic Brain Injury Research
Wilde, E. A., Whiteneck, G. G., Bogner, J., Bushnik, T., Cifu, D. X., Dikmen, S., French, L., Giacino, J. T., Hart, T., Malec, J. F., et al. (2010) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2010.06.033 · Cited by 461
Self-citationSystematic Review of Multivariable Prognostic Models for Mild Traumatic Brain Injury
Silverberg, N. D., Gardner, A. J., Brubacher, J. R., Panenka, W. J., Li, J. J., & Iverson, G. L. (2015) · Journal of Neurotrauma · doi:10.1089/neu.2014.3600 · Cited by 393
A review of post-concussion syndrome and psychological factors associated with concussion
Broshek, D. K., De Marco, A. P., & Freeman, J. R. (2015) · Brain Injury · doi:10.3109/02699052.2014.974674 · Cited by 379
A Multidimensional Approach to Post-concussion Symptoms in Mild Traumatic Brain Injury
Polinder, S., Cnossen, M. C., Real, R. G. L., Covic, A., Gorbunova, A., Voormolen, D. C., Master, C. L., Haagsma, J. A., Diaz-Arrastia, R., & von Steinbuechel, N. (2018) · Frontiers in Neurology · doi:10.3389/fneur.2018.01113 · Cited by 376
Self-citationvan der Naalt, J., Timmerman, M. E., de Koning, M. E., van der Horn, H. J., Scheenen, M. E., Jacobs, B., Hageman, G., Yilmaz, T., Roks, G., & Spikman, J. M. (2017) · The Lancet Neurology · doi:10.1016/s1474-4422(17)30117-5 · Cited by 362 · cited 1×
“Nevertheless, our study confirms that a significant percentage of persons with mild TBI do not return to baseline global functioning 6 months post-injury.(6,8)”
Wäljas, M., Iverson, G. L., Lange, R. T., Hakulinen, U., Dastidar, P., Huhtala, H., Liimatainen, S., Hartikainen, K., & Öhman, J. (2015) · Journal of Neurotrauma · doi:10.1089/neu.2014.3339 · Cited by 247
Hicks, R., Giacino, J., Harrison-Felix, C., Manley, G., Valadka, A., & Wilde, E. A. (2013) · Journal of Neurotrauma · doi:10.1089/neu.2013.2938 · Cited by 183
Self-citationA new concordance measure for risk prediction models in external validation settings
van Klaveren, D., Gönen, M., Steyerberg, E. W., & Vergouwe, Y. (2016) · Statistics in Medicine · doi:10.1002/sim.6997 · Cited by 48 · cited 1×
“To disentangle their influence on the discriminative ability of logistical regression models, we used the model-based concordance (mbc), which is only influenced by differences in case-mix heterogeneity.(37) All models were validated using patients with GCS 13–15 with all information on the relevant predictors availab…”
Self-citationPlass, A. M., Van Praag, D., Covic, A., Gorbunova, A., Real, R., von Steinbuechel, N., & Dutch and Flemish CENTER TBI investigators (2019) · PLOS ONE · doi:10.1371/journal.pone.0210138 · Cited by 26
Cited by
Traumatic brain injury: progress and challenges in prevention, clinical care, and research
Maas, A. I. R., Menon, D. K., Manley, G. T., Abrams, M., Åkerlund, C., Andelic, N., Aries, M., Bashford, T., Bell, M. J., Bodien, Y. G., et al. (2022) · The Lancet Neurology · doi:10.1016/s1474-4422(22)00309-x · Cited by 1,520
Self-citationA Systematic Review of Treatments of Post-Concussion Symptoms
Heslot, C., Azouvi, P., Perdrieau, V., Granger, A., Lefèvre-Dognin, C., & Cogné, M. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11206224 · Cited by 62
“an individual level [10] but have been found to be statistically predicted by a combination of variables, including pre-injury factors (older age, lower education, pre-existing mental”
Self-citationManagement of Psychological Complications Following Mild Traumatic Brain Injury
Silverberg, N. D., & Mikolić, A. (2023) · Current Neurology and Neuroscience Reports · doi:10.1007/s11910-023-01251-9 · Cited by 39
Self-citationSilverberg, N. D., Cairncross, M., Brasher, P. M. A., Vranceanu, A.-M., Snell, D. L., Yeates, K. O., Panenka, W. J., Iverson, G. L., Debert, C. T., Bayley, M. T., et al. (2022) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2021.12.005 · Cited by 40
King, S., Stapert, S. Z., Winkens, I., van der Naalt, J., van Heugten, C. M., & Rijkeboer, M. M. (2024) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0000000000000942 · Cited by 9
Metadata
- Authors
- Mikolić, A., Polinder, S., Steyerberg, E. W., Retel Helmrich, I. R. A., Giacino, J. T., Maas, A. I. R., van der Naalt, J., Voormolen, D. C., von Steinbüchel, N., Wilson, L., Lingsma, H. F., van Klaveren, D., the Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI) Study Participants and Investigators, Åkerlund, C., Amrein, K., Andelic, N., Andreassen, L., Anke, A., Antoni, A., Audibert, G., Azouvi, P., Azzolini, M. L., Bartels, R., Barzó, P., Beauvais, R., Beer, R., Bellander, B.-M., Belli, A., Benali, H., Berardino, M., Beretta, L., Blaabjerg, M., Bragge, P., Brazinova, A., Brinck, V., Brooker, J., Brorsson, C., Buki, A., Bullinger, M., Cabeleira, M., Caccioppola, A., Calappi, E., Calvi, M. R., Cameron, P., Lozano, G. C., Carbonara, M., Castaño-León, A. M., Cavallo, S., Chevallard, G., Chieregato, A., Citerio, G., di Monza, A., Ceyisakar, I., Clusmann, H., Coburn, M., Coles, J., Cooper, J. D., Correia, M., Čović, A., Curry, N., Czeiter, E., Czosnyka, M., Dahyot-Fizelier, C., Dark, P., Dawes, H., De Keyser, V., Degos, V., Della Corte, F., den Boogert, H., Depreitere, B., Đilvesi, Đ., Dixit, A., Donoghue, E., Dreier, J., Dulière, G.-L., Ercole, A., Esser, P., Ezer, E., Fabricius, M., Feigin, V. L., Foks, K., Frisvold, S., Furmanov, A., Gagliardo, P., Galanaud, D., Gantner, D., Gao, G., George, P., Ghuysne, A., Giga, L., Glocker, B., Golubovic, J., Gomez, P. A., Gratz, J., Gravesteijn, B., Grossi, F., Gruen, R. L., Gupta, D., Haagsma, J. A., Haitsma, I., Helbok, R., Helseth, E., Horton, L., Huijben, J., Hutchinson, P. J., Jacobs, B., Jankowski, S., Jarrett, M., Jiang, J.-Y., Johnson, F., Jones, K., Karan, M., Kolias, A. G., Kompanje, E., Kondziella, D., Koraropoulos, E., Koskinen, L.-O., Kovács, N., Kowark, A., Lagares, A., Lanyon, L., Laureys, S., Lecky, F., Ledoux, D., Lefering, R., Legrand, V., Lejeune, A., Levi, L., Lightfoot, R., Maegele, M., Majdan, M., Manara, A., Manley, G., Martino, C., Maréchal, H., Mattern, J., McMahon, C., Melegh, B., Menon, D., Menovsky, T., Misset, B., Muraleedharan, V., Murray, L., Negru, A., Nelson, D., Newcombe, V., Nieboer, D., Nyirádi, J., Olubukola, O., Oresic, M., Ortolano, F., Palotie, A., Parizel, P. M., Payen, J.-F., Perera, N., Perlbarg, V., Persona, P., Peul, W., Piippo-Karjalainen, A., Pirinen, M., Ples, H., Pomposo, I., Posti, J. P., Puybasset, L., Radoi, A., Ragauskas, A., Raj, R., Rambadagalla, M., Rhodes, J., Richardson, S., Richter, S., Ripatti, S., Rocka, S., Roe, C., Roise, O., Rosand, J., Rosenfeld, J. V., Rosenlund, C., Rosenthal, G., Rossaint, R., Rossi, S., Rueckert, D., Rusnák, M., Sahuquillo, J., Sakowitz, O., Sanchez-Porras, R., Sandor, J., Schäfer, N., Schmidt, S., Schoechl, H., Schoonman, G., Schou, R. F., Schwendenwein, E., Sewalt, C., Skandsen, T., Smielewski, P., Sorinola, A., Stamatakis, E., Stanworth, S., Stevens, R., Stewart, W., Steyerberg, E. W., Stocchetti, N., Sundström, N., Synnot, A., Takala, R., Tamás, V., Tamosuitis, T., Taylor, M. S., Te Ao, B., Tenovuo, O., Theadom, A., Thomas, M., Tibboel, D., Timmers, M., Tolias, C., Trapani, T., Tudora, C. M., Vajkoczy, P., Vallance, S., Valeinis, E., Vámos, Z., van der Jagt, M., Van der Steen, G., van der Naalt, J., van Dijck, J. T. J. M., van Essen, T. A., Van Hecke, W., van Heugten, C., Van Praag, D., Vande Vyvere, T., van Wijk, R. P. J., Vargiolu, A., Vega, E., Velt, K., Verheyden, J., Vespa, P. M., Vilcinis, A. V., Volovici, V., Voormolen, D., Vulekovic, P., Wang, K. K. W., Williams, G., Wilson, L., Winzeck, S., Wolf, S., Yang, Z., Ylén, P., Younsi, A., Zeiler, F. A., Zelinkova, V., Ziverte, A., & Zoerle, T.
- Venue
- Journal of Neurotrauma
- Publisher
- SAGE Publications
- Published
- 2020-10-19
- Volume
- 38
- Issue
- 2
- Pages
- 196-209
- ISSN
- 0897-7151 (ISSN-L)
- 1557-9042
- OpenAlex
- W3088423555
- Cited by
- 68
- References
- 21
- FWCI
- 4.76
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.