The psychometric validation of the Dutch version of the Rivermead Post-Concussion Symptoms Questionnaire (RPQ) after traumatic brain injury (TBI)
Open accessPublished version of a preprint
The DOI matches its Crossref record; 39 of the 40 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Traumatic brain injury (TBI) is one of the most common neurological conditions. It can have wide-ranging physical, cognitive and psychosocial effects. Most people recover within weeks to months after the injury, but a substantial proportion are at risk of developing lasting post-concussion symptoms. The Rivermead Post-Concussion Syndrome Questionnaire (RPQ) is a short validated 16-items self-report instrument to evaluate post-concussive symptoms. The aim of this study was to test psychometrics characteristics of the current Dutch translation of the RPQ. METHODS: To determine the psychometric characteristics of the Dutch RPQ, 472 consecutive patients six months after they presented with a traumatic brain injury in seven medical centers in the Netherlands (N = 397), and in two in Belgium (Flanders) (N = 75) took part in the study which is part of the large prospective longitudinal observational CENTER-TBI-EU-study. Psychometric properties at six months post TBI, were assessed using exploratory and confirmatory factor analyses. Sensitivity was analyzed by comparing RPQ scores and self-reported recovery status of patients with mild vs. moderate and severe TBI. FINDINGS: The Dutch version of RPQ proved good, showing excellent psychometric characteristics: high internal consistency (Cronbach's α .93), and good construct validity, being sensitive to self-reported recovery status at six months post TBI. Moreover, data showed a good fit to the three dimensional structure of separate cognitive, emotional and somatic factors (Chi2 = 119; df = 117; p = .4; CFI = .99; RMSEA = .006), reported earlier in the literature. DISCUSSION: Psychometric characteristics of the Dutch version of RPQ proved excellent to good, and can the instrument therefore be applied for research purposes and in daily clinical practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788 · cited 2×
“06 indicating good fit [29,30] Concurrent criterion validity was assessed by analyzing the influence of important covariates on RPQ scores (GCS, GOSE) using both t-tests or one-way ANOVA, and non-parametric Wilcoxon Rank Sum W tests for independent samples.”
MethodResultlavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955 · cited 1×
“the lavaan-package [28] to performing analyses on the factor structure.”
MethodConfirmatory factor analysis for applied research
(2007) · Choice Reviews Online · doi:10.5860/choice.44-2769 · Cited by 15,614 · cited 8×
“Another limitation of this study was the limited Belgian sample, which was often too small for sound complex analyses, such as CFA.”
MethodResultInfluentialASSESSMENT OF COMA AND IMPAIRED CONSCIOUSNESS
Teasdale, G., & Jennett, B. (1974) · The Lancet · doi:10.1016/s0140-6736(74)91639-0 · Cited by 13,215
Guillemin, F., Bombardier, C., & Beaton, D. (1993) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(93)90142-n · Cited by 6,060 · cited 1×
“A third possible 302 explanation underpinning this may be the way in which measurement-instruments are being 303 translated in accordance to the WHO guidelines of forward and back translation (30).”
MethodNature and Operation of Attitudes
Ajzen, I. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.27 · Cited by 4,321 · cited 1×
“attitude scales that usually exist of a cognitive and affective component [38].”
BackgroundFamily history of subarachnoid haemorrhage: supplemental value of scrutinizing all relatives.
Greebe, P., Bromberg, J. E., Rinkel, G. J., Algra, A., & van Gijn, J. (1997) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.62.3.273 · Cited by 4,139
WILSON, J. T. L., PETTIGREW, L. E. L., & TEASDALE, G. M. (1998) · Journal of Neurotrauma · doi:10.1089/neu.1998.15.573 · Cited by 2,386 · cited 9×
“Six months after the brain injury, GOSE scores reveal that 55.5% (N=248) of the respondents showed good recovery, 25% (N=112) reported moderate disabilities, and 6.7% (N=30) suffered from severe disabilities at that point in time.”
MethodInfluentialPosition statement: definition of traumatic brain injury
Menon, D. K., Schwab, K., Wright, D. W., & Maas, A. I. (2010) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2010.05.017 · Cited by 1,678 · cited 1×
“Traumatic brain injury (TBI) is one of the most common neurological conditions, and occurs 53 when an external force causes brain trauma (1).”
BackgroundKing, N. S., Crawford, S., Wenden, F. J., Moss, N. E. G., & Wade, D. T. (1995) · Journal of Neurology · doi:10.1007/bf00868811 · Cited by 1,460 · cited 3×
“Following this, CFA indicated a lack of fit to unitary model, given the significant Chi-squares (15) (Chi2=285.5; df=120; p<.001; CFI=.99; RMSEA=.06), and a lack of fit to the RPQ3/ RPQ13 two component model(4) (Chi2=271; df=119; p<.001; CFI=.99; RMSEA=.05), but showed a good fit to the three factor structure(18) (Chi…”
MethodInfluentialCan test statistics in covariance structure analysis be trusted?
Hu, L., Bentler, P. M., & Kano, Y. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.2.351 · Cited by 1,425 · cited 1×
“to which the criteria for model fit may not be valid [33].”
BackgroundThe Glasgow Coma Scale at 40 years: standing the test of time
Teasdale, G., Maas, A., Lecky, F., Manley, G., Stocchetti, N., & Murray, G. (2014) · The Lancet Neurology · doi:10.1016/s1474-4422(14)70120-6 · Cited by 1,003 · cited 1×
“Page 8 of 26 were used to differentiate between patients with remaining severe disability (3-4), moderate 165 disability (5-6), and good recovery (21,22).”
MethodWillis, G. B., & Artino, A. R. (2013) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-13-00154.1 · Cited by 685
Maas, A. I. R., Menon, D. K., Steyerberg, E. W., Citerio, G., Lecky, F., Manley, G. T., Hill, S., Legrand, V., & Sorgner, A. (2015) · Neurosurgery · doi:10.1227/neu.0000000000000575 · Cited by 509 · cited 2×
“the study without stating a reason [20].”
BackgroundMagnetic resonance imaging improves 3‐month outcome prediction in mild traumatic brain injury
Yuh, E. L., Mukherjee, P., Lingsma, H. F., Yue, J. K., Ferguson, A. R., Gordon, W. A., Valadka, A. B., Schnyer, D. M., Okonkwo, D. O., Maas, A. I. R., et al. (2013) · Annals of Neurology · doi:10.1002/ana.23783 · Cited by 413 · cited 1×
“Furthermore, imaging techniques often do not show any structural brain damage in this population [13,14].”
BackgroundHou, R., Moss-Morris, R., Peveler, R., Mogg, K., Bradley, B. P., & Belli, A. (2012) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp-2011-300767 · Cited by 381 · cited 7×
“001), and initial 263 diagnoses within 24 hours after the brain injury occurred (GCS Scores) (F(2, 299)=3.”
BackgroundInfluentialvan der Naalt, J., Timmerman, M. E., de Koning, M. E., van der Horn, H. J., Scheenen, M. E., Jacobs, B., Hageman, G., Yilmaz, T., Roks, G., & Spikman, J. M. (2017) · The Lancet Neurology · doi:10.1016/s1474-4422(17)30117-5 · Cited by 362 · cited 4×
“Years of 73 education, pre-injury psychiatric disorders, neck pain and prior TBI were found strong 74 predictors of 6-month post-concussive symptoms (3,5), as were patient’s perceptions of their 75 brain injury, their behavioral responses, passive and avoidant coping styles and emotional 76 distress in response to thi…”
BackgroundMethodInfluentialConstruct validity and reliability of the Rivermead Post-Concussion Symptoms Questionnaire
Eyres, S., Carey, A., Gilworth, G., Neumann, V., & Tennant, A. (2005) · Clinical Rehabilitation · doi:10.1191/0269215505cr905oa · Cited by 335 · cited 9×
“Confirmatory Factor analysis 227 (CFA) was run to testing model fit to possible underlying factor structures that had been 228 described in literature earlier (4,6,17,18).”
BackgroundMethodResultInfluentialSmith-Seemiller, L., Fow, N. R., Kant, R., & Franzen, M. D. (2003) · Brain Injury · doi:10.1080/0269905021000030823 · Cited by 302 · cited 5×
“emotional 99 complaints (irritably, depression, frustration, restlessness), serving as framework in various 100 studies on post-concussion symptoms (3,18).”
BackgroundMethodResultInfluentialThe Rivermead Post Concussion Symptoms Questionnaire: A confirmatory factor analysis
Potter, S., Leigh, E., Wade, D., & Fleminger, S. (2006) · Journal of Neurology · doi:10.1007/s00415-006-0275-z · Cited by 265 · cited 5×
“Confirmatory Factor analysis (CFA) was run to testing model fit to possible underlying factor structures that had been described in literature earlier [4,6,18,19].”
BackgroundMethodResultInfluentialQuality of Life after Brain Injury (QOLIBRI): Scale Validity and Correlates of Quality of Life
von Steinbüchel, N., Wilson, L., Gibbons, H., Hawthorne, G., Höfer, S., Schmidt, S., Bullinger, M., Maas, A., Neugebauer, E., Powell, J., et al. (2010) · Journal of Neurotrauma · doi:10.1089/neu.2009.1077 · Cited by 235
Early prediction of favourable recovery 6 months after mild traumatic brain injury
Stulemeijer, M., van der Werf, S., Borm, G. F., & Vos, P. E. (2008) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.2007.131250 · Cited by 229 · cited 2×
“Stulemeijer et al (2008) showed that 94% of non-brain159 injured patients (wrist-, or ankle distortion) would meet this criterion (19).”
BackgroundKing, N. S. (1996) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.61.1.75 · Cited by 169 · cited 2×
“The items form one scale, but were not 88 always found to tap into the same underlying construct (3,4,14)).”
BackgroundHaagsma, J. A., Scholten, A. C., Andriessen, T. M. J. C., Vos, P. E., Van Beeck, E. F., & Polinder, S. (2015) · Journal of Neurotrauma · doi:10.1089/neu.2013.3283 · Cited by 163 · cited 1×
“Consistent with the findings of others, we found multidimensionality as underlying structure of the RPQ measurement-instrument [3,4,6,18,19,31,32].”
ResultMajdan, M., Plancikova, D., Maas, A., Polinder, S., Feigin, V., Theadom, A., Rusnak, M., Brazinova, A., & Haagsma, J. (2017) · PLOS Medicine · doi:10.1371/journal.pmed.1002331 · Cited by 134
Cnossen, M. C., Winkler, E. A., Yue, J. K., Okonkwo, D. O., Valadka, A. B., Steyerberg, E. W., Lingsma, H. F., Manley, G. T., & the TRACK-TBI Investigators (2017) · Journal of Neurotrauma · doi:10.1089/neu.2016.4819 · Cited by 117 · cited 5×
“emotional 99 complaints (irritably, depression, frustration, restlessness), serving as framework in various 100 studies on post-concussion symptoms (3,18).”
BackgroundMethodResultInfluentialEarly prediction of persisting post‐concussion symptoms following mild and moderate head injuries
King, N. S., Wenden, F. J., Caldwell, F. E., & Wade, D. T. (1999) · British Journal of Clinical Psychology · doi:10.1348/014466599162638 · Cited by 103
Cnossen, M. C., Scholten, A. C., Lingsma, H. F., Synnot, A., Haagsma, J., Steyerberg, P. E. W., & Polinder, S. (2017) · The Journal of Neuropsychiatry and Clinical Neurosciences · doi:10.1176/appi.neuropsych.16090165 · Cited by 79 · cited 1×
“Consistent with the findings of others, we found multidimensionality as underlying structure of the RPQ measurement-instrument [3,4,6,18,19,31,32].”
ResultHerrmann, N., Rapoport, M. J., Rajaram, R. D., Chan, F., Kiss, A., Ma, A. K., Feinstein, A., MCCullagh, S., & Lanctot, K. L. (2009) · Journal of Neuropsychiatry · doi:10.1176/appi.neuropsych.21.2.181 · Cited by 74
Internal construct validity of the Rivermead Post-Concussion Symptoms Questionnaire
Lannsjö, M., Borg, J., Björklund, G., af Geijerstam, L., & Lundgren-Nilsson, Å. (2011) · Journal of Rehabilitation Medicine · doi:10.2340/16501977-0875 · Cited by 73 · cited 5×
“Confirmatory Factor analysis 227 (CFA) was run to testing model fit to possible underlying factor structures that had been 228 described in literature earlier (4,6,17,18).”
BackgroundMethodResultInfluentialYuh, E. L., Hawryluk, G. W. J., & Manley, G. T. (2014) · Neurosurgery · doi:10.1227/neu.0000000000000491 · Cited by 66 · cited 2×
“The items form one scale, but were not always found to tap into the same underlying construct [3,4,14].”
Backgroundvan den Dungen, C., Hoeymans, N., Gijsen, R., van den Akker, M., Boesten, J., Brouwer, H. J., Smeets, H. M., van der Veen, W. J., Verheij, R. A., de Waal, M., et al. (2008) · European Journal of General Practice · doi:10.1080/13814780802436218 · Cited by 31
German validation of Quality of Life after Brain Injury (QOLIBRI) assessment and associated factors
von Steinbüchel, N., Real, R. G. L., Sasse, N., Wilson, L., Otto, C., Mullins, R., Behr, R., Deinsberger, W., Martínez, R., Puschendorf, W., et al. (2017) · PLoS ONE · doi:10.1371/journal.pone.0176668 · Cited by 27
Self-citationKessel, P., de Boer, D., Hendriks, M. C. P., & Plass, A. M. (2017) · BMC Health Services Research · doi:10.1186/s12913-017-2452-4 · Cited by 25
Self-citationReliability and validity of a self‐administration version of DEMQOL‐Proxy
Hendriks, A. A. J., Smith, S. C., Chrysanthaki, T., & Black, N. A. (2016) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.4515 · Cited by 18
Castaño-León, A. M., Navarro-Main, B., Gómez, P. A., Gil, Á. C., Soler, M. D., Lagares, A., Bernabeu, M., von Steinbüchel, N., & Real, R. G. L. (2017) · Evaluation & the Health Professions · doi:10.1177/0163278717702696 · Cited by 17
Self-citationRasch Analysis and Construct Validity of the Disease Burden Morbidity Assessment in Older Adults
Wijers, I. G. M., Ayala, A., Rodríguez‐Blázquez, C., Rodríguez‐Laso, Á., Rodríguez, V. R., & Forjaz, M. J. (2017) · The Gerontologist · doi:10.1093/geront/gnx061 · Cited by 11
Peters, G.-J., Dima, A. L., Plass, A. M., Crutzen, R., Sidey-Gibbons, C. J., & Doyle, F. (2016) · Research Publications (Maastricht University) · Cited by 3
Self-citationMedical care seeking and self care behaviour for minor illnesses
Plass, A. M. (2005) · Pure Amsterdam UMC · Cited by 1
Self-citation
Cited by
Voormolen, D. C., Haagsma, J. A., Polinder, S., Maas, A. I. R., Steyerberg, E. W., Vuleković, P., Sewalt, C. A., Gravesteijn, B. Y., Čović, A., Anđelić, N., et al. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8111921 · Cited by 116
Self-citationMikolić, A., Polinder, S., Steyerberg, E. W., Retel Helmrich, I. R. A., Giacino, J. T., Maas, A. I. R., van der Naalt, J., Voormolen, D. C., von Steinbüchel, N., Wilson, L., et al. (2020) · Journal of Neurotrauma · doi:10.1089/neu.2020.7074 · Cited by 68
von Steinbüchel, N., Rauen, K., Krenz, U., Wu, Y.-J., Čović, A., Plass, A. M., Cunitz, K., Mueller, I., Bockhop, F., Polinder, S., et al. (2021) · Journal of Clinical Medicine · doi:10.3390/jcm10132863 · Cited by 45
“[55], underline the quality of our translations of the instruments based on the procedure applied.”
MethodSelf-citationVarner, C. E., Thompson, C., de Wit, K., Borgundvaag, B., Houston, R., & McLeod, S. L. (2021) · Canadian Journal of Emergency Medicine · doi:10.1007/s43678-020-00076-6 · Cited by 31
Varner, C. E., Thompson, C., de Wit, K., Borgundvaag, B., Houston, R., & McLeod, S. L. (2021) · Academic Emergency Medicine · doi:10.1111/acem.14215 · Cited by 33
Metadata
- Authors
- Plass, A. M., Van Praag, D., Covic, A., Gorbunova, A., Real, R., von Steinbuechel, N., & Dutch and Flemish CENTER TBI investigators
- Affiliations
- Universitätsmedizin Göttingen (DE)
- Corresponding author
- Plass, Anne Marie
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2019-10-24
- Volume
- 14
- Issue
- 10
- Pages
- e0210138
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC6812802
- OpenAlex
- W2981743760
- Semantic Scholar
- 95160c251d9a096045f09317ad390f9f90a17248
- Cited by
- 26
- References
- 40
- Citations by year
- 2026: 2 · 2025: 8 · 2024: 4 · 2023: 2 · 2022: 2 · 2021: 4 · 2020: 2 · 2019: 1
- FWCI
- 1.71
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- GoeScholar The Publication Server of the Georg-August-Universität Göttingen (Georg-August-Universität Göttingen) (submittedVersion, cc-by)
- Funders
- FP7 Science in Society (602150)
- ZNS - Hannelore Kohl Stiftung
- Topics
- Health Sciences › Medicine › Clinical Neurology › Traumatic Brain Injury Research
- Health Sciences › Medicine › Clinical Neurology › Traumatic Brain Injury and Neurovascular Disturbances
- Health Sciences › Medicine › Clinical Neurology › Long-Term Effects of COVID-19
- Keywords
- traumatic brain injury, post-concussion symptoms, Dutch translation, psychometric validation, factor structure, construct validity, internal consistency, mild traumatic brain injury
- MeSH terms
- Chronic Traumatic Encephalopathy, Brain Injuries, Traumatic, Adolescent, Adult, Aged, Belgium, Cognition, Emotions, Female, Humans, Male, Middle Aged, Netherlands, Prospective Studies, Psychometrics, Surveys and Questionnaires, Translations, Reproducibility of Results, Post-Concussion Syndrome, Young Adult, Self Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
![Fig 1 Factors influencing the development of post-concussion symptoms after TBI [2].](https://figures.cochat.ai/paper-figures/b1dae07d552a4e06846f75f43f159dd2/the-psychometric-validation-of-the-dutch-version-of-the-rivermead-post-figure-1.jpg)
