The value added of neurocognitive testing after sports-related concussion
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
Background: Neurocognitive testing has been endorsed as a “cornerstone’ of concussion management by recent Vienna and Prague meetings of the Concussion in Sport Group. Neurocognitive testing is important given the potential unreliability of athlete self-report after injury. Relying only on athletes'ormalities after injury. Study Design: Case control study; Level of evidence, 3. Methods: High school and college athletes with a diagnosed concussion were tested 2 days after injury. Postinjury neurocognitive performance (Immediate Postconcussion Assessment and Cognitive Testing) and symptom (postconcussion symptom) scores were compared with preinjury (baseline) scores and with those of an agex and education-matched noninjured athlete control group. “Abnormal” test performance was determined statistically with Reliable Change Index scores. Results: Sixty-four percent of concussed athletes reported a significant increase in symptoms, as judged by postconcussion symptom scores, compared with preinjury baseline at 2 days after injury. Eighty-three percent of the concussed sample demonstrated significantly poorer neurocognitive test results relative to their own baseline performance. The addition of neurocognitive testing resulted in a net increase in sensitivity of 19%. Ninety-three percent of the sample had either abnormal neurocognitive test results or a significant increase in symptoms, relative to their own baseline; 30% of a control group demonstrated either abnormalities in neurocognitive testing or elevated symptoms, as judged by postconcussion symptom scores. For the concussed group, use of symptom and neurocognitive test results resulted in an increased yield of 29% overreliance on symptoms alone. In contrast, 0% of the control group had both symptoms and abnormal neurocognitive testing. Conclusion: Reliance on patients’ self-reported symptoms after concussion is likely to result in underdiagnosis of concussion and may result in premature return to play. Neurocognitive testing increases diagnostic accuracy when used in conjunction with self-reported symptoms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Apart from this, five of these 15 high-cited articles were relevant to sport-related concussion and cognition assessment methods (45–49).”
From Research on digital tool in cognitive assessment: a bibliometric analysis (2023) · cites this paper as [49]
Citations
Cites
McCrory, P., Johnston, K., Meeuwisse, W., Aubry, M., Cantu, R., Dvorak, J., Graf-Baumann, T., Kelly, J., Lovell, M., & Schamasch, P. (2005) · British Journal of Sports Medicine · doi:10.1136/bjsm.2005.018614 · Cited by 950
Self-citationRelationship Between Concussion and Neuropsychological Performance in College Football Players
Collins, M. W. (1999) · JAMA · doi:10.1001/jama.282.10.964 · Cited by 834
Self-citationField, M., Collins, M. W., Lovell, M. R., & Maroon, J. (2003) · The Journal of Pediatrics · doi:10.1067/mpd.2003.190 · Cited by 802 · cited 1×
“Furthermore, prior research has suggested that premature return to play may be a particularly dangerous practice in children given a likely heightened degree of vulnerability in this group.(4,5,9) Despite the widespread acceptance of neurocognitive testing in professional,(16,20) collegiate,(6,8,19) and high school sp…”
BackgroundSelf-citationConcussion in Professional Football: Reconstruction of Game Impacts and Injuries
Pellman, E. J., Viano, D. C., Tucker, A. M., Casson, I. R., & Waeckerle, J. F. (2003) · Neurosurgery · doi:10.1093/neurosurgery/53.3.799 · Cited by 675
Sensitivity and specificity of the ImPACT Test Battery for concussion in athletes
SCHATZ, P., PARDINI, J., LOVELL, M., COLLINS, M., & PODELL, K. (2006) · Archives of Clinical Neuropsychology · doi:10.1016/j.acn.2005.08.001 · Cited by 575 · cited 2×
“This test battery has also demonstrated good sensitivity and specificity in prior studies of young athletes, and ImPACT has the capability to discriminate even mildly concussed high school athletes.(26,27,31) It has also been found to correlate with athlete self-report of neurocognitive decline and “fogginess.”
BackgroundMethodSelf-citationInterpreting Change on ImPACT Following Sport Concussion
Iverson, G. L., Lovell, M. R., & Collins, M. W. (2003) · The Clinical Neuropsychologist · doi:10.1076/clin.17.4.460.27934 · Cited by 518 · cited 2×
“An athlete’s test performance was deemed to be reliably different relative to his or her own baseline if the difference between postconcussion and baseline scores on a given composite index of ImPACT was larger than the established RCI scores, as determined in previously published research by Iverson et al.13 Iverson…”
ResultSelf-citationRecovery from mild concussion in high school athletes
Lovell, M. R., Collins, M. W., Iverson, G. L., Field, M., Maroon, J. C., Cantu, R., Podell, K., Powell, J. W., Belza, M., & Fu, F. H. (2003) · Journal of Neurosurgery · doi:10.3171/jns.2003.98.2.0296 · Cited by 492 · cited 3×
“Recent research has demonstrated that even in mildly concussed athletes, there can be a pronounced memory decline, lasting for at least 7 days after injury.(10,22) These data have led to a reexamination of previous return-to-play guidelines and a reconsideration of return-to-play standards that were heavily symptom ba…”
BackgroundMethodResultSelf-citationNeuropsychological Assessment of the College Football Player
Lovell, M. R., & Collins, M. W. (1998) · Journal of Head Trauma Rehabilitation · doi:10.1097/00001199-199804000-00004 · Cited by 452 · cited 1×
“The minimization of postconcussion symptoms (PCS) is a well-known phenomenon at all levels of competition.(7,18,19) An athlete’s apparent fear of removal from a game or of losing his or her position on the team may tempt some athletes to deny or underreport postconcussive symptoms.”
BackgroundSelf-citationCumulative effects of concussion in amateur athletes
Iverson, G. L., Gaetz, M., Lovell, M. R., & Collins, M. W. (2004) · Brain Injury · doi:10.1080/02699050310001617352 · Cited by 433
Self-citationEchemendia, R. J., Putukian, M., Mackin, R. S., Julian, L., & Shoss, N. (2001) · Clinical Journal of Sport Medicine · doi:10.1097/00042752-200101000-00005 · Cited by 393
Diagnosis and management of concussion in sports
Kelly, J. P., & Rosenberg, J. H. (1997) · Neurology · doi:10.1212/wnl.48.3.575 · Cited by 339
Cantu, R. C. (2001) · PubMed Central · Cited by 327
Aubry, M., Cantu, R., Dvorak, J., Graf-Baumann, T., Johnston, K. M., Kelly, J., Lovell, M., McCrory, P., Meeuwisse, W. H., & Schamasch, P. (2002) · Clinical Journal of Sport Medicine · doi:10.1097/00042752-200201000-00005 · Cited by 305
Self-citationGrade 1 or “Ding” Concussions in High School Athletes
Lovell, M. R., Collins, M. W., Iverson, G. L., Johnston, K. M., & Bradley, J. P. (2004) · The American Journal of Sports Medicine · doi:10.1177/0363546503260723 · Cited by 295 · cited 1×
“The ImPACT test battery has undergone extensive validation through multiple studies and is currently used throughout professional and amateur sports.(11-14,22,23,31) This study was designed to evaluate the individual and combined sensitivity and specificity of player symptom reporting, as judged by PCS score and neuro…”
MethodSelf-citationBARR, W. B., & McCREA, M. (2001) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617701766052 · Cited by 294 · cited 1×
“to account for practice effect and other factors that can influence test scores over repeated testing.(3,10,27) The RCI scores allow a clinician to account for measurement error surrounding test-retest difference score and therefore adjust each score for practice effects secondary to multiple exposures to the particul…”
BackgroundValidity of ImPACT for measuring processing speed following sports-related concussion
Iverson, G. L., Lovell, M. R., & Collins, M. W. (2005) · Journal of Clinical and Experimental Neuropsychology · doi:10.1081/13803390490918435 · Cited by 278 · cited 2×
“These composite scores were constructed to measure the broad neurocognitive domains that their names suggest, and recent validity studies have indicated good convergence with more traditional neuropsychological tests.(14) Multiple composite scores were constructed to reflect the reality that athletes who have suffered…”
BackgroundMethodSelf-citationMcCrory, P., Johnston, K., Meeuwisse, W., Aubry, M., Cantu, R., Dvorak, J., Graf-Baumann, T., Kelly, J., Lovell, M., & Schamasch, P. (2005) · Clinical Journal of Sport Medicine · doi:10.1097/01.jsm.0000159931.77191.29 · Cited by 244
Self-citationPellman, E. J., Lovell, M. R., Viano, D. C., & Casson, I. R. (2006) · Neurosurgery · doi:10.1227/01.neu.0000200272.56192.62 · Cited by 218
Self-citationTackling concussions in sports.
Tagliabue, P. (2003) · PubMed · doi:10.1227/01.neu.0000083559.68424.3f · Cited by 196
Bailes, J. E., & Cantu, R. C. (2001) · Neurosurgery · doi:10.1097/00006123-200101000-00005 · Cited by 175 · cited 1×
“5 million concussion injuries occur in American football in the United States alone.(2) The diagnosis and management of sports-related concussion have traditionally relied heavily on an athlete’s selfreport of symptoms, but these symptoms may not always be accurately reported to team medical personnel.”
BackgroundConcussion in Contact Sports: Reliable Change Indices of Impairment and Recovery
Hinton-Bayre, A. D., Geffen, G. M., Geffen, L. B., McFarland, K. A., & Frijs, P. (1999) · Journal of Clinical and Experimental Neuropsychology · doi:10.1076/jcen.21.1.70.945 · Cited by 163 · cited 3×
“to account for practice effect and other factors that can influence test scores over repeated testing.(3,10,27) The RCI scores allow a clinician to account for measurement error surrounding test-retest difference score and therefore adjust each score for practice effects secondary to multiple exposures to the particul…”
BackgroundResultConcussions During the 1997 Canadian Football League Season
Delaney, J. S., Lacroix, V. J., Leclerc, S., & Johnston, K. M. (2000) · Clinical Journal of Sport Medicine · doi:10.1097/00042752-200001000-00003 · Cited by 154 · cited 1×
“The minimization of postconcussion symptoms (PCS) is a well-known phenomenon at all levels of competition.(7,18,19) An athlete’s apparent fear of removal from a game or of losing his or her position on the team may tempt some athletes to deny or underreport postconcussive symptoms.”
BackgroundReturn to play following sports-related concussion
Lovell, M. R., Collins, M. W., & Bradley, J. P. (2004) · Clinics in Sports Medicine · doi:10.1016/j.csm.2004.04.001 · Cited by 152 · cited 1×
“These symptoms usually occur with no detectable pathologic changes, and traditional neurodiagnostic tests such as CT, MRI, and electroencephalogram are generally insensitive in measuring the subtle neurologic changes after injury.(17) Recent research has indicated that sports-related concussion is a very common injury…”
BackgroundSelf-citationCerebral Concussion in Athletes: Evaluation and Neuropsychological Testing
Maroon, J. C., Lovell, M. R., Norwig, J., Podell, K., Powell, J. W., & Hartl, R. (2000) · Neurosurgery · doi:10.1097/00006123-200009000-00027 · Cited by 149 · cited 2×
“The test battery used in this study was ImPACT.(24) The computer-based neurocognitive assessment tool includes a demographic questionnaire, symptom inventory, injury evaluation form, and a 20-minute neurocognitive test battery.”
MethodSelf-citationEnduring effects of concussion in youth athletes
Moser, R. (2002) · Archives of Clinical Neuropsychology · doi:10.1016/s0887-6177(01)00108-1 · Cited by 140 · cited 1×
“This test battery has also demonstrated good sensitivity and specificity in prior studies of young athletes, and ImPACT has the capability to discriminate even mildly concussed high school athletes.(26,27,31) It has also been found to correlate with athlete self-report of neurocognitive decline and “fogginess.”
BackgroundConcussion in Professional Football: Neuropsychological Testing—Part 6
Pellman, E. J., Lovell, M. R., Viano, D. C., Casson, I. R., & Tucker, A. M. (2004) · Neurosurgery · doi:10.1227/01.neu.0000149244.97560.91 · Cited by 136
Self-citationCantu, R. C. (1992) · Sports Medicine · doi:10.2165/00007256-199214010-00005 · Cited by 130
Relation between subjective fogginess and neuropsychological testing following concussion
IVERSON, G. L., GAETZ, M., LOVELL, M. R., & COLLINS, M. W. (2004) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617704106139 · Cited by 129
Self-citationNaugle, R. I., Chelune, G. J., Cheek, R., Lüders, H. O., & Awad, I. A. (1993) · Archives of Clinical Neuropsychology · doi:10.1016/0887-6177(93)90002-i · Cited by 56 · cited 2×
“This test battery has also demonstrated good sensitivity and specificity in prior studies of young athletes, and ImPACT has the capability to discriminate even mildly concussed high school athletes.(26,27,31) It has also been found to correlate with athlete self-report of neurocognitive decline and “fogginess.”
BackgroundTraumatic Brain Injury in Sports: An International Neuropsychological Perspective
Lovell, M., Barth, J., Collins, M., & Echemendia, R. (2020) · Taylor & Francis eBooks · doi:10.1201/9780367810535 · Cited by 55
Self-citationNaugle, R. I., Chelune, G. J., Cheek, R., et al. (1993) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/8.5.381 · Cited by 39
Traumatic Brain Injury in Sports
Delmonico, R. L. (2005) · Journal of Head Trauma Rehabilitation · doi:10.1097/00001199-200501000-00011 · Cited by 37
INACCURACY OF SYMPTOM REPORTING FOLLOWING CONCUSSION IN ATHLETES
Lovell, M. R., Collins, M. W., Maroon, J. C., Cantu, R. C., Hawn, M. A., Burke, C., & Fu, F. H. (2002) · Medicine & Science in Sports & Exercise · doi:10.1097/00005768-200205001-01680 · Cited by 29 · cited 3×
“The minimization of postconcussion symptoms (PCS) is a well-known phenomenon at all levels of competition.(7,18,19) An athlete’s apparent fear of removal from a game or of losing his or her position on the team may tempt some athletes to deny or underreport postconcussive symptoms.”
BackgroundSelf-citation
Research works printed but not linked: 6
- 10.1227/00006123-200101000-00005 · doi:10.1227/00006123-200101000-00005 · Paper page
- Cantu RC, 2001, J Athl Train, 36, 244
- Lovell M, 2004, Traumatic Brain Injury in Sports, 221
- Lovell MR, First Annual Meeting of the Concussion in Sport
- 10.1227/00006123-200009000-00027 · doi:10.1227/00006123-200009000-00027 · Paper page
- 10.1093/arclin/17.1.91 · doi:10.1093/arclin/17.1.91
Cited by
American Medical Society for Sports Medicine position statement: concussion in sport
Harmon, K. G., Drezner, J. A., Gammons, M., Guskiewicz, K. M., Halstead, M., Herring, S. A., Kutcher, J. S., Pana, A., Putukian, M., & Roberts, W. O. (2013) · British Journal of Sports Medicine · doi:10.1136/bjsports-2012-091941 · Cited by 1,420
The New Neurometabolic Cascade of Concussion
Giza, C. C., & Hovda, D. A. (2014) · Neurosurgery · doi:10.1227/neu.0000000000000505 · Cited by 1,353
“Clinical studies show early postconcussion problems in attention and memory that generally recover over time; these have been measured by using simple sideline questions,(76) the Standardized Assessment of Concussion,(77) paper-and-pencil neuropsychological testing,(78) and computerized cognitive testing.(79) Slowed r…”
National Athletic Trainers' Association Position Statement: Management of Sport Concussion
Broglio, S. P., Cantu, R. C., Gioia, G. A., Guskiewicz, K. M., Kutcher, J., Palm, M., & McLeod, T. C. V. (2014) · Journal of Athletic Training · doi:10.4085/1062-6050-49.1.07 · Cited by 1,106
“19,113,115,116 Regardless of the instrumentation, the emphasis should be on maximizing performance on the baseline and postinjury assessments.”
BackgroundGiza, C. C., Kutcher, J. S., Ashwal, S., Barth, J., Getchius, T. S. D., Gioia, G. A., Gronseth, G. S., Guskiewicz, K., Mandel, S., Manley, G., et al. (2013) · Neurology · doi:10.1212/wnl.0b013e31828d57dd · Cited by 929
Sport-Related Concussion in Children and Adolescents
Halstead, M. E., Walter, K. D., & The Council on Sports Medicine and Fitness (2010) · Pediatrics · doi:10.1542/peds.2010-2005 · Cited by 628
Metadata
- Authors
- Van Kampen, D. A., Lovell, M. R., Pardini, J. E., Collins, M. W., & Fu, F. H.
- Affiliations
- Department of Orthopaedics, University Medical Center Groningen, Groningen, the Netherlands
- University of Pittsburgh Medical Center (US)
- Corresponding author
- Lovell, Mark R.
- Venue
- The American Journal of Sports Medicine
- Publisher
- SAGE Publications
- Published
- 2006-10
- Volume
- 34
- Issue
- 10
- Pages
- 1630-1635
- ISSN
- 0363-5465 (ISSN-L)
- 1552-3365
- OpenAlex
- W2144530436
- Cited by
- 331
- References
- 31
- Citations by year
- 2026: 3 · 2025: 2 · 2024: 3 · 2023: 8 · 2022: 6 · 2021: 20 · 2020: 12 · 2019: 20 · 2018: 20 · 2017: 18 · 2016: 17 · 2015: 19 · 2014: 37 · 2013: 23 · 2012: 27
- FWCI
- 8.99
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- The American Journal of Sports Medicine (publishedVersion)
- PubMed (publishedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion)
- Funders
- Dartmouth College
- Topics
- Health Sciences › Medicine › Clinical Neurology › Traumatic Brain Injury Research
- Health Sciences › Medicine › Orthopedics and Sports Medicine › Sports injuries and prevention
- Health Sciences › Medicine › Clinical Neurology › Traumatic Brain Injury and Neurovascular Disturbances
- Keywords
- sports-related concussion, neurocognitive testing, post-concussion symptoms, diagnostic accuracy, self-reported symptoms, return to sport, high school athletes, college athletes, reliable change index
- MeSH terms
- Adolescent, Athletic Injuries, Brain Concussion, Diagnosis, Computer-Assisted, Female, Humans, Male, Neuropsychological Tests, Sensitivity and Specificity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.