The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index; 23 of the 65 sources its claims cite were checked for support.
Research on digital tool in cognitive assessment: a bibliometric analysis
Open accessAbstract
Objective: The number of research into new cognitive assessment tools has increased rapidly in recent years, sparking great interest among professionals. However, there is still little literature revealing the current status and future trends of digital technology use in cognitive assessment. The aim of this study was to summarize the development of digital cognitive assessment tools through the bibliometric method. Methods: We carried out a comprehensive search in the Web of Science Core Collection to identify relevant papers published in English between January 1, 2003, and April 3, 2023. We used the subjects such as “digital,” “computer,” and “cognitive,” and finally 13,244 related publications were collected. Then we conducted the bibliometric analysis by Bibliometrix” R-package, VOSviewer and CiteSpace software, revealing the prominent countries, authors, institutions, and journals. Results: 11,045 articles and 2,199 reviews were included in our analyzes. The number of annual publications in this field was rising rapidly. The results showed that the most productive countries, authors and institutions were primarily located in economically developed regions, especially the North American, European, and Australian countries. Research cooperation tended to occur in these areas as well. The application of digital technology in cognitive assessment appealed to growing attention during the outbreak of the COVID-19 epidemic. Conclusion: Digital technology uses have had a great impact on cognitive assessment and health care. There have been substantial papers published in these areas in recent years. The findings of the study indicate the great potential of digital technology in cognitive assessment.
Overview
CoChat Summary
TL;DR
This bibliometric analysis of 13,244 publications from 2003–2023 maps research on digital cognitive assessment, showing rapid growth and concentration in economically developed countries. It identifies COVID-19, mental health, dementia/MCI, concussion, and AI-related topics as major hotspots.
Key findings
- The field grew from 104 articles in 2003 to 1,761 in 2022, with an annual growth rate of 5.51%; the exponential fit had R² = 0.996, and the authors projected roughly 2,152 papers in 2023 if the trend continued.
- The United States was the most productive country with 3,953 publications, followed by China (1,132), the United Kingdom (1,129), Australia (830), Germany (764), and Canada (735); the University of Toronto was the top institution with 450 papers, and Ruben C. Gur was the top author with 71 articles (H-index = 25).
- The most frequent keywords included “cognition” (939), “dementia” (511), “depression” (465), “assessment” (383), and “Alzheimer’s disease” (380); the strongest keyword citation bursts were “mental health” (42.36), “schizophrenia” (38.48), “systematic review” (37.48), and “Internet” (32.07).
- Co-citation analysis produced 1,327 nodes, 3,028 edges, and 238 main clusters; the 11 largest clusters included “covid-19” (size = 146, Silhouette = 0.915), “concussion” (size = 113, Silhouette = 0.950), and “machine learning” (size = 26, Silhouette = 1), with total modularity Q = 0.8673 and weighted mean Silhouette = 0.9345.
Methods
- The authors searched the Web of Science Core Collection on April 5, 2023, for English articles and reviews published from January 1, 2003, to April 3, 2023, using terms derived from MeSH and literature, including “cognitive assessment,” “digital,” and “computer”; 13,244 publications were included (11,045 articles and 2,199 reviews).
- Bibliometric analysis used Bibliometrix R-package, VOSviewer, and CiteSpace to describe annual publications, countries/regions, institutions, authors, co-authorship networks, keyword co-occurrence, co-cited references, and citation bursts; Microsoft Excel 2019 was used for annual publication trends.
- Cluster analysis results were evaluated with Modularity (Q-score) and Silhouette (S-score) coefficients.
Limitations
- The paper states that data were solely collected from English articles or reviews in the WoSCC database, partly due to scientometric software limitations and difficulty merging databases such as Scopus and Embase; therefore, some excellent publications may have been missed, including gray articles, meeting abstracts, and patent materials.
- Evident from the text: the authors note that citations of recently published studies were low compared with earlier publications, which may lead to underestimation of the importance of new publications.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures








Verification
Claims the paper makes
12 Valid · 4 Not valid · 29 Not checked · 87 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“First, high concordance may not be guaranteed after simply converting traditional pen-and-paper tests into the digital versions (15, 16).”
§ Research on digital tool in cognitive assessment: a bibliometric analysis > Mini literature review > Current challenge
What the sources say
- Supportedcites [15] Bauer, 2012, Computerized neuropsychological assessment devices: joint position paper of the American Academy of clinical neuropsychology and the National Academy of neuropsychology, Clin Neuropsychol source
The Psychometric Development Issues section (p. ~10, passage 6) states that 'It cannot be assumed that the normative data obtained for an examiner-administered test apply equally well to a computerized version of the same test,' and that comparability studies 'indicate that there are substantive differences in some samples,' concluding that such a computerized adaptation 'is a new test.' The CONCLUSIONS (passage 1) repeat this: adaptation 'should be accompanied by the development of normative or equivalency data... a computerized version is a new test and not merely a slightly different format for an existing test.' This directly supports the hedged claim that high concordance is not guaranteed after simple conversion of pen-and-paper tests to digital form. (LLM, conf=0.92)
- Not checked yetcites [16] Gates, 2015, Computerized and on-line neuropsychological testing for late-life cognition and neurocognitive disorders: are we there yet?, Curr Opin Psychiatry source
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Two reviews about assessing or detecting cognitive changes employing computerized testing in the elderly were also highly cited in this field (43, 44)”
§ Research on digital tool in cognitive assessment: a bibliometric analysis > Results > The basic condition of digital cognitive assessment
What the sources say
- Supportedcites [43] Wild, 2008, Status of computerized cognitive testing in aging: a systematic review, Alzheimers Dement source
The Abstract (Background) identifies this paper as a systematic review of computer-based cognitive testing for detecting cognitive decline in older adults. The Introduction likewise says the review focuses on tests for detecting cognitive changes in the elderly. The statement that the reviews were highly cited is the citing authors’ characterization, not a finding attributed to this source. (LLM, conf=0.93)
- Supportedcites [44] Zygouris, 2015, Computerized cognitive testing for older adults: a review, Am J Alzheimers Dis Other Dement source
The Abstract identifies this work as a review of computerized test batteries used to assess cognition in older adults. The phrase “highly cited in this field” is the citing authors’ characterization, not a finding attributed to this review. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Another important consideration is that their application scenarios are narrowly focused on a few specific places, like hospitals, community clinics, psychological counseling institutions, physical examination centers and specialized experience centers (18).”
§ Research on digital tool in cognitive assessment: a bibliometric analysis > Mini literature review > Current challenge
What the sources say
- Partly supportedcites [18] Chen, 2023, The development of smart eldercare in China, Lancet Reg Health West Pac sourceExperimental — accuracy not yet measured
The Preliminary research section of our copy states that early digital cognitive tools in the Chinese market have 'application scenarios ... narrowly focused to hospitals, psychological counseling institutions, and specialized experience centers, seriously restricting user accessibility', which supports the core of the claim and three of the five listed settings. However, our copy lists only those three settings — 'community clinics' and 'physical examination centers' appear nowhere in it — and the statement is made about digital cognitive TRAINING products for older adults with mild cognitive impairment in China, not cognitive ASSESSMENT tools generally, so the claim both adds settings and shifts the tool type and scope beyond what the source says. (LLM, conf=0.80)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This offered a critical opportunity for the popularity of electronic cognitive assessment tools (70–72).”
§ Research on digital tool in cognitive assessment: a bibliometric analysis > Discussion > The new trends
What the sources say
- Partly supportedcites [70] Detweiler Guarino, 2021, Use of a self-guided computerized cognitive behavioral tool during COVID-19: evaluation study, JMIR Form Res sourceExperimental — accuracy not yet measured
The Introduction reports that the PATH program grew in popularity during the COVID-19 pandemic, creating an opportunity to study use of a self-help resource. But PATH is a computerized cognitive behavioral treatment tool, not an electronic cognitive assessment tool, and the passage does not establish increased popularity for assessment tools generally. (LLM, conf=0.86)
- Could not verifycites [71] Mahoney, 2021, The uptake and effectiveness of online cognitive behaviour therapy for symptoms of anxiety and depression during COVID-19, J Affect Disord sourceExperimental — accuracy not yet measured
The Discussion reports increased uptake of an online cognitive behavioural therapy course during COVID-19, not increased popularity of electronic cognitive assessment tools. The Method > Assessments section describes symptom questionnaires but does not discuss their popularity. Searches for electronic cognitive assessment tools and online cognitive testing found no passage addressing the claim. (LLM, conf=0.78)
- Could not verifycites [72] Wahlund, 2021, Brief online cognitive Behavioural intervention for dysfunctional worry related to the COVID-19 pandemic: a randomised controlled trial, Psychother Psychosom sourceExperimental — accuracy not yet measured
The Introduction and Discussion discuss online psychological interventions and the availability of digital health tools during COVID-19, while Recruitment and Determination of Eligibility describes an online screening battery; the supplied passages give no page numbers. None addresses whether the pandemic created an opportunity for electronic cognitive assessment tools to become popular. Searched for electronic cognitive assessment, popularity, and uptake. (LLM, conf=0.75)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The results showed that the most productive countries, authors and institutions were primarily located in economically developed regions, especially the North American, European, and Australian countries.”
§ Research on digital tool in cognitive assessment: a bibliometric analysis > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
61 more claims
Create a free account to see all 132 claims and to verify the 42 references still open.
- Probably not a substantial claim. 38
- It may state two separate claims as one. 37
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“AI transcription and summarization are already being used during the visit as healthcare institutions are widely adopting ambient AI scribes.44”
From Review of Artificial Intelligence for Clinical Use in Alzheimer's Disease and Related Dementias (2026) · cites this paper as [44]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Research on digital tool in cognitive assessment: a bibliometric analysis > Results > Overview of research trends and hotspots
“In this study, selected keywords were roughly divided into five clusters.”
§ Research on digital tool in cognitive assessment: a bibliometric analysis > Results > Overview of research trends and hotspots
“Cluster 5 in purple color focuses on psychosis with the main keywords “psychosis,” “bipolar disorder” and “schizophrenia.” Cluster 6 in light blue color emphasizes cognitive dysfunction and rehabilitation.”
Citations
Cites
1 retracted
Dementia prevention, intervention, and care: 2020 report of the Lancet Commission
Livingston, G., Huntley, J., Sommerlad, A., Ames, D., Ballard, C., Banerjee, S., Brayne, C., Burns, A., Cohen-Mansfield, J., Cooper, C., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30367-6 · Cited by 10,430
RetractedSoftware survey: VOSviewer, a computer program for bibliometric mapping
van Eck, N. J., & Waltman, L. (2010) · Scientometrics · doi:10.1007/s11192-009-0146-3 · Cited by 21,484
bibliometrix: An R-tool for comprehensive science mapping analysis
Aria, M., & Cuccurullo, C. (2017) · Journal of Informetrics · doi:10.1016/j.joi.2017.08.007 · Cited by 16,064
How to conduct a bibliometric analysis: An overview and guidelines
Donthu, N., Kumar, S., Mukherjee, D., Pandey, N., & Lim, W. M. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2021.04.070 · Cited by 14,329
NIA‐AA Research Framework: Toward a biological definition of Alzheimer's disease
Jack, C. R., Bennett, D. A., Blennow, K., Carrillo, M. C., Dunn, B., Haeberlein, S. B., Holtzman, D. M., Jagust, W., Jessen, F., Karlawish, J., et al. (2018) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2018.02.018 · Cited by 10,537
Santomauro, D. F., Mantilla Herrera, A. M., Shadid, J., Zheng, P., Ashbaugh, C., Pigott, D. M., Abbafati, C., Adolph, C., Amlag, J. O., Aravkin, A. Y., et al. (2021) · The Lancet · doi:10.1016/s0140-6736(21)02143-7 · Cited by 5,444
Ageing as a risk factor for neurodegenerative disease
Hou, Y., Dan, X., Babbar, M., Wei, Y., Hasselbalch, S. G., Croteau, D. L., & Bohr, V. A. (2019) · Nature Reviews Neurology · doi:10.1038/s41582-019-0244-7 · Cited by 3,310 · cited 1×
“Elderly people frequently have dementia and other forms of cognitive impairment since becoming older is still the biggest risk factor for dementia (61).”
BackgroundSearching for intellectual turning points: progressive knowledge domain visualization
Chen, C. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307513100 · Cited by 2,791
Diagnosis and Management of Dementia: Review
Arvanitakis, Z., Shah, R. C., & Bennett, D. A. (2019) · JAMA · doi:10.1001/jama.2019.4782 · Cited by 1,403
Research works printed but not linked: 2
- 2018, "National Institute for Health and Care Excellence: Guidelines," in Dementia: Assessment, management and support for people living with Dementia and their Carers
- Chen, 2016, Cite Space: A Practical Guide for Mapping Scientific Literature
Cited by
Alzola, P., Pardo, C. C., Bermejo‐Pareja, F., Sánchez‐Benavides, G., Peña‐Casanova, J., Puertas‐Martín, V., Fernández‐Calvo, B., & Contador, I. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13123442 · Cited by 66
“These include a lack of consensus among experts, difficulties in interpreting results, the digital divide among older adults, ethical and privacy concerns, or tool updates that may affect the psychometric properties of the tests used [241,242].”
BackgroundYeung, A. W. K., Litvinova, O., Bragazzi, N. L., Khader, Y. S., Rahman, M. M., Said, Z., Istepanian, R. S. H., Koulaouzidis, A., Aremu, A. O., Flanagan, J. M., et al. (2024) · Exploration of Digital Health Technologies · doi:10.37349/edht.2024.00013 · Cited by 18
Thompson, L. I., Gaster, B., Hammers, D. B., Fittipaldi, S., Barrett, A. M., Partrick, K. A., Scholler, E., Tiede, B., Butler, C., & Workgroup, T. C. D. C. A. (2025) · Alzheimer s & Dementia · doi:10.1002/alz.70966 · Cited by 17
Agentic AI for scaling diagnosis and care in neurodegenerative disease
Breithaupt, A. G., Weiner, M. W., Tang, A., Possin, K. L., Sirota, M., Lah, J. J., Levey, A. I., Hentenryck, P. V., Zandehshahvar, R., Gorno-Tempini, M. L., et al. (2026) · Nature Aging · doi:10.1038/s43587-026-01186-z · Cited by 9
“The digital cognitive assessment landscape is advancing rapidly 34,35 , with clinically available tools continually improving in accuracy, accessibility and ecological validity 34,35 .”
Kang, J. M., Manjavong, M., Jin, C., Diaz, A., Ashford, M. T., Eichenbaum, J., Thorp, E., Wragg, E., Zavitz, K. H., Cormack, F. K., et al. (2025) · Alzheimer s Research & Therapy · doi:10.1186/s13195-024-01641-2 · Cited by 11
Metadata
- Authors
- Chen, L., Zhen, W., & Peng, D.
- Affiliations
- Chinese Academy of Medical Sciences & Peking Union Medical College (CN)
- Beijing University of Chinese Medicine (CN)
- Corresponding author
- Peng, Dantao
- Venue
- Frontiers in Psychiatry
- Publisher
- Frontiers Media SA
- Published
- 2023-08-23
- Volume
- 14
- Pages
- 1227261-1227261
- ISSN
- 1664-0640 (ISSN-L)
- PMC
- PMC10482043
- OpenAlex
- W4386086094
- Cited by
- 26
- References
- 73
- Citations by year
- 2026: 10 · 2025: 10 · 2024: 6
- FWCI
- 4.82
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Psychiatry (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Keywords
- digital cognitive assessment, cognitive assessment tools, digital technologies, computer-based testing, research trends, research collaboration, COVID-19 impact on research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Research on digital tool in cognitive assessment: a bibliometric analysis. https://app.cochat.ai/papers/10.3389/fpsyt.2023.1227261
- The paper
- Chen, L., Zhen, W., & Peng, D. (2023). Research on digital tool in cognitive assessment: a bibliometric analysis. Frontiers in Psychiatry. https://doi.org/10.3389/fpsyt.2023.1227261
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.