The DOI matches its Crossref record.
The THINC-Integrated Tool (THINC-it) Screening Assessment for Cognitive Dysfunction: Validation in Patients With Major Depressive Disorder
Abstract
OBJECTIVE: To validate the THINC-integrated tool (THINC-it)-a freely available, patient-administered, computerized screening tool integrating subjective and objective measures of cognitive function in adults with major depressive disorder (MDD). METHODS: Subjects aged 18 to 65 years (n = 100) with recurrent MDD experiencing a major depressive episode of at least moderate severity were evaluated and compared to age-, sex-, and education-matched healthy controls (n = 100). Between January and June 2016, subjects completed the THINC-it, which includes variants of the Choice Reaction Time Identification Task (IDN), One-Back Test, Digit Symbol Substitution Test, Trail Making Test-Part B, and the Perceived Deficits Questionnaire for Depression-5-item (PDQ-5-D). RESULTS: The THINC-it required approximately 10 to 15 minutes for administration and was capable of detecting cognitive deficits in adults with MDD. A total of 44.4% of adults with MDD exhibited cognitive performance at ≥ 1.0 SD below that of healthy controls on standardized mean scores of the THINC-it. Concurrent validity of the overall tool, based on a calculated composite score, was acceptable (r = 0.539, P < .001). Concurrent validity of the component tests ranged from -0.083 (IDN) to 0.929 (PDQ-5-D). Qualitative survey results indicated that there was a high level of satisfaction and perceived value in administering the THINC-it regarding its impact on the appropriateness and quality of care being received. CONCLUSIONS: The THINC-it is a valid and sensitive tool for detecting cognitive dysfunction in adults with MDD that is free, easy to use, and rapidly administered. The THINC-it should be incorporated into the assessment and measurement of all patients with MDD, particularly among those with enduring functional impairment. TRIAL REGISTRATION: ClinicalTrials.gov identifier: NCT02508493.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The app has been validated to identify cognitive dysfunction within the context of depressive disorder [28].”
Citations
Cited by
Sorted by citations
Items 101–168 of 168
Adelman, M. R., Aalbers, G., Matcham, F., Simblett, S. K., Leightley, D., Siddi, S., Haro, J. M., Oetzmann, C., Narayan, V. A., Hotopf, M. H., et al. (2025) · Depression and Anxiety · doi:10.1155/da/1509978 · Cited by 4
“All THINC-it modules have been validated against paper and pencil versions [28] and are sensitive to changes in cognitive functioning in adults with MDD [30, 33].”
InfluentialDimensions and Predictors of Personal Recovery in Major Depression
Luciano, M., Carmassi, C., & Albert, U. (2022) · Comprehensive approach to psychiatry · doi:10.1007/978-3-030-98301-7_13 · Cited by 6
Szmyd, J., Lewczuk, K., Teopiz, K. M., McIntyre, R. S., & Wichniak, A. (2023) · Brain Sciences · doi:10.3390/brainsci13030389 · Cited by 5
“The THINC-it tool is an easy-to-use mobile application (THINC-it) that can be used to screen and measure cognitive functions not only in patients suffering from depression [26,27].”
MethodSelf-citationShibaoka, M., Masuda, M., Iwasawa, S., Ikezawa, S., Eguchi, H., & Nakagome, K. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1404518 · Cited by 4
Navarra‐Ventura, G., Serra, P. R., Castro, A., Moreno, J. J. M., Roca, M., & Gili, M. (2025) · Psychiatry Research · doi:10.1016/j.psychres.2025.116636 · Cited by 3
Turner, W., Brühl, A. B., Böker, H., Schulze, B., Marschall, K., Marca, R. L., Pfaff, M., Russmann, T., & Schmidt‐Trucksäss, A. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-081299 · Cited by 4
Nejati, V., Khorrami, A. S., Vaziri, Z., Shahri, F., Yazdchi, M., Abdolmanafi, V., Paydarfard, S., & Golshan, A. (2024) · Journal of Neural Transmission · doi:10.1007/s00702-024-02852-5 · Cited by 3
Hafiz, P., Miskowiak, K. W., Kessing, L. V., et al. (2018) · International Conference on Digital Health · doi:10.1145/3194658.3194691 · Cited by 3
“THINC-it [4] is a computerized cognitive assessment tool developed for Major Depressive Disorder (MDD) patients.”
MethodYen, Y., Chiu, N.-Y., Hwang, T., Su, T., Yang, Y.-K., Chen, C., Li, C., Su, K., Lai, T., & Chang, C. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12030359 · Cited by 3
“For other objective cognitive measures, such as SCIP-D [12], or composite cognitive measures, such as THINC-it [10], trained staff, specific device, and more time is needed compared to TCQ.”
BackgroundMethodSuccessful treatment with guanfacine in a long‐ COVID case manifesting marked cognitive impairment
Kondo, T., Higa, R., Kuniba, M., et al. (2024) · Neuropsychopharmacology Reports · doi:10.1002/npr2.12466 · Cited by 3
“At baseline examinations, the THINC-it, a digital battery consisting of the five-item version of the perceived deficit questionnaire (PDQ-5), choice reaction time (CRT), 1-back test, digit symbol sub-stitution test (DSST), and TMT-B, 11 revealed poor capability in attention, working memory, and executive function (Fig…”
ResultJohe, K. K., Kay, G. G., Kumar, S., Burdick, K. E., McIntyre, R. S., Papakostas, G. I., & D, M. F. M. (2020) · Annals of Clinical Psychiatry · doi:10.1177/104012372003200308 · Cited by 3
Self-citationThe THINC-it tool: temporal sensitivity to change over time
Zhu, N., Huang, J., Su, Y., Lu, J., Wu, X., Yang, L., Chen, J., & Fang, Y. (2024) · BMC Psychiatry · doi:10.1186/s12888-024-06170-8 · Cited by 4
“Primary cognitive impairment was analyzed using a composite z score of the THINC-it, according to Mclntyre [15].”
MethodZhu, N., Zhang, Q., Huang, J., Tong, J., Gong, H., Zhu, M., Lu, W. H., Zhang, J., & Sun, X.-R. (2025) · World Journal of Psychiatry · doi:10.5498/wjp.v15.i3.99408 · Cited by 3
Gut microbiota reshapes host energy metabolism to modulate depressive behaviors
Lei, P., Qi, Z., Ma, Q., Zhao, B., Wen, B., Jiang, W., Xi, W., Liu, Y., 寻玉凤, Zhang, S., et al. (2026) · Gut Microbes · doi:10.1080/19490976.2026.2662556 · Cited by 3
Cao, B., Xiao, M., Chen, X., Zhao, Y., Pan, Z., McIntyre, R. S., & Chen, H. (2021) · Nordic Journal of Psychiatry · doi:10.1080/08039488.2021.1965654 · Cited by 2
“There are currently a number of computerized cognitive test batteries widely used in MDD research, such as the Cambridge Neuropsychological Test Automated Battery (CANTAB) [57,58], the CNS Vital Signs (CNSVS) [59], Cogstate [60], IntegNeuro [61], MyCognition Quotient (MyCQ) [62], THINC-Integrated Tool (THINC-it) [63],…”
MethodSelf-citationAkhtar, A., Nwofe, E. S., Parveen, S., & Windle, K. (2025) · International Journal of Mental Health · doi:10.1080/00207411.2025.2472433 · Cited by 1
Xu, L., He, J., Yang, L., Du, D., Yang, F., Feng, L., Jin, Y., Li, C., & Yang, J. (2025) · BMC Psychiatry · doi:10.1186/s12888-025-07393-z · Cited by 2
“…due to reliance on insensitive instruments like dementia scales [18], ecological validity deficits from computerized tests that poorly simulate real-world demands [19, 20], and feasibility barriers arising from costly or time-intensive neuroimaging and neuropsychological assessments [21].”
Ross-Adelman, M., Aalbers, G., Matcham, F., Leightley, D., Oetzmann, C., Carr, E., Siddi, S., Haro, J. M., Annas, P., Dalby, M., et al. (2026) · Neuroscience Applied · doi:10.1016/j.nsa.2026.106985
“Cognition was assessed using the THINC-it ® app, a self-administered mobile tool validated for use in MDD that takes 10-15 min to complete (McIntyre et al., 2017; THINC-it physician guide, 2017).”
InfluentialCAT‐Hokkaido: A tablet‐based assessment of cognitive impairment in schizophrenia
Toyomaki, A., Watanabe, H., Sawagashira, R., Kubota, C., Hashimoto, N., & Kato, T. A. (2026) · Psychiatry and Clinical Neurosciences Reports · doi:10.1002/pcn5.70339 · Cited by 1
Hamada, F., Gotoh, L., Tomiyama, Y., Sugawara, H., Ogata, M., Kumagai, H., Asada, R., Hatae, R., Yasumatsu, K., & Hori, H. (2026) · Metabolites · doi:10.3390/metabo16050328 · Cited by 1
“To assess cognitive impairment, we used the Thinc-it tool [27].”
Krupa, A. J., Kania, M. J., Podkowa, K., Krawczyk, E., Plencler, I., & Siwek, M. (2026) · Frontiers in Pharmacology · doi:10.3389/fphar.2026.1770558 · Cited by 1
“Furthermore, the use of the THINC-it application for cognitive assessment enables an objective evaluation of treatment effects on cognitive functioning, which is frequently impaired in patients with depression yet remains rarely monitored in routine clinical practice (McIntyre et al., 2017).”
Li, M., Wu, Z., Lu, X., Zalesky, A., Cheng, X., Zhang, Y., Cash, R. F. H., Jin, F., Jia, S., Xiao, Y., et al. (2026) · American Journal of Psychiatry · doi:10.1176/appi.ajp.20251084 · Cited by 2
Hawighorst, A., Knight, M. J., Fourrier, C., Sampson, E., Hori, H., Cearns, M., Jörgens, S., & Baune, B. T. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115590 · Cited by 1
Self-citationMonitoring of adverse events and safety of antidepressants
Češková, E., & Horská, K. (2019) · Psychiatrie pro praxi · doi:10.36290/psy.2019.017 · Cited by 1
Ragguett, R., & McIntyre, R. S. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-813176-3.00038-9 · Cited by 1
Self-citationWhite, K. M., Dawe‐Lane, E., Siddi, S., Lamers, F., Simblett, S. K., Alacid, G. R., Ivan, A., Myin‐Germeys, I., Haro, J. M., Oetzmann, C., et al. (2022) · Research Square · doi:10.21203/rs.3.rs-1622706/v1 · Cited by 1
Relationship between Cognitive Remediation and Evaluation Tools in Clinical Routine.
Franza, F., Solomita, B., Pellegrino, F., & Aldi, G. (2018) · PubMed
Residual symptoms of depression and their importance in common clinical practice
Češková, E. (2020) · Psychiatrie pro praxi · doi:10.36290/psy.2020.011
Escala de síntomas cognitivos en depresión (EsADFUN)
de Leon, E. P., Mejía-Martínez, K., Ruíz-Chow, Á. A., Monsiváis-Ríos, R., & Álvarez-Bernal, C. A. (2019) · Archivos de Neurociencias · doi:10.31157/archneurosciencesmex.v24i4.186
Klaiber, I., Schönfeldt‐Lecuona, C., & Kiefer, M. (2021) · Nervenheilkunde · doi:10.1055/a-1300-3619 · Cited by 1
“Mittlerweile wurden aber erste, ökonomische, leitungsbezogene Screenings wie das Screen for Cognitive Impairment in Psychiatry (SCIP) [92] oder das computergestützte THINC-it-Tool [93] entwickelt.”
BackgroundPark, C. (2019) · TSpace (University of Toronto)
Digital technology-enabled home health care
van de Weijer, S. C. F. (2021) · doi:10.26481/dis.20210901sw
Assessment of cognitive dimensions
Baune, B. T. (2021) · Oxford University Press eBooks · doi:10.1093/med/9780198835554.003.0006
Self-citationEvaluating Cognitive Dysfunction of Major Depressive Disorder in Clinical Settings
Lee, J.-H. (2022) · Psychiatric Annals · doi:10.3928/00485713-20220222-01
Samuel, V., Arora, R., & Virk, P. (2022) · Journal of Psychosocial Nursing and Mental Health Services · doi:10.3928/02793695-20220902-02
de Angel, V., Adeleye, F., Zhang, Y., Cummins, N., Munir, S., Lewis, S., Laporta, E., Matcham, F., Sun, S., Dobson, R., et al. (2022) · doi:10.2196/preprints.42866
Woo, Y. S., Lee, K., Hahn, C., McIntyre, R. S., Teopiz, K. M., & Bahk, W. (2023) · Clinical Psychopharmacology and Neuroscience · doi:10.9758/cpn.23.1135 · Cited by 1
“The THINC-it instrument has undergone validation in a Caucasian and Chinese sample and has demonstrated the ability to identify cognitive impairment in individuals with MDD [15,18].”
BackgroundMethodResultInfluentialSelf-citationNoda, T., Nishikawa, M., Matsuda, Y., Hayashi, D., & Kito, S. (2023) · Research Square · doi:10.21203/rs.3.rs-3680639/v1
Tubbs, J. D., Mallard, T. T., Dalby, M., Jiang, Y., Lee, Y. A., Choi, K. W., Ge, T., Plath, N., Hammer-Helmich, L., Granka, J. M., et al. (2025) · medRxiv · doi:10.1101/2025.02.14.25322257
Self-citationLiu, J., Li, K., Li, S., Liu, S., Wang, C., Huang, S., Tu, Y., Wang, B., Zhang, P., Luo, Y., et al. (2025) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2025.1555416
Noda, T., Nishikawa, M., Matsuda, Y., Hayashi, D., & Kito, S. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1393605
Huber, R. S., Weinstein, S. M., Sullivan, A. E., Batt, M. M., Voort, J. V., Schreiner, M. W., Are, F. G., Douka, I., DelBello, M. P., Singh, M. K., et al. (2025) · FOCUS The Journal of Lifelong Learning in Psychiatry · doi:10.1176/appi.focus.20240045
Exploring Relations Between Depression and Cognitive Impairment
Zhu, N., Luo, W., & Huang, Z. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-5597-7_16
Cognitive Functioning in Bipolar Disorder
Martínez‐Arán, A., Jiménez, E., Montejo, L., Solé, B., Torrent, C., & Sánchez‐Moreno, J. (2025) · Springer eBooks · doi:10.1007/978-3-031-85519-1_18 · Cited by 2
Furusawa, R., Mafune, K., Hino, A., Inoue, A., & Eguchi, H. (2025) · Journal of UOEH · doi:10.7888/juoeh.47.55
Cha, D. S., Carmona, N. E., Cha, R. H., Zhou, A. J., Subramaniapillai, M., Mansur, R. B., Lee, Y. L., Lee, J. H., Lee, J., Almatham, F., et al. (2018) · Annals of Clinical Psychiatry · doi:10.1177/104012371803000401
“Therefore, the present study provides strength in its exploration and comparison of “non-mood” symptoms (ie, cognitive impairment and sleep disturbances) among adults with MDD.”
InfluentialSelf-citationLocus Coeruleus MR Measured Signal Intensity in Fibromyalgia Relative to Healthy Controls
DeMayo, M. M., Cassidy, C., McCreary, C. R., Trang, T., Harris, A. D., & McGirr, A. (2025) · European Journal of Pain · doi:10.1002/ejp.70173
Matcham, F., Leightley, D., Siddi, S., Lamers, F., White, K. M., Annas, P., de Girolamo, G., Difrancesco, S., Haro, J. M., Horsfall, M., et al. (2022) · Figshare · doi:10.6084/m9.figshare.19211615
Matcham, F., Leightley, D., Siddi, S., Lamers, F., White, K. M., Annas, P., de Girolamo, G., Difrancesco, S., Haro, J. M., Horsfall, M., et al. (2022) · Figshare · doi:10.6084/m9.figshare.19211621
Andrews, J. A., Craven, M. P., Lang, A. R., Guo, B., Morriss, R. K., & Hollis, C. P. (2022) · Figshare · doi:10.6084/m9.figshare.19728368
Matcham, F., Leightley, D., Siddi, S., Lamers, F., White, K. M., Annas, P., de Girolamo, G., Difrancesco, S., Haro, J. M., Horsfall, M., et al. (2022) · Figshare · doi:10.6084/m9.figshare.19211627
Matcham, F., Leightley, D., Siddi, S., Lamers, F., White, K. M., Annas, P., de Girolamo, G., Difrancesco, S., Haro, J. M., Horsfall, M., et al. (2022) · Figshare · doi:10.6084/m9.figshare.19211618
Andrews, J. A., Craven, M. P., Lang, A. R., Guo, B., Morriss, R. K., & Hollis, C. P. (2021) · Figshare · doi:10.6084/m9.figshare.16807603
Matcham, F., Leightley, D., Siddi, S., Lamers, F., White, K. M., Annas, P., de Girolamo, G., Difrancesco, S., Haro, J. M., Horsfall, M., et al. (2022) · Figshare · doi:10.6084/m9.figshare.19211624
Griffiths, C., Banazadeh, A., & Mu, M. (2025) · Open Journal of Depression · doi:10.4236/ojd.2026.151001
Immune-cognitive relationships across viral infections: A transnosological systematic review
Nuber‐Champier, A., Bréville, G., Lalive, P. H., Assal, F., & Péron, J. (2026) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2026.106588 · Cited by 1
Akhtar, A., Nwofe, E. S., Shafiq, S., Parveen, S., & Windle, K. (2026) · BMJ Open · doi:10.1136/bmjopen-2025-109285
“20 The THINC-it tool is another promising screening measure, developed by McIntyre et al , 21 which combines subjective and objective measures.”
Qu, Y., Tong, Y., Yao, L., Lu, J., & Zhang, N. (2026) · Building and Environment · doi:10.1016/j.buildenv.2026.114473
Mauche, N., Kojcinovic, M., Huang, J., Weller, S., Makiol, C., Plewnia, C., & Strauß, M. (2026) · Research Square · doi:10.21203/rs.3.rs-8910222/v1
Jeon, M., Lee, S., Lee, Y., Uam, S.-B., Ahn, Y.-M., & Shin, M. (2026) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2026.1773101 · Cited by 1
“In recent years, tablet-and personal computer (PC)-adapted neuropsychological tools have been introduced; McIntyre et al. reported that a tablet/PC-based instrument could rapidly screen cognitive de fi cits in adults with MDD (29).”
InfluentialSelf-citationZhang, C. H. I., & Xu, F. (2026) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2026.1872083
“These controls, matched to the MDD patients based on age, sex and education level, were not taking any medications that might affect cognitive function (McIntyre et al., 2017).”
Tubbs, J. D., Mallard, T. T., Dalby, M., Jiang, Y., Lee, Y. A., Choi, K. W., Ge, T., Plath, N., Hammer-Helmich, L., Granka, J. M., et al. (2026) · Molecular Psychiatry · doi:10.1038/s41380-026-03712-2 · Cited by 2
Self-citationBriley, P. M., Webster, L., Hall, B., Davison, L., Gallagher, P., Pszczółkowski, S., Lankappa, S. T., Auer, D. P., Liddle, P. F., McAllister-Williams, H., et al. (2026) · Psychological Medicine · doi:10.1017/s0033291726104899
“Cognitive testing used the THINC-it battery of tests (McIntyre et al., 2017) presented on a touch screen tablet.”
Chen, H., Xu, D., Wang, W., Luo, X., Jiang, X., Wan, N., Wei, Y., Wang, T., Zhang, L., Li, X., et al. (2026) · PLoS ONE · doi:10.1371/journal.pone.0355676
Paganin, W. (2026) · Consortium Psychiatricum · doi:10.17816/cp15810
Zhao, R., Cui, G., Zhang, X., 白银霞, Peng, Z., Zhào, H., Wang, R., Ma, W., & Lv, D. (2026) · Frontiers in Neuroscience · doi:10.3389/fnins.2026.1916857
“A shorter time represented better corresponding cognitive function (Dalby et al., 2022; McIntyre et al., 2017; Zhu et al., 2024).”
Hamada, F., Hori, H., Kumagai, H., Ogata, M., Yokoyama, H., Tomiyama, Y., Sugawara, H., Asada, R., Hatanaka, A., Masuda, M., et al. (2026) · Metabolites · doi:10.3390/metabo16090679
“Cognitive function was assessed using the THINC-it cognitive assessment battery [39], which includes four objective cognitive tasks and one self-report questionnaire.”
Metadata
- Authors
- McIntyre, R. S., Best, M. W., Bowie, C. R., Carmona, N. E., Cha, D. S., Lee, Y., Subramaniapillai, M., Mansur, R. B., Barry, H., Baune, B. T., Culpepper, L., Fossati, P., Greer, T. L., Harmer, C., Klag, E., Lam, R. W., Wittchen, H.-U., & Harrison, J.
- Affiliations
- University Health Network (CA)
- Queen's University (CA)
- Centre for Addiction and Mental Health (CA)
- The University of Adelaide (AU)
- Boston University (US)
- Centre National de la Recherche Scientifique (FR)
- The University of Texas Southwestern Medical Center (US)
- Warneford Hospital (GB)
- University of British Columbia (CA)
- King's College London (GB)
- ORCID
- Venue
- The Journal of Clinical Psychiatry
- Publisher
- Physicians Postgraduate Press, Inc
- Published
- 2017-08-23
- Volume
- 78
- Issue
- 7
- Pages
- 873-881
- ISSN
- 0160-6689 (ISSN-L)
- OpenAlex
- W2747517649
- Cited by
- 172
- References
- 0
- Citations by year
- 2026: 21 · 2025: 20 · 2024: 17 · 2023: 22 · 2022: 26 · 2021: 16 · 2020: 15 · 2019: 16 · 2018: 15 · 2017: 4
- FWCI
- 9.54
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Journal of Clinical Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Pharmacology (medical) › Treatment of Major Depression
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Keywords
- cognitive impairment, major depressive disorder, screening tool, computerized cognitive assessment, concurrent validity, Trail Making Test, Digit Symbol Substitution Test, functional disability
- MeSH terms
- Adolescent, Adult, Aged, Cognition Disorders, Major Depressive Disorder, Diagnosis, Computer-Assisted, Female, Humans, Male, Mass Screening, Middle Aged, Neuropsychological Tests, Psychometrics, Recurrence, Reference Values, Reproducibility of Results, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review