Test–retest reliability of five frequently used executive tasks in healthy adults
Abstract
Executive tasks are important instruments for neuropsychological and cognitive research, but only a limited number of studies have investigated the test-retest reliability of these tasks. Such information is needed for optimizing task usage, for example, in longitudinal and intervention studies. In this study with healthy adults, we investigated the temporal stability of five executive tasks: the Simon task, a visuoverbal N-back task, a visuospatial N-back task, a running memory task, and the Number-letter task. These five tasks are frequently used in research, but previously published reliability data is very limited or totally lacking. The results from the present study showed considerable variability with the highest test-retest reliabilities amongst the three working memory tasks. Furthermore, reaction time measures indicated practice effects between the two sessions across the tasks. The present results set constraints to the interpretation of the results of longitudinal and intervention studies using these tasks.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
There is evidence for significant performance improvements on WM tasks already within the first two test sessions and even within a single session.
“We employed short (single-session) training as there is evidence for significant performance improvements on WM tasks already within the first two test sessions and even within a single session17.”
From The early effects of external and internal strategies on working memory updating training (2018) · cites this paper as [17]
Cites
Discovering Statistics Using SPSS
Field, A. P., & Miles, J. N. V. (2000) · Medical Entomology and Zoology · Cited by 28,268 · see citing works
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000) · Cognitive Psychology · doi:10.1006/cogp.1999.0734 · Cited by 15,798 · see citing works
Cicchetti, D. V. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.4.284 · Cited by 9,349 · see citing works
A compendium of neuropsychological tests: administration, norms, and commentary
(1991) · Choice Reviews Online · doi:10.5860/choice.29-2400 · Cited by 6,117 · see citing works
QUANTIFYING TEST-RETEST RELIABILITY USING THE INTRACLASS CORRELATION COEFFICIENT AND THE SEM
Weir, J. P. (2005) · The Journal of Strength and Conditioning Research · doi:10.1519/15184.1 · Cited by 4,864 · see citing works
Starting at the beginning: an introduction to coefficient alpha and internal consistency
Streiner, D. L. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8001_18 · Cited by 3,794 · see citing works
Is working memory training effective? A meta-analytic review
Melby-Lervåg, M., & Hulme, C. (2013) · Developmental Psychology · doi:10.1037/a0028228 · Cited by 1,782 · see citing works
The elusive nature of executive functions: a review of our current understanding.
Jurado, M. B., & Rosselli, M. (2007) · Neuropsychology Review · doi:10.1007/s11065-007-9040-z · Cited by 1,684 · see citing works
Psychological Testing: A Practical Approach to Design and Evaluation
Kline, T. (2005) · doi:10.4135/9781483385693 · Cited by 1,588 · see citing works
Is working memory training effective?
Shipstead, Z., Redick, T. S., & Engle, R. W. (2012) · Psychological Bulletin · doi:10.1037/a0027473 · Cited by 1,101 · see citing works
Executive Function: The Search for an Integrated Account
Banich, M. T. (2009) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2009.01615.x · Cited by 840 · see citing works
Beach, S. R., Schulz, R., Castle, N. G., & Rosen, J. (2010) · The Gerontologist · doi:10.1093/geront/gnq053 · Cited by 640 · see citing works
How to Assess the Reliability of Measurements in Rehabilitation
Lexell, J. E., & Downham, D. Y. (2005) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/01.phm.0000176452.17771.20 · Cited by 629 · see citing works
Executive functions: what they are, how they work, and why they evolved
(2012) · Choice Reviews Online · doi:10.5860/choice.50-2366 · Cited by 622 · see citing works
Schmiedek (2010) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2010.00027 · Cited by 607 · see citing works
The Case for Using the Repeatability Coefficient When Calculating Test–Retest Reliability
Vaz, S. M. A., Falkmer, T., Passmore, A. E., Parsons, R. W., & Andreou, P. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073990 · Cited by 476 · see citing works
Measuring Working Memory Capacity With Automated Complex Span Tasks
Redick, T. S., Broadway, J. M., Meier, M. E., Kuriakose, P. S., Unsworth, N., Kane, M. J., & Engle, R. W. (2012) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000123 · Cited by 457 · see citing works
Chen, H., Chen, C. C., Hsueh, I., Huang, S., & Hsieh, C. (2009) · Neurorehabilitation and neural repair · doi:10.1177/1545968308331146 · Cited by 446 · see citing works
Assessing intrarater, interrater, and test-retest reliability of continuous measurements
Rousson, V., Gasser, T., & Seifert, B. (2002) · Statistics in Medicine · doi:10.1002/sim.1253 · Cited by 415 · see citing works
Lowe, C., & Rabbitt, P. (1998) · Neuropsychologia · doi:10.1016/s0028-3932(98)00036-0 · Cited by 344 · see citing works
Effects and mechanisms of working memory training: a review
von Bastian, C. C., & Oberauer, K. (2014) · Psychological Research · doi:10.1007/s00426-013-0524-6 · Cited by 318 · see citing works
The reading span test and its predictive power for reading comprehension ability
Friedman, N. P., & Miyake, A. (2004) · Journal of Memory and Language · doi:10.1016/j.jml.2004.03.008 · Cited by 267 · see citing works
Does working memory training generalize?
Shipstead, Z., Redick, T. S., & Engle, R. W. (2010) · Psychologica Belgica · doi:10.5334/pb-50-3-4-245 · Cited by 242 · see citing works
Effects of working-memory training on striatal dopamine release
Bäckman, L., Nyberg, L., Soveri, A., Johansson, J., Andersson, M., Dahlin, E., Neely, A. S., Virta, J., Laine, M., & Rinne, J. O. (2011) · Science · doi:10.1126/science.1204978 · Cited by 232 · see citing works
Reliability and plasticity of response inhibition and interference control
Wöstmann, N. M., Aichert, D. S., Costa, A., Rubia, K., Möller, H.-J., & Ettinger, U. (2013) · Brain and Cognition · doi:10.1016/j.bandc.2012.09.010 · Cited by 217 · see citing works
Lemay, S., Bédard, M., Rouleau, I., & Tremblay, P.-L. (2004) · The Clinical Neuropsychologist · doi:10.1080/13854040490501718 · Cited by 193 · see citing works
Melby-Lervåg, M., & Hulme, C. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0862-z · Cited by 189 · see citing works
Langenecker, S. A., Zubieta, J., Young, E. A., Akil, H., & Nielson, K. A. (2007) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803390601147611 · Cited by 156 · see citing works
Paap, K. R., & Sawi, O. M. (2016) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2016.10.002 · Cited by 139 · see citing works
The concurrent validity and test?retest reliability of a visuospatial working memory task
HOCKEY, A., & GEFFEN, G. (2004) · Intelligence · doi:10.1016/j.intell.2004.07.009 · Cited by 115 · see citing works
Measurement and Evaluation in Psychology and Education
Thorndike-Christ (2011) · Cited by 109 · see citing works
Kanyongo, G. Y., Brook, G. P., Kyei-Blankson, L., & Gocmen, G. (2007) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1177992480 · Cited by 103 · see citing works
Piper, B., Mueller, S. T., Geerken, A. R., Dixon, K. L., Króliczak, G., Olsen, R. H. J., & Miller, J. K. (2015) · PeerJ · doi:10.7717/peerj.1460 · Cited by 78 · see citing works
Gonçalves, M. M., Pinho, M. S., & Simões, M. R. (2015) · Applied Neuropsychology Adult · doi:10.1080/23279095.2015.1053889 · Cited by 49 · see citing works
Transfer after working memory updating training
Waris, O., Soveri, A., & Laine, M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0138734 · Cited by 47 · see citing works
Self-citationThe composite complex span: French validation of a short working memory task
Gonthier, C., Thomassin, N., & Roulin, J. (2015) · Behavior Research Methods · doi:10.3758/s13428-015-0566-3 · Cited by 31 · see citing works
Troyer, A. K., Rowe, G., Murphy, K. J., Levine, B., Leach, L. R., & Hasher, L. (2014) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2014.00335 · Cited by 31 · see citing works
Jones, S. A. H., Butler, B. C., Kintzel, F., Johnson, A., Klein, R. M., & Eskes, G. A. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00823 · Cited by 27 · see citing works
Woods, D. L., Wyma, J. M., Herron, T. J., & Yund, E. W. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00690 · Cited by 16 · see citing works
Set Shifting Training with Categorization Tasks
Soveri, A., Waris, O., & Laine, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0081693 · Cited by 10 · see citing works
Self-citationDevelopment and Evaluation of an Online, Multicomponent Working Memory Battery
Englund, J. A., Decker, S. L., Woodlief, D. T., & DiStefano, C. (2014) · Assessment · doi:10.1177/1073191114524016 · Cited by 9 · see citing works
A Preliminary Assessment of the Reliability and Validity of a Computerized Working Memory Task
Lovato, N., Lack, L. C., Wright, H., Kemps, E., Cant, M., & Humphreys, J. (2013) · Perceptual and Motor Skills · doi:10.2466/22.24.pms.116.2.368-381 · Cited by 4 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Is bilingualism associated with enhanced executive functioning in adults? A meta-analytic review.
Lehtonen, M., Soveri, A., Laine, A., Järvenpää, J., de Bruin, A., & Antfolk, J. (2018) · Psychological Bulletin · doi:10.1037/bul0000142 · Cited by 646 · see citing works
Self-citationOn the phantom-like appearance of bilingualism effects on neurocognition: (How) should we proceed?
Leivada, E., Westergaard, M. R., Duñabeitia, J. A., & Rothman, J. (2020) · Bilingualism Language and Cognition · doi:10.1017/s1366728920000358 · Cited by 134 · see citing works
Liao, Y.-Y., Chen, I.-H., Hsu, W.-C., Tseng, H., & Wang, R. (2021) · Annals of Physical and Rehabilitation Medicine · doi:10.1016/j.rehab.2021.101492 · Cited by 98 · see citing works
The early effects of external and internal strategies on working memory updating training
Laine, M., Fellman, D., Waris, O., & Nyman, T. J. (2018) · Scientific Reports · doi:10.1038/s41598-018-22396-5 · Cited by 71 · see citing works
Self-citationLiu, C., Cheng, F., Wei, M.-J., & Liao, Y.-Y. (2022) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2022.761053 · Cited by 69 · see citing works
Lopez, K. L., Monachino, A. D., Vincent, K. M., Peck, F. C., & Gabard-Durnam, L. J. (2023) · NeuroImage · doi:10.1016/j.neuroimage.2023.120116 · Cited by 70 · see citing works
Suboptimal phenotypic reliability impedes reproducible human neurosciencePreprint
Nikolaidis, A., Chen, A. A., He, X., Shinohara, R. T., Vogelstein, J. T., Milham, M. P., & Shou, H. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.07.22.501193 · Cited by 63 · see citing works
Gerber, M., Beck, J., Brand, S., Cody, R., Donath, L., Eckert, A., Faude, O., Fischer, X., Hatzinger, M., Holsboer‐Trachsler, E., et al. (2019) · Trials · doi:10.1186/s13063-019-3468-3 · Cited by 56 · see citing works
The relationship between bilingual language use and executive functions
Lehtonen, M., Fyndanis, V., & Jylkkä, J. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00178-9 · Cited by 46 · see citing works
Self-citationCognitive consequences of bilingualism: where to go from here?
Laine, M., & Lehtonen, M. (2018) · Language Cognition and Neuroscience · doi:10.1080/23273798.2018.1462498 · Cited by 47 · see citing works
Self-citationJylkkä, J., Soveri, A., Wahlström, J., Lehtonen, M., Rodríguez‐Fornells, A., & Laine, M. (2017) · Journal of Cognitive Psychology · doi:10.1080/20445911.2017.1282489 · Cited by 41 · see citing works
Self-citationWhat Is Mental Effort: A Clinical Perspective
Wolpe, N., Holton, R., & Fletcher, P. C. (2024) · Biological Psychiatry · doi:10.1016/j.biopsych.2024.01.022 · Cited by 40 · see citing works
On the Reliability of Switching Costs Across Time and Domains
Timmer, K., Calabria, M., Branzi, F. M., Baus, C., & Costa, A. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01032 · Cited by 37 · see citing works
The influence of media exposure on anxiety and working memory during lockdown period in Italy.
Fabio, R. A., & Suriano, R. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18179279 · Cited by 33 · see citing works
Verschueren, J., Tassignon, B., Pluym, B., Cutsem, J. V., Verhagen, E. A. L. M., & MEEUSEN, R. R. (2019) · Archives of Physiotherapy · doi:10.1186/s40945-019-0057-4 · Cited by 33 · see citing works
Individual differences in executive function affect learning with immersive virtual reality
Lawson, A. P., & Mayer, R. E. (2024) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12925 · Cited by 31 · see citing works
Believing is achieving - On the role of treatment expectation in neurofeedback applications
Schönenberg, M., Weingärtner, A.-L., Weimer, K., & Scheeff, J. (2020) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2020.110129 · Cited by 32 · see citing works
Cognitive performance of military men and women during prolonged load carriage
Armstrong, N. C. D., Smith, S. J., Risius, D., Doyle, D. P., Wardle, S. L., Greeves, J. P., House, J. R., Tipton, M., & Lomax, M. (2022) · BMJ Military Health · doi:10.1136/bmjmilitary-2021-002000 · Cited by 31 · see citing works
Experience-based individual differences modulate language, mind and brain outcomes in multilinguals
Luk, G., & Rothman, J. (2022) · Brain and Language · doi:10.1016/j.bandl.2022.105107 · Cited by 30 · see citing works
Williams, D. R., Martin, S. R., & Rast, P. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01646-x · Cited by 31 · see citing works
Reliability and Validity of Smartphone Cognitive Testing for Frontotemporal Lobar Degeneration
Staffaroni, A. M., Clark, A. L., Taylor, J. C., Heuer, H. W., Sanderson-Cimino, M., Wise, A. B., Dhanam, S., Cobigo, Y., Wolf, A., Manoochehri, M., et al. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.4266 · Cited by 28 · see citing works
Yeung, M. K.-C., & Han, Y. M. Y. (2023) · Scientific Reports · doi:10.1038/s41598-023-30552-9 · Cited by 29 · see citing works
Assessing bilingual language switching behavior with Ecological Momentary Assessment
Jylkkä, J., Soveri, A., Laine, M., & Lehtonen, M. (2019) · Bilingualism Language and Cognition · doi:10.1017/s1366728918001190 · Cited by 26 · see citing works
Self-citationZareian, B., Wilson, J., & LeMoult, J. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.660062 · Cited by 29 · see citing works
Sambol, S., Suleyman, E., Scarfo, J., & Ball, M. (2023) · Acta Psychologica · doi:10.1016/j.actpsy.2023.103934 · Cited by 26 · see citing works
Effect of Guarana (Paullinia cupana) on Cognitive Performance: A Systematic Review and Meta-Analysis
Hack, B., Penna, E. M., Talik, T. N., Chandrashekhar, R., & Millard-Stafford, M. L. (2023) · Nutrients · doi:10.3390/nu15020434 · Cited by 23 · see citing works
Inhibition and Calendar Age Explain Variance in Game Performance of Youth Soccer Athletes
Heilmann, F., Wollny, R., & Lautenbach, F. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19031138 · Cited by 22 · see citing works
Spontaneous strategy use during a working memory updating task
Waris, O., Jylkkä, J., Fellman, D., & Laine, M. (2020) · Acta Psychologica · doi:10.1016/j.actpsy.2020.103211 · Cited by 21 · see citing works
Self-citationFriebe, D., Hülsdünker, T., Giesche, F., et al. (2023) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000003153 · Cited by 20 · see citing works
Chenot, Q., Hamery, C., Truninger, M. I., Langer, N., Boissezon, X. D., & Scannella, S. (2024) · Cortex · doi:10.1016/j.cortex.2024.05.019 · Cited by 21 · see citing works
Shared lexical access processes in speaking and listening? An individual differences study.
Hintz, F., Jongman, S. R., Dijkhuis, M., Hoff, V. V. '., McQueen, J. M., & Meyer, A. S. (2019) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000768 · Cited by 20 · see citing works
Skirrow, C., Cashdollar, N. M., Granger, K. T., Jennings, S., Baker, E. K., Barnett, J. H., & Cormack, F. K. (2021) · Applied Neuropsychology Adult · doi:10.1080/23279095.2020.1860987 · Cited by 18 · see citing works
Luo, J., Yeung, P., & Li, H. (2021) · Internet Research · doi:10.1108/intr-01-2021-0078 · Cited by 19 · see citing works
Gerber, M., Colledge, F., de Quervain, D. J. ‐., Filippou, K., Havas, E., Knappe, F., Ludyga, S., Meier, M., Morres, I. D., Panagos, A., et al. (2021) · Trials · doi:10.1186/s13063-021-05808-2 · Cited by 20 · see citing works
Test-retest reliability for common tasks in vision science
Clark, K., Birch-Hurst, K., Pennington, C. R., Petrie, A. C. P., Lee, J. T., & Hedge, C. (2022) · Journal of Vision · doi:10.1167/jov.22.8.18 · Cited by 19 · see citing works
Executive function, motivation, and emotion recognition in high-functioning autism spectrum disorder
Yeung, M. K.-C., & Chan, A. S.-Y. (2020) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2020.103730 · Cited by 17 · see citing works
Holczer, A., Németh, V. L., Vékony, T., Kocsis, K., Király, A., Kincses, Z. T., Vécsei, L., Klivényi, P., & Must, A. (2021) · Neuroscience · doi:10.1016/j.neuroscience.2021.03.001 · Cited by 15 · see citing works
Gerber, M., Cody, R., Beck, J., Brand, S., Donath, L., Eckert, A., Faude, O., Hatzinger, M., Imboden, C., Kreppke, J.-N., et al. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12103370 · Cited by 15 · see citing works
Jonker, N. C., Heitmann, J., Ostafin, B. D., MacLeod, C., Glashouwer, K. A., & de Jong, P. J. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103445 · Cited by 14 · see citing works
Schumann, F., Steinborn, M. B., Flehmig, H. C., Kürten, J., Langner, R., & Huestegge, L. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.946626 · Cited by 14 · see citing works
Lukasik, K. M., Lehtonen, M., Salmi, J., Meinzer, M., Joutsa, J., & Laine, M. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00738 · Cited by 14 · see citing works
Self-citationLittman, R., Hochman, S., & Kalanthroff, E. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02131-3 · Cited by 8 · see citing works
Heilmann, F., Knöbel, S., & Lautenbach, F. (2024) · BMC Psychology · doi:10.1186/s40359-024-02017-9 · Cited by 10 · see citing works
Smithies, T. D., Toth, A. J., & Campbell, M. J. (2024) · Journal of Cognitive Psychology · doi:10.1080/20445911.2024.2357363 · Cited by 9 · see citing works
The structure of executive functions in athletes: A latent variable approach
Brimmell, J., Edwards, E. J., Uiga, L., Wood, G., & Vaughan, R. S. (2025) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2025.102808 · Cited by 7 · see citing works
Hoskens, M. C. J., Uiga, L., Cooke, A., Capio, C. M., & Masters, R. S. W. (2021) · Journal of Experimental Psychology General · doi:10.1037/xge0000905 · Cited by 7 · see citing works
Roeh, A., Schoenfeld, J., RAAB, R., Landes, V., Papazova, I., Haller, B., Strube, W., Halle, M., Falkai, P., Hasan, A., et al. (2021) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000002699 · Cited by 7 · see citing works
Schröder, R., Baumert, P. M., & Ettinger, U. (2021) · Acta Psychologica · doi:10.1016/j.actpsy.2021.103364 · Cited by 6 · see citing works
Luteijn, P. J., van der Wurff, I. S. M., Singh, A. S., Savelberg, H. H. C. M., & de Groot, R. H. M. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.810007 · Cited by 6 · see citing works
Dali, G., Poulton, A., Chen, L. P. E., & Hester, R. (2024) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2024.2364396 · Cited by 6 · see citing works
Kowalczyk, M., Kornacka, M., Wisiecka, K., Młyniec, A., Redeł, A., Szwykowska-Ziemniak, M., & Krejtz, I. (2023) · European Psychologist · doi:10.1027/1016-9040/a000514 · Cited by 7 · see citing works
Test-retest reliability of the simon task: a short version proposal
Cevada, T., Conde, E. F. Q., Marques, D., & Deslandes, A. C. (2019) · Somatosensory & Motor Research · doi:10.1080/08990220.2019.1689114 · Cited by 6 · see citing works
Guerra, A., Hazin, I., Roulin, J., Gall, D. L., & Roy, A. (2021) · Psicologia Reflexão e Crítica · doi:10.1186/s41155-021-00171-2 · Cited by 5 · see citing works
Filippetti, V. A., & Gutiérrez, M. (2024) · The Clinical Neuropsychologist · doi:10.1080/13854046.2024.2423414 · Cited by 4 · see citing works
Dumont, R., Majerus, S., & Hansenne, M. (2021) · Psychologica Belgica · doi:10.5334/pb.534 · Cited by 4 · see citing works
Zhao, X., Wang, L., & Maes, J. H. R. (2021) · Addictive Behaviors Reports · doi:10.1016/j.abrep.2021.100385 · Cited by 6 · see citing works
Saeed, A., Niazi, I. K., Alzahrani, A., Trager, R. J., Haavik, H., & Amjad, I. (2024) · Mental health and physical activity · doi:10.1016/j.mhpa.2024.100637 · Cited by 6 · see citing works
CPNE3 moderates the association between anxiety and working memory
Chen, C., Wang, Z., Chen, C., Xue, G., Lu, S., Liu, H., Dong, Q., & Zhang, M. (2021) · Scientific Reports · doi:10.1038/s41598-021-86263-6 · Cited by 5 · see citing works
Gill, L.-N., Tabry, V., Taylor, V. A., Lussier, M., Martinu, K., Bherer, L., Roy, M., & Rainville, P. (2021) · Frontiers in Pain Research · doi:10.3389/fpain.2021.673027 · Cited by 5 · see citing works
Lehtonen, M., Soveri, A., Laine, A., Järvenpää, J., de Bruin, A., & Antfolk, J. (2018) · doi:10.31234/osf.io/vwcgu · Cited by 4 · see citing works
Self-citationWooten, T., Sansevere, K. S., Siqueira, S., McWilliams, T., Peach, S., Hussey, E. K., Brunyé, T. T., & Ward, N. (2024) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2024.112388 · Cited by 2 · see citing works
OpenWMB: An open-source and automated working memory task battery for OpenSesame
Monteiro, F., Nascimento, L. B., Leitão, J., Santos, E. J. R., Rodrigues, P., Santos, I. M., Simões, F., & Nascimento, C. S. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02397-1 · Cited by 3 · see citing works
What is mental effort: a clinical perspectivePreprint
Wolpe, N., Holton, R., & Fletcher, P. C. (2023) · doi:10.31234/osf.io/tkbq3 · Cited by 3 · see citing works
Investigating age-related differences in semantic control mechanisms involved in creative cognition
Patel, T., MacPherson, S. E., & Hoffman, P. (2025) · Memory & Cognition · doi:10.3758/s13421-025-01753-6 · Cited by 2 · see citing works
Psychometric evidence of digital and online executive function tests: a systematic review
Neves-Teles, T., de Souza, J. B., Zanon, C., & de Almeida, R. M. M. (2026) · International Journal of Testing · doi:10.1080/15305058.2026.2639759 · Cited by 1 · see citing works
Ridgewell, C., Sczuroski, C. E., Merullo, D. J., Lange, E., Hildebrandt, A. M., Ekon, N., Neumeier, W. H., Smith, C. D., & Heaton, K. J. (2025) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2025.112540 · Cited by 1 · see citing works
Neves-Teles, T., de Souza, J. B., & de Almeida, R. M. M. (2024) · Research Square · doi:10.21203/rs.3.rs-5161193/v1 · Cited by 1 · see citing works
Phase of transcranial alternating current stimulation modulates working memory processing speedPreprint
Dimmendaal, J., Xiaojuan, W., Dijkslag, B. J., Huizinga, L. E., Maalderink, S., Priest, M., van Dam, F. J. E., Span, M. M., & Wischnewski, M. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.05.26.727793 · Cited by 1 · see citing works
Cognitive control in written word production
Neophytou, K., Wiley, R. W., & Rapp, B. C. (2024) · Frontiers in Language Sciences · doi:10.3389/flang.2024.1398125
Test-retest reliability and behavioural correlates of pupil responses in an n-back taskPreprint
Bényei, G. L., & Pajkossy, P. (2024) · doi:10.31234/osf.io/vrphq
A preliminary investigation of proximal effects of media multitasking on executive functioning
Seddon, A. L., Law, A. S., Adams, A.-M., & Simmons, F. R. (2025) · Journal of Cognitive Psychology · doi:10.1080/20445911.2025.2525252 · Cited by 1 · see citing works
YÜRÜTÜCÜ İŞLEV BECERİSİNİ ÖLÇMEDE N-GERİ GÖREVİ YAZILIMI: BEYİN ATÖLYESİ + DUYGUSAL UYARANLAR
ÖZGÜR, A., Özhan, Ş. Ç., Tekeli, P., Özeke, V., & Altun, A. (2025) · Eğitim Teknolojisi Kuram ve Uygulama · doi:10.17943/etku.1588306
Liu, T., You, S., Chen, Y., Wu, Q., & Wu, T. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5375743
Bolić, T., Ručević, S., & Brezetić, S. (2025) · Primenjena psihologija · doi:10.19090/pp.v18i2.2568
Slade, B., Williams, B. J., Engelbrecht, R., Woods, W., Bhar, S. S., & Ciorciari, J. (2026) · Biomedicines · doi:10.3390/biomedicines14020452 · Cited by 1 · see citing works
Bényei, G. L., & Pajkossy, P. (2026) · Scientific Reports · doi:10.1038/s41598-026-46731-3
Baumert, P. M., Schröder, R., & Ettinger, U. (2021) · OSF Preprints (OSF Preprints)
Psychometric evaluation of interpretation bias measures for pain
Duijzings, M., Sharpe, L., Ryckeghem, D. M. L. V., Notebaert, L., Coutts‐Bain, D., Pickup, B., Colagiuri, B., & Todd, J. (2026) · Journal of Pain · doi:10.1016/j.jpain.2026.106349
Dimmendaal, J., Wang, X., Dijkslag, B. J., Huizinga, L. E., Maalderink, S., Priest, M., van Dam, F. J. E., Span, M. M., & Wischnewski, M. (2026) · NeuroImage · doi:10.1016/j.neuroimage.2026.122157
A comparative study on executive function of adolescent athletes in different winter sports
Wang, J., Wang, F., Gao, G., Liu, C., & Shi, P. (2026) · BMC Sports Science Medicine and Rehabilitation · doi:10.1186/s13102-026-02004-0
Díaz‐Guerra, D. D., Lugo, M. D. L. C. H., Dapresa, V. L., Galarza, C. R., Pérez, Y. B., Obregón, J., Ruíz, I. I. C., Gamboa, A. J. P., Reinado, K. V. C., & Castillo, E. F. (2026) · Journal of Psychoeducational Assessment · doi:10.1177/07342829261494058
- Authors
- Soveri, A., Lehtonen, M., Karlsson, L. C., Lukasik, K., Antfolk, J., & Laine, M.
- Affiliations
- Åbo Akademi University (FI)
- Corresponding author
- Soveri, Anna
- Venue
- Applied Neuropsychology: Adult
- Publisher
- Informa UK Limited
- Published
- 2016-12-21
- Volume
- 25
- Issue
- 2
- Pages
- 155-165
- ISSN
- 2327-9095 (ISSN-L)
- 2327-9109
- OpenAlex
- W2562548993
- Semantic Scholar
- 7b63a49952c10e604101ad5d950aa0fe286ec4f7
- Cited by
- 81
- References
- 42
- Citations by year
- 2026: 8 · 2025: 7 · 2024: 14 · 2023: 10 · 2022: 8 · 2021: 17 · 2020: 4 · 2019: 6 · 2018: 6 · 2017: 1
- FWCI
- 6.17
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Applied Neuropsychology Adult (publishedVersion)
- PubMed (publishedVersion)
- Åbo Akademi University Research Portal (submittedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Keywords
- executive function, test-retest reliability, temporal stability, Simon task, n-back task, working memory, practice effects, reaction time, healthy adults, longitudinal study
- MeSH terms
- Adult, Female, Humans, Male, Neuropsychological Tests, Psychomotor Performance, Reaction Time, Reproducibility of Results, Young Adult, Executive Function
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review