The DOI matches its Crossref record; 42 of the 43 references it cites were found in a registry or an index; 43 of the 60 sources its claims cite were checked for support.
Enhancing Ecological Validity: Virtual Reality Assessment of Executive Functioning in Children and Adolescents with ADHD
Open accessAbstract
Background: SmartAction-VR uses virtual reality to simulate daily life tasks and assess cognitive performance based on the multi-errand paradigm. This study explored whether this new task could provide insights into the executive functioning of children and adolescents with ADHD in their everyday activities. Methods: A cross-sectional study was conducted between November 2021 and December 2022. It consisted of one session and was divided into two parts (cognitive tests; and SmartAction-VR). The sample comprised 76 children and adolescents with a median age (IQR) of 13 (11–14) years and an age range of 9–17 years. Of these participants, 60.50% (n = 46) were males. Out of this sample, 40 participants were in the ADHD group and 36 were in the neurotypical group. The following instruments were used: Waisman Activities of Daily Living Scale, Assessment of Sensory Processing and Executive Functioning, Pediatric Simulator Disease Questionnaire, Digit span subtest, Stroop test, NEPSY-II Subtest of Auditory Attention and Cognitive Flexibility, Trail Making Test, Zoo Map Test, and SmartAction-VR. Results: The ADHD group demonstrated lower accuracy (U = 406, p = 0.010), higher values for total errors (U = 292, p = 0.001), more commissions (U = 417, p = 0.003), new actions (U = 470, p = 0.014), and forgetting actions (U = 406, p = 0.010), as well as fewer perseverations compared to the neurotypical group (U = 540.5, p = 0.029). Additionally, participants who forgot more actions were found to have lower independence in daily life (r = −0.281, p = 0.024). Conclusions: The correlations between the results of SmartAction-VR and activities of daily living, as well as cognitive tests, suggest that this new task could be useful for evaluating executive functioning in daily life.
Overview
CoChat Summary
TL;DR
This cross-sectional study tested whether SmartAction-VR, an immersive multiple-errands virtual reality task, can assess executive functioning in daily life in children and adolescents with ADHD compared with neurotypical peers. The ADHD group showed lower accuracy and more total errors, commissions, new actions, and forgetting actions on SmartAction-VR, with some error types correlating with daily-life independence and traditional cognitive tests.
Key findings
- On SmartAction-VR, the ADHD group had lower accuracy (U = 406, p = 0.010), more total errors (U = 292, p = 0.001), more commissions (U = 417, p = 0.003), more new actions (U = 470, p = 0.014), and more forgetting actions (U = 406, p = 0.010), but fewer perseverations (U = 540.5, p = 0.029) than the neurotypical group.
- On traditional cognitive tests, the ADHD group took longer on TMT-A (U = 279, p < 0.001) and TMT-B (U = 175.5, p < 0.001), made more TMT errors (TMT-A: U = 576.5, p = 0.036; TMT-B: U = 335, p < 0.001), scored lower on Digit Span forward (U = 419, p = 0.001) and backward (U = 491, p = 0.014), showed more Stroop interference (U = 502.5, p = 0.034), made more Zoo Map planning errors (U = 278, p = 0.001) with longer execution time (U = 344.5, p = 0.001), and had more NEPSY-II flexibility errors (U = 435, p = 0.006).
- Daily-life measures showed the ADHD group had lower W-ADL scores (U = 520, p = 0.037) and more EPYFEI difficulties across executive attention, sensory processing, behavioral/emotional self-regulation, problem solving, inhibitory control, and total score (total: U = 159, p < 0.001). Forgetting more actions on SmartAction-VR was associated with lower independence in daily life (r = −0.281, p = 0.024).
- No significant between-group differences were found on Peds-SSQ before or after SmartAction-VR, but intragroup increases occurred for fatigue in the ADHD group (Z = −1.992, p = 0.046) and for neck discomfort (Z = −2.555, p = 0.011) and dizziness (Z = −2.315, p = 0.021) in the neurotypical group.
Methods
- Cross-sectional study conducted between November 2021 and December 2022 at the Faculty of Health Sciences, University of Granada, Spain. Participants were 76 children and adolescents aged 9–17 years, median age 13 (IQR 11–14), 60.50% male (n = 46), divided into an ADHD group (n = 40) and a neurotypical group (n = 36) using non-probability convenience sampling.
- Instruments included guardian-completed sociodemographic and functional questionnaires (W-ADL, EPYFEI), participant self-report (Peds-SSQ), cognitive tests (Digit Span, Stroop, NEPSY-II Cognitive Flexibility, Trail Making Test, Zoo Map), and SmartAction-VR, a Unity 3D/Oculus Quest 2 multiple-errands task with five scenarios (hall, bedroom, kitchen, street, stationery store).
- Because variables were non-normally distributed, medians and IQRs were computed; Mann–Whitney U tests compared groups, Wilcoxon signed-rank tests assessed intragroup Peds-SSQ changes, and Spearman correlations examined associations among SmartAction-VR, cognitive tests, and daily-life measures, with p < 0.05.
Limitations
- The paper states that non-probability convenience sampling may limit extrapolation of results, and that the small sample size—due to the project duration and family availability—may have reduced statistical power and generalizability.
- The paper notes future studies should extend recruitment, diversify recruitment channels, use stratified random sampling, calculate statistical power, and study the psychometric properties of SmartAction-VR; these are presented as future directions rather than completed validation.
- Evident from the text: the study is cross-sectional and single-session, so it cannot establish predictive or longitudinal validity of SmartAction-VR for real-world ADHD outcomes.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
33 Valid · 3 Not valid · 8 Not checked · 82 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Traditional assessment methods for ADHD, which have been used since the 1980s, have highlighted the differences in executive functions (EFs) in people with ADHD compared with their neurotypical peers.”
§ Enhancing Ecological Validity: Virtual Reality Assessment of Executive Functioning in Children and Adolescents with ADHD > 1. Introduction
What the sources say
- Partly supportedcites [3] Diamond, 2013, Executive functions, Annu. Rev. Psychol. sourceExperimental — accuracy not yet measured
The “Canary in the Coal Mine” section describes ADHD as a disorder of executive functions, and “Differences and Similarities Between Executive Functions and Related Terms” says EFs have historically been assessed with laboratory tests. Neither passage says that traditional ADHD assessments, used since the 1980s, demonstrated differences between people with ADHD and neurotypical peers. Page numbers are unavailable in our copy. (LLM, conf=0.78)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, their accuracy in assessing functional deficits in ADHD may be limited.”
§ Enhancing Ecological Validity: Virtual Reality Assessment of Executive Functioning in Children and Adolescents with ADHD > 1. Introduction
What the sources say
- Partly supportedcites [4] Burgess, 2006, The case for the development and use of “ecologically valid” measures of executive function in experimental and clinical neuropsychology, J. Int. Neuropsychol. Soc. sourceExperimental — accuracy not yet measured
In “Argument 5,” the paper reports that traditional executive-function tests had weaker associations with carers’ ratings of everyday problems than a more ecologically valid task. This supports the concern about assessing functional deficits, but the passage does not establish that limitation specifically for ADHD. The paper’s ADHD mention, in “What Is Function-Led Research?”, concerns the use of alternative tests to investigate that condition. (LLM, conf=0.84)
- Partly supportedcites [5] Kirkham, 2024, Immersive Virtual Reality-Based Methods for Assessing Executive Functioning: Systematic Review, JMIR Serious Games sourceExperimental — accuracy not yet measured
The Introduction (Background; page not provided) says traditional executive-function tests may align poorly with real-world functioning, supporting the concern about assessing functional deficits. It does not establish that traditional ADHD assessments specifically have this limitation; the paper discusses executive-function assessments more broadly. (LLM, conf=0.85)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Typically conducted in clinical or laboratory settings, these tests often evaluate specific skills in isolation, potentially overlooking interactions between different EFs and their relevance to daily activities [4,5].”
§ Enhancing Ecological Validity: Virtual Reality Assessment of Executive Functioning in Children and Adolescents with ADHD > 1. Introduction
What the sources say
- Partly supportedcites [4] Burgess, 2006, The case for the development and use of “ecologically valid” measures of executive function in experimental and clinical neuropsychology, J. Int. Neuropsychol. Soc. sourceExperimental — accuracy not yet measured
In “What Is Function-Led Research? An Example and Conclusion” (page not specified), the paper contrasts existing executive-function tests performed in a lab or examination room with tests carried out in the real world. It does not establish that traditional ADHD tests specifically are typically conducted in clinical or laboratory settings; its discussion of ADHD concerns uses of the Multiple Errands and Six Element tests. (LLM, conf=0.82)
- Partly supportedcites [5] Kirkham, 2024, Immersive Virtual Reality-Based Methods for Assessing Executive Functioning: Systematic Review, JMIR Serious Games sourceExperimental — accuracy not yet measured
The Introduction > Background describes traditional executive-function tests as abstract measures conducted in a testing environment, in contrast to everyday functioning. It does not establish that traditional ADHD tests specifically are typically conducted in clinical or laboratory settings. The cited copy provides no page number for this passage. (LLM, conf=0.76)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Likewise, regarding EPYFEI [17], this group exhibited more difficulties in executive functioning and sensory processing in daily life, with the following results: executive attention, U = 87, p < 0.001; sensory processing, U = 431, p < 0.001; behavioral and emotional self-regulation, U = 440, p = 0.004; problem solving, U = 304.5, p < 0.001; inhibitory control, U = 248, p < 0.001; and EPYFEI total”
§ Enhancing Ecological Validity: Virtual Reality Assessment of Executive Functioning in Children and Adolescents with ADHD > 3. Results
What the sources say
- Supportedcites [17] Romero-Ayuso, D., Jorquera-Cabrera, S., Segura-Fragoso, A., Toledano-González, A., Rodríguez-Martínez, M.C., and Triviño-Juárez, J.M. (2018). Assessment of Sensory Processing and Executive Functions in Childhood: Development, Reliability, and Validity of the EPYFEI. Front. Pediatr., 6. source
The citation is attached to the EPYFEI, identifying the instrument used for the citing study’s ADHD-versus-neurotypical comparison. The source’s Results (Factor Analysis and Internal Consistency; page unavailable) identify executive attention as an EPYFEI factor; the comparison and U statistic are presented as the citing study’s own results, not attributed to this source. (LLM, conf=0.90)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“For the EPYFEI total score, higher values indicate greater difficulties, with a cutoff point of ≥46.5 allowing for a differentiation between children and adolescents with and without difficulties in sensory processing and executive functioning in daily life.”
§ Enhancing Ecological Validity: Virtual Reality Assessment of Executive Functioning in Children and Adolescents with ADHD > 2. Materials and Methods > 2.3. Instruments
What the sources say
- Partly supportedcites [17] Romero-Ayuso, D., Jorquera-Cabrera, S., Segura-Fragoso, A., Toledano-González, A., Rodríguez-Martínez, M.C., and Triviño-Juárez, J.M. (2018). Assessment of Sensory Processing and Executive Functions in Childhood: Development, Reliability, and Validity of the EPYFEI. Front. Pediatr., 6. sourceExperimental — accuracy not yet measured
The Results (Interpretability; page not provided) identify 46.5 as the optimal EPYFEI total-score cutoff, and the Discussion (Discriminant Validity; page not provided) says it differentiates children with typical development from children with neurodevelopmental disorders. The study concerns children aged 3–11, not adolescents, and establishes this cutoff for those two groups rather than for everyone with and without sensory-processing or executive-function difficulties. (LLM, conf=0.87)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
96 more claims · 17 with their cited sources checked
Create a free account to see all 126 claims and every source verdict.
- It may state two separate claims as one. 15
- Probably not a substantial claim. 11
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentz = -1.992reported p = .046 · recomputed p = .046
“(Z = −1.992, p = .046”
- Consistentz = -2.555reported p = .011 · recomputed p = .011
“(Z = −2.555, p = .011”
- Consistentz = -2.315reported p = .021 · recomputed p = .021
“(Z = −2.315, p = .021”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“In the ADHD group, 63.4% (n = 26) were on methylphenidate as their usual pharmacological treatment (Table 2).”
§ Enhancing Ecological Validity: Virtual Reality Assessment of Executive Functioning in Children and Adolescents with ADHD > 3. Results
Reported 63.4 · recomputed 65
Citations
Cites
Diamond, A. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143750 · Cited by 13,268 · cited 1×
“These evaluations measure cognitive processes such as working memory, inhibitory control, cognitive flexibility, planning, action monitoring, and problem-solving [3].”
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“This could have reduced the statistical power of the study, potentially lowering the probability of detecting a true effect if one exists and reducing the likelihood that a statistically significant result reflects a real effect [46].”
BackgroundInterventions shown to aid executive function development in children 4 to 12 years old
Diamond, A., & Lee, K. (2011) · Science · doi:10.1126/science.1204529 · Cited by 2,901 · cited 1×
“This type of task identifies specific problems through realistic scenarios, therefore helping clinicians design intervention strategies that can be integrated into the child’s daily routines, and thereby improving the person’s overall functioning [31].”
BackgroundFaraone, S. V., Banaschewski, T., Coghill, D., Zheng, Y., Biederman, J., Bellgrove, M. A., Newcorn, J. H., Gignac, M., Al Saud, N. M., Manor, I., et al. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.01.022 · Cited by 1,545 · cited 1×
“These difficulties can persistently and severely affect behavior, with a prevalence of approximately 5.9% among children and adolescents [2].”
BackgroundInfluentialVirtual reality in neuroscience research and therapy
Bohil, C. J., Alicea, B., & Biocca, F. A. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn3122 · Cited by 1,108
BURGESS, P. W., ALDERMAN, N., FORBES, C., COSTELLO, A., M-A.COATES, L., DAWSON, D. R., ANDERSON, N. D., GILBERT, S. J., DUMONTHEIL, I., & CHANNON, S. (2006) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617706060310 · Cited by 663
Improving digit span assessment of short-term verbal memory
Woods, D. L., Kishiyama, M. M., Yund, E. W., Herron, T. J., Edwards, B., Poliva, O., Hink, R. F., & Reed, B. (2011) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2010.493149 · Cited by 380 · cited 2×
“The test demonstrated very good reliability (Cronbach’s alpha = 0.83) [19].”
BackgroundInfluentialThe ‘Real-World Approach’ and Its Problems: A Critique of the Term Ecological Validity
Holleman, G. A., Hooge, I. T. C., Kemner, C., & Hessels, R. S. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00721 · Cited by 345 · cited 2×
“Moreover, laboratory settings may influence a child’s behavior, increasing anxiety and affecting task performance, thus reducing predictive validity [6].”
BackgroundEcological validity of a simplified version of the multiple errands shopping test
ALDERMAN, N., BURGESS, P. W., KNIGHT, C., & HENMAN, C. (2003) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617703910046 · Cited by 337 · cited 1×
“Errors were classified according to a scheme previously used by other authors for naturalistic tasks [26,27]: omission, commission, estimation, not following rules, asking for help, questions, or comments.”
MethodDomingo-Salvany, A., Bacigalupe, A., Carrasco, J. M., Espelt, A., Ferrando, J., & Borrell, C. (2013) · Gaceta Sanitaria · doi:10.1016/j.gaceta.2012.12.009 · Cited by 325
Research works printed but not linked: 3
- Argimón-Pallas, J., and Jiménez-Vila, J. (2010). Métodos de Investigación Clínica y Epidemiológica, Elsevier. [4th ed.].
- Bacigalupe, 2013, Proposals for social class classification based on the Spanish National Classification of Occupations 2011 using neo-Weberian and neo-Marxist approaches, Gac. Sanit., 27, 263
- 2014, Ecological validity and multitasking environments in the evaluation of the executive functions, Rev. Neurol., 59, 77
Cited by
Babu, A., & Joseph, A. P. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1591504 · Cited by 17
Kourtesis, P., Giatzoglou, E., Vorias, P., Gounari, K. A., Orfanidou, E., & Nega, C. (2025) · Multimodal Technologies and Interaction · doi:10.3390/mti9080076 · Cited by 10
Özaslan, A., Sevri, M., İşeri, E., Karacan, B., Cengiz, M., Karacan, H., Sarıpınar, E. G., Dikmen, A. U., & Güney, E. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13216438 · Cited by 8
Galitskaya, V., Polydoros, G., Drigas, A. S., & Antoniou, A. (2025) · Scientific Electronic Archives · doi:10.36560/18320252078 · Cited by 4
Vinci, L. A., Passaro, A., & Stasolla, F. (2026) · Information · doi:10.3390/info17020186 · Cited by 5
“Children with ADHD tend to perform a greater number of irrelevant actions, suggesting deficits in inhibitory control and action monitoring mechanisms [28].”
Influential
Metadata
- Authors
- Romero-Ayuso, D., del Pino-González, A., Torres-Jiménez, A., Juan-González, J., Celdrán, F. J., Franchella, M. C., Ortega-López, N., Triviño-Juárez, J. M., Garach-Gómez, A., Arrabal-Fernández, L., Medina-Martínez, I., & González, P.
- Affiliations
- Department of Physical Therapy, Occupational Therapy Division, University of Granada, 18071 Granada, Spain
- Universidad de Granada (ES)
- University of Castilla-La Mancha (ES)
- Andalusian Health Service (ES)
- Hospital Universitario Virgen de las Nieves (ES)
- ORCID
- Venue
- Children
- Publisher
- MDPI AG
- Published
- 2024-08-14
- Volume
- 11
- Issue
- 8
- Pages
- 986
- ISSN
- 2227-9067 (ISSN-L)
- PMC
- PMC11353110
- OpenAlex
- W4401576587
- Semantic Scholar
- 654739020ed81d9a97c73b9db9f567dab8d0fadd
- Cited by
- 20
- References
- 43
- Citations by year
- 2026: 11 · 2025: 8 · 2024: 1
- FWCI
- 4.73
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Children (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Proyectos de Investigación del MediaLab- UGR Vicerrectorado de Investigación y Transferencia de la Universidad de Granada 2020 (C-CTS-244-UGR23)
- Consejería de Universidad, Investigación e Innovación (C-CTS-244-UGR23)
- ERDF Andalusia Program 2021–2027 (C-CTS-244-UGR23)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Attention Deficit Hyperactivity Disorder
- Social Sciences › Psychology › Neuropsychology and Physiological Psychology › Developmental and Educational Neuropsychology
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Keywords
- attention deficit hyperactivity disorder, executive function, virtual reality assessment, ecological validity, activities of daily living, children and adolescents, cognitive flexibility, perseveration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Enhancing Ecological Validity: Virtual Reality Assessment of Executive Functioning in Children and Adolescents with ADHD. https://app.cochat.ai/papers/10.3390/children11080986
- The paper
- Romero-Ayuso, D., del Pino-González, A., Torres-Jiménez, A., Juan-González, J., Celdrán, F. J., Franchella, M. C., Ortega-López, N., Triviño-Juárez, J. M., Garach-Gómez, A., Arrabal-Fernández, L., Medina-Martínez, I., & González, P. (2024). Enhancing Ecological Validity: Virtual Reality Assessment of Executive Functioning in Children and Adolescents with ADHD. Children. https://doi.org/10.3390/children11080986
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.