The DOI matches its Crossref record; 36 of the 38 references it cites were found in a registry or an index; 1 of the 26 sources its claims cite were checked for support.
Interface design and interaction optimization for spatial computing 3D content creation and immersive environment generation using Apple Vision Pro
Open accessAbstract
Traditional 3D content creation paradigms present significant barriers to meaningful creative expression in XR environments, limiting designers' ability to iterate fluidly between conceptual thinking and spatial implementation. Current tools often disconnect the designer's creative thought process from the immersive context where their work will be experienced, creating a gap between design intention and spatial realization. This disconnect particularly impacts the iterative cycles fundamental to effective design thinking, where creators need to rapidly externalize, test, and refine concepts within their intended spatial context. This research addresses the need for more intuitive, context-aware creation systems that support the iterative nature of creative cognition in immersive environments. We developed Dream Space, a spatial computing system that bridges this gap by enabling designers to think, create, and iterate directly within XR contexts. The system leverages generative AI for rapid prototyping of 3D content and environments, allowing designers to externalize and test creative concepts without breaking their cognitive flow. Through multimodal interaction design utilizing Vision Pro's spatial computing capabilities, creators can manipulate virtual artifacts through natural gestures and gaze, supporting the fluid iteration cycles characteristic of established design thinking frameworks. A mixed-methods evaluation with 20 participants from diverse creative backgrounds demonstrated that spatial computing-based creation paradigms significantly reduce cognitive load in the design process. The system enabled even novice users to complete complex creative tasks within 20-30 minutes, with real-time feedback mechanisms supporting rapid iteration between ideation and implementation. Participants reported enhanced creative flow and reduced technical barriers compared to traditional 3D creation tools. This research contributes to understanding how XR interfaces can better support creative cognition and iterative design processes, offering insights for developing tools that enhance rather than hinder the natural flow of creative thinking in immersive environments.
Overview
CoChat Summary
TL;DR
Dream Space is an Apple Vision Pro spatial-computing system that combines generative AI with gesture, gaze, and voice interaction to support 3D content creation and immersive environment generation. A two-phase mixed-methods study with 20 participants found positive user experience and reduced cognitive load, while identifying remaining issues in stability, scene integration, and model-generation precision.
Key findings
- The system integrates TripoSR for image-to-3D model generation and Blockade Labs for 360° environment generation; optimized image-to-model conversion time dropped from 125–130 seconds to 80–102 seconds.
- In the mixed-methods evaluation, UEQ-S scores were Hedonic Quality 1.75, Pragmatic Quality 1.00, and Overall 1.38 on a −3 to +3 scale; NASA-TLX Overall was 2.00 (SD 0.49), with 100% of participants saying they would use the software in the future and approximately 80% reporting “high” to “very high” task success.
- Novice users reportedly mastered basic operations within 5 minutes and completed full creation tasks within 20 minutes; the abstract states complex creative tasks were completed within 20–30 minutes.
- Performance optimization included adaptive mesh simplification with target face counts of about 80,000 for ordinary interaction models, 100,000 for focus models, and about 10,000 for lightweight real-time rendering; one coral model was reduced from 1.5 million to 52,000 polygons, and ASTC texture compression reduced texture memory consumption by 60–75%.
Methods
- The system was developed using User-Centered Design/Human-Centered Design methods, including field observations, in-depth interviews, rapid prototyping, heuristic evaluation, think-aloud protocols, semi-structured interviews, and task-based observation.
- Evaluation used two rounds: Phase 1 was qualitative with 10 participants completing three core tasks (image/text to 3D model, immersive environment generation/adjustment, and gesture control of 3D models); Phase 2 used 10 different participants in approximately one-hour sessions with mixed methods, including task completion time, operation error rate, 7-point Likert satisfaction ratings, NASA-TLX, and UEQ-S.
- Participants across both phases were aged 18–50 and came from backgrounds including computer science, machine learning, musical composition, botanical research, marketing, and AR/VR development; all provided informed consent.
Limitations
- The paper states that the sample was small and that a larger sample of 20–30 participants would provide more definitive conclusions; it also reports two crashes during resource-intensive operations, frame rates dropping to around 40fps in extreme scenes with over 30 high-detail models exceeding 2 million total faces, a perceived disconnect between generated environments and placed 3D objects, and remaining needs for better model-generation precision/style control and gesture-operation time.
- Evident from the text: the claim that Dream Space improved task completion efficiency by over 50% compared with traditional tools is not supported by a detailed baseline, statistical test, or controlled comparison in the reported evaluation.
- Evident from the text: some quantitative UX metrics are reported for n = 10 even though the overall study involved 20 participants, and the two testing phases used different participants, which limits before-and-after within-subject comparisons.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 9 Not valid · 23 Not checked · 116 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Traditional 3D creation tools mainly rely on traditional 2D input devices such as mouse, keyboard, and touchpad, which are incompatible with the spatial computing and immersive characteristics of XR devices (Makransky and Petersen, 2021).”
What the sources say
- Could not verifycites Makransky and Petersen, 2021 sourceExperimental — accuracy not yet measured
The ‘Defining Immersive Virtual Reality’ section distinguishes desktop 3D worlds from immersive VR, but does not discuss how traditional 3D creation tools are operated. Searches for mouse, keyboard, touchpad, and desktop 3D modelling found no passage saying those devices are the tools’ main inputs or are incompatible with XR. (LLM, conf=0.74)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The system enabled even novice users to complete complex creative tasks within 20 30 minutes, with real time feedback mechanisms supporting rapid iteration between ideation and implementation.”
plainstates a causen = 20- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Traditional hierarchical menu structures cause users to lose orientation in 3D space, leading to the adoption of a spatial position-based functional zoning design.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A mixed methods evaluation with 20 participants from diverse creative backgrounds demonstrated that spatial computing based creation paradigms significantly reduce cognitive load in the design process.”
boostedstates a causen = 20- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“with real time feedback mechanisms supporting rapid iteration between ideation and implementation.”
plainstates a causen = 20- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
34 more claims
Create a free account to see all 148 claims and to verify the 1 reference still open.
- It may state two separate claims as one. 74
- Probably not a substantial claim. 67
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ 5.4.1 Quantitative performance improvements · p. 17
“Our measurements revealed that after system optimization between testing phases, users significantly reduced their completion time for image-to-3D model and environment generation tasks.”
§ 5 User research and evaluation · p. 13
“The second round introduced quantitative metrics, including task completion times and operational error rates”
Citations
Cites
The Ecological Approach to Visual Perception
Bornstein, M. H., & Gibson, J. J. (1980) · The Journal of Aesthetics and Art Criticism · doi:10.2307/429816 · Cited by 22,935
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048
The information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1954) · Journal of Experimental Psychology · doi:10.1037/h0055392 · Cited by 6,466
Defining virtual reality: Dimensions determining telepresence
Steuer, J. (1992) · Journal of Communication · doi:10.1111/j.1460-2466.1992.tb00812.x · Cited by 5,459
Hierarchical Text-Conditional Image Generation with CLIP Latents
Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022) · arXiv · doi:10.48550/arxiv.2204.06125 · Cited by 2,511
The psychology of everyday things
Weld, D. S. (1989) · Artificial Intelligence · doi:10.1016/0004-3702(89)90083-0 · Cited by 2,105
Enhancing Our Lives with Immersive Virtual Reality
Slater, M., & Sanchez-Vives, M. V. (2016) · Frontiers in Robotics and AI · doi:10.3389/frobt.2016.00074 · Cited by 1,993
Mystakidis, S. (2022) · Encyclopedia · doi:10.3390/encyclopedia2010031 · Cited by 1,977
The psychology of human-computer interaction
Rogers, Y. (1984) · Applied Ergonomics · doi:10.1016/0003-6870(84)90205-9 · Cited by 1,970
Research works printed but not linked: 9
- Billinghurst, 2002, Space augmented reality, Sci. Am, 287, 84
- Burman, 2022, “The state of 3D modeling in industry: a survey of professionals,”, 1
- Hollensen, 2022, Metaverse - the new reality?, J. Bus. Strategy, 43, 349, 10.1108/JBS-02-2022-0036 · doi:10.1108/jbs-02-2022-0036
- La Viola, 2019, Natural interaction, Proc. IEEE, 107, 1061, 10.1109/JPROC.2019.2907277 · doi:10.1109/jproc.2019.2907277
- Mann, 2014, “Wearable computing as means for personal empowerment,”, 1
- Montello, 2001, “Spatial cognition and environmental behavior,”, 318
- Preece, 2015, Interaction Design: Beyond Human-Computer Interaction
- Wu, 2022, A comparative study of online and offline 3D design platforms: an educational perspective, Comput Educ, 180, 104425, 10.1016/j.compedu.2022.104425 · doi:10.1016/j.compedu.2022.104425
- Yariv, 2023, “TripoSR: direct profile-guided single-image 3D mesh reconstruction,”, 6527
Cited by
Rodrigues, R., Gonçalves, G., Machado, R., Peixoto, B., Bessa, M., & Melo, M. (2026) · Computers & Graphics · doi:10.1016/j.cag.2026.104750 · Cited by 1
Metadata
- Authors
- Fu, J., Grierson, M., Jiang, R., Fu, S., He, M., & Xu, M.
- Affiliations
- University of the Arts London (GB)
- Tianjin Natural History Museum (CN)
- Corresponding author
- Fu, Jie
- Venue
- Frontiers in Computer Science
- Publisher
- Frontiers Media SA
- Published
- 2025-07-28
- Volume
- 7
- ISSN
- 2624-9898 (ISSN-L)
- OpenAlex
- W4412685994
- Cited by
- 1
- References
- 34
- Citations by year
- 2026: 1
- FWCI
- 0.84
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Computer Science (publishedVersion, cc-by)
- University of the Arts London Research Online (University of the Arts London) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- University of the Arts London
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Digital Media and Visual Art
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Augmented Reality Applications
- Keywords
- spatial computing, 3D content creation, immersive environments, Apple Vision Pro, extended reality, generative AI, multimodal interaction, iterative design, creative cognition, cognitive load, dream space, design thinking, prototype development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Interface design and interaction optimization for spatial computing 3D content creation and immersive environment generation using Apple Vision Pro. https://app.cochat.ai/papers/10.3389/fcomp.2025.1591289
- The paper
- Fu, J., Grierson, M., Jiang, R., Fu, S., He, M., & Xu, M. (2025). Interface design and interaction optimization for spatial computing 3D content creation and immersive environment generation using Apple Vision Pro. Frontiers in Computer Science. https://doi.org/10.3389/fcomp.2025.1591289
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.