Subjective and behavioral presence measurement and interactivity in the collaborative augmented reality game TimeWarp
Open accessAbstract
Presence is usually assessed via a variety of subjective and objective measures. However, constraints often result in subjective measurements using questionnaires as a key method of data collection. In this paper we present a study of 44 participants of a collaborative augmented reality game known as TimeWarp which used both subjective and objective behavioral measures. Behavior as coded from video recordings of one scene of the game and self-reports about feelings of presence were compared. Our findings indicate that pointing behavior and verbal responses to the virtual content are correlated negatively to sense of presence. We further investigated the influence of subjectively perceived interactivity on perceived presence. We found that the interaction possibilities perceived by the participants predicted their experience of social presence with the virtual characters in the game. Furthermore, playing together with another person did not result in decreased social presence of the virtual characters. Implications for presence research are discussed.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The measurements of presence and anxiety used in this study were self-reported, which is prone to well-known demand characteristics.
“First, the measurements of presence and anxiety used in this study were self-reported which is prone to well-known demand characteristics.”
From A Meta-Analysis on the Relationship between Self-Reported Presence and Anxiety in Virtual Reality Exposure Therapy for Anxiety Disorders (2014) · cites this paper as [88]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Azuma, R. T. (1997) · Presence: Teleoperators and Virtual Environments · doi:10.1162/pres.1997.6.4.355 · Cited by 10,121 · see citing works
Measuring Presence in Virtual Environments: A Presence Questionnaire
Witmer, B. G., & Singer, M. J. (1998) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474698565686 · Cited by 6,371 · see citing works
At the Heart of It All: The Concept of Presence
Lombard, M., & Ditton, T. B. (2006) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.1997.tb00072.x · Cited by 3,754 · see citing works
Lee, K. M. (2004) · Communication Theory · doi:10.1111/j.1468-2885.2004.tb00302.x · Cited by 1,631 · see citing works
Being There: The Subjective Experience of Presence
Heeter, C. (1992) · PRESENCE Virtual and Augmented Reality · doi:10.1162/pres.1992.1.2.262 · Cited by 1,457 · see citing works
Blascovich, J., Loomis, J., Beall, A. C., Swinth, K. R., Hoyt, C. L., & Bailenson, J. N. (2002) · Psychological Inquiry · doi:10.1207/s15327965pli1302_01 · Cited by 1,280 · see citing works
A grounded investigation of game immersion
Brown, E., & Cairns, P. A. (2004) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/985921.986048 · Cited by 1,193 · see citing works
Playing Video Games : Motives, Responses, and Consequences
Vorderer, P., & Bryant, J. (2012) · Cited by 1,060 · see citing works
Using Presence Questionnaires in Reality
Usoh, M., Catena, E., Arman, S., & Slater, M. (2000) · PRESENCE Virtual and Augmented Reality · doi:10.1162/105474600566989 · Cited by 985 · see citing works
Equilibrium Theory Revisited: Mutual Gaze and Personal Space in Virtual Environments
Bailenson, J., Blascovich, J., Beall, A., & Loomis, J. (2001) · Presence - Teleoperators and Virtual Environments · doi:10.1162/105474601753272844 · Cited by 567 · see citing works
<title>Presence: concept, determinants, and measurement</title>
IJsselsteijn, W. A., de Ridder, H., Freeman, J., & Avons, S. E. (2000) · SPIE Proceedings · doi:10.1117/12.387188 · Cited by 529 · see citing works
(2003) · TU/e Research Portal · Cited by 491 · see citing works
Nardi, B. A., & Harris, J. (2006) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/1180875.1180898 · Cited by 418 · see citing works
Representations systems, perceptual position, and presence in immersive virtual environments
Slater, M., & Usoh, M. (1993) · Presence: Teleoperators and Virtual Environments · doi:10.1162/pres.1993.2.3.221 · Cited by 401 · see citing works
Being there : the experience of presence in mediated environments
IJsselsteijn, W. A., Riva, G., Riva, G., Davide, F., & IJsselsteijn, W. A. (2003) · TU/e Research Portal · Cited by 323 · see citing works
Spatial Presence and Emotions during Video Game Playing: Does It Matter with Whom You Play?
Ravaja, N., Saari, T., Turpeinen, M., Laarni, J., Salminen, M., & Kivikangas, M. (2006) · PRESENCE Virtual and Augmented Reality · doi:10.1162/pres.15.4.381 · Cited by 322 · see citing works
Piekarski, W., & Thomas, B. H. (2002) · Communications of the ACM · doi:10.1145/502269.502291 · Cited by 319 · see citing works
Welch, R., Blackmon, T., Liu, A., Mellers, B., & Stark, L. (1996) · Presence - Teleoperators and Virtual Environments · doi:10.1162/pres.1996.5.3.263 · Cited by 316 · see citing works
Freeman, J., Avons, S. E., Meddis, R., Pearson, D. E., & IJsselsteijn, W. A. (2000) · PRESENCE Virtual and Augmented Reality · doi:10.1162/105474600566691 · Cited by 281 · see citing works
Effects of Sensory Information and Prior Experience on Direct Subjective Ratings of Presence
Freeman, J., Avons, S. E., Pearson, D. E., & IJsselsteijn, W. A. (1999) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474699566017 · Cited by 233 · see citing works
Lombard, M., Ditton, T. B., Crane, D., Davis, B., Gil-Egui, G., Horvath, K., Rossman, J., & Temple, U. (2000) · Cited by 231 · see citing works
Calvert, S. L., & Tan, S.-L. (1994) · Journal of Applied Developmental Psychology · doi:10.1016/0193-3973(94)90009-4 · Cited by 223 · see citing works
Augmented Reality for Construction Tasks: Doorlock Assembly
Behringer, R., Klinker, G. J., & Mizell, D. (1999) · A K Peters/CRC Press eBooks · doi:10.1201/9781439863992-10 · Cited by 185 · see citing works
The Influence of Dynamic Shadows on Presence in Immersive Virtual Environments
Slater, M., Usoh, M., & Chrysanthou, Y. (1995) · Eurographics · doi:10.1007/978-3-7091-9433-1_2 · Cited by 165 · see citing works
Effectance, self-efficacy, and the motivation to play video games
Klimmt, C., & Hartmann, T. (2006) · Cited by 163 · see citing works
Analysis of Physiological Responses to a Social Situation in an Immersive Virtual Environment
Slater, M., Guger, C., Edlinger, G., Leeb, R., Pfurtscheller, G., Antley, A., Garau, M., Brogni, A., & Friedman, D. A. (2006) · PRESENCE Virtual and Augmented Reality · doi:10.1162/pres.15.5.553 · Cited by 161 · see citing works
Reinecke, L., Klatt, J., & Krämer, N. C. (2011) · Media Psychology · doi:10.1080/15213269.2011.573466 · Cited by 137 · see citing works
Self-citationViolent Virtual Video Games and Hostile Thoughts
Tamborini, R., Eastin, M. S., SKALSKI, P. D., Lachlan, K. A., Fediuk, T. A., & Brady, R. (2004) · Journal of Broadcasting & Electronic Media · Cited by 131 · see citing works
An ecological approach to embodiment and cognition
廣瀬, 直. (2002) · Cognitive Systems Research · doi:10.1016/s1389-0417(02)00044-x · Cited by 128 · see citing works
Vorderer, P., Knobloch, S., & Schramm, H. (2001) · Media Psychology · doi:10.1207/s1532785xmep0304_03 · Cited by 121 · see citing works
(2008) · doi:10.1145/1409240.1409266 · Cited by 116 · see citing works
Starner, T. E., Leibe, B., Singletary, B., et al. (2000) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/325737.325864 · Cited by 91 · see citing works
Smith, M. (2006) · Springer eBooks · doi:10.1007/1-4020-3567-5_4 · Cited by 59 · see citing works
Augmented Reality Guidance for Needle Biopsies: A Randomized, Controlled Trial in Phantoms
Rosenthal, M., State, A., Lee, J., et al. (2001) · Lecture notes in computer science · doi:10.1007/3-540-45468-3_29 · Cited by 51 · see citing works
A grounded investigation of immersion in games
Brown, E. E., & CAIRNS, P. A. (2004) · UCL Discovery (University College London) · Cited by 29 · see citing works
Wissmath, B., Weibel, D., & Mast, F. W. (2009) · Virtual Reality · doi:10.1007/s10055-009-0127-0 · Cited by 29 · see citing works
Wagner, I., Stuedahl, D., & Bratteteig, T. (2010) · Computer supported cooperative work · doi:10.1007/978-1-84996-223-0 · Cited by 25 · see citing works
Behringer, R., Klinker, G., & Mizell, D. (1999) · A K Peters/CRC Press eBooks · doi:10.1201/9781439863992-19 · Cited by 15 · see citing works
Case Studies of See-Through Augmentation in Mixed Reality Project
Behringer, R., Klinker, G., & Mizell, D. (1999) · A K Peters/CRC Press eBooks · doi:10.1201/9781439863992-8 · Cited by 13 · see citing works
Augmented reality : placing artificial objects in real scenes : proceedings of IWAR '98
Iwar, Behringer, R., Klinker, G. J., et al. (1999) · Medical Entomology and Zoology · Cited by 13 · see citing works
Experiences of Evaluating Presence in Augmented Realities
McCall, R., & Braun, A.-K. (2008) · Open Repository and Bibliography (University of Luxembourg) · Cited by 10 · see citing works
Self-citationHöhl, W. (2008) · Medical Entomology and Zoology · Cited by 8 · see citing works
When what you see is what you hear: Auditory-visual integration and presence in virtual environments
Larsson, P., Olsson Västfjäll, D., Olsson, P., & Kleiner, M. (2005) · Chalmers Publication Library (Chalmers University of Technology) · Cited by 7 · see citing works
Computer-vision-enabled Ophthalmic Augmented Reality: A PC-based Prototype
Behringer, R., Klinker, G., & Mizell, D. (1999) · A K Peters/CRC Press eBooks · doi:10.1201/9781439863992-9 · Cited by 6 · see citing works
Flagged first, then by citations
Research works printed but not linked: 6
- W. Broll, A.-K. Braun, I. Herbst, R. McCall, R. TimeWarp: Interactive Time Travel with a Mobile Mixed Reality Game. In Proc. of ACM MobileHCI 2008, the 10th International Conference on Human-Computer Interaction with Mobile Devices and Services. 2008.
- R. Tamborini, M. Eastin, P. Skalski, K. Lachlan, T. Fediuk, R. Brady. Violent virtual video games. In Journal of Broadcasting and Electronic Media, 48(3/04), 335-357.
- F. Biocca, C. Harms, J. L. Gregg. The networked minds measure of social presence: Pilot test of the factor structure and concurrent validity. Proceedings of the Fourth Annual International Presence Workshop, Philadelphia, PA. 2001.
- W. A. IJsselsteijn, H. de Ridder, J. Freeman, S.E. Avons. Presence: Concept, determinants and measurement. In Proceedings of the SPIE 3959, 520-529. 2000.
- J. D. Prothero, D. E. Parker, T. A. Furness III, M. J. Wells. Towards a robust, quantitative measure for presence. In Proceedings of the Conference on Experimental Analysis and Measurement of Situation Awareness, 359-366. 1995.
- W. Piekarski, B. Thomas. ARQuake: The Outdoor Augmented Reality Gaming System. Communications of the ACM, 45/02, 36-38.
Cited by
Sorted by citations
The state of immersive technology research: A literature analysis
Suh, A., & Prophet, J. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.04.019 · Cited by 841 · see citing works
Ling, Y., Nefs, H. T., Morina, N., Heynderickx, I., & Brinkman, W.-P. (2014) · PLoS ONE · doi:10.1371/journal.pone.0096144 · Cited by 215 · see citing works
The relationship between individual characteristics and experienced presence
Ling, Y., Nefs, H. T., Brinkman, W.-P., Qu, C., & Heynderickx, I. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2012.12.010 · Cited by 138 · see citing works
- Authors
- von der Pütten, A. M., Klatt, J., Ten Broeke, S., McCall, R., Krämer, N. C., Wetzel, R., Blum, L., Oppermann, L., & Klatt, J.
- Affiliations
- Fraunhofer Institute for Applied Information Technology (DE)
- University of Luxembourg (LU)
- University of Duisburg-Essen (DE)
- Venue
- Interacting with Computers
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-07
- Volume
- 24
- Issue
- 4
- Pages
- 317-325
- ISSN
- 0953-5438 (ISSN-L)
- OpenAlex
- W2006152882
- Cited by
- 69
- References
- 44
- Citations by year
- 2026: 2 · 2025: 8 · 2024: 6 · 2023: 2 · 2022: 10 · 2021: 5 · 2020: 4 · 2019: 1 · 2018: 6 · 2017: 5 · 2016: 5 · 2015: 6 · 2014: 5 · 2013: 4
- FWCI
- 8.86
- Type
- journal article
- Language
- en
- Open access
- green
- orbilu.uni.lu
- Licence
- other-oa
- Locations
- Interacting with Computers (publishedVersion)
- Open Repository and Bibliography (University of Luxembourg) (submittedVersion, other-oa)
- Universitätsbibliographie, Universität Duisburg-Essen (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Fraunhofer-Publica (Fraunhofer-Gesellschaft) (submittedVersion)
- RWTH Publications (RWTH Aachen) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Psychology › Developmental and Educational Psychology › Flow Experience in Various Fields
- Keywords
- presence, social presence, collaborative augmented reality, augmented reality games, interactivity, perceived interactivity, pointing behavior, verbal responses
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
