Reality-based interaction: a framework for post-WIMP interfaces
The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
We are in the midst of an explosion of emerging human-computer interaction techniques that redefine our understanding of both computers and interaction. We propose the notion of Reality-Based Interaction (RBI) as a unifying concept that ties together a large subset of these emerging interaction styles. Based on this concept of RBI, we provide a framework that can be used to understand, compare, and relate current paths of recent HCI research as well as to analyze specific interaction designs. We believe that viewing interaction through the lens of RBI provides insights for design and uncovers gaps or opportunities for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Where the Action Is: The Foundations of Embodied Interaction
Dourish, P. (2001) · Cited by 3,148
Augmented reality: a class of displays on the reality-virtuality continuum:
Milgram, P., Takemura, H., Utsumi, A., & Kishino, F. (1995) · SPIE Proceedings · doi:10.1117/12.197321 · Cited by 2,367
The Computer for the Twenty-First Century
Weiser, M. (1991) · Scientific American · Cited by 2,113
3D User Interfaces: Theory and Practice
Bowman, D. A., Kruijff, E., LaViola, J. J., & Poupyrev, I. (2004) · Cited by 2,016
Direct Manipulation: A Step Beyond Programming Languages
Shneiderman (1983) · Computer · doi:10.1109/mc.1983.1654471 · Cited by 1,939 · cited 1×
“Shneiderman took a variety of what, at the time, seemed disparate new user interface inventions and brought them together by noting their common characteristics and defining them as a new generation of user interfaces [39].”
BackgroundDirect Manipulation Interfaces
Hutchins, E. L., Hollan, J. D., & Norman, D. A. (1985) · Human–Computer Interaction · doi:10.1207/s15327051hci0104_2 · Cited by 1,307
Emerging frameworks for tangible user interfaces
Ullmer, B., & Ishii, H. (2000) · IBM Systems Journal · doi:10.1147/sj.393.0915 · Cited by 1,221
Getting a grip on tangible interaction: a framework on physical space and social interaction
Hornecker, E., & Buur, J. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124838 · Cited by 1,100
Walking > walking-in-place > flying, in virtual environments
Usoh, M., Arthur, K., Whitton, M. C., Bastos, R., Steed, A., Slater, M., & Brooks, F. P. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311589 · Cited by 921
Questions, Options, and Criteria: Elements of Design Space Analysis
MacLean, A., Young, R., Bellotti, V., & Moran, T. (1991) · Human-Computer Interaction · doi:10.1207/s15327051hci0603&4_2 · Cited by 794
Taking steps: the influence of a walking technique on presence in virtual reality
Slater, M., Usoh, M., & Steed, A. (1995) · ACM Transactions on Computer-Human Interaction · doi:10.1145/210079.210084 · Cited by 713
How bodies matter: five themes for interaction design
Klemmer, S. R., Hartmann, B., & Takayama, L. (2006) · Proceedings of the 6th conference on Designing Interactive systems · doi:10.1145/1142405.1142429 · Cited by 645 · cited 1×
“Some work has focused more generally on new issues that are not present in interactions with traditional WIMP interfaces [8, 9, 29].”
BackgroundInstrumental interaction: an interaction model for designing post-WIMP user interfaces
Beaudouin-Lafon, M. (2000) · Proceedings of the SIGCHI conference on Human Factors in Computing Systems · doi:10.1145/332040.332473 · Cited by 614
Urp: a luminous-tangible workbench for urban planning and design
Underkoffler, J., & Ishii, H. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303114 · Cited by 604
Collaborative virtual environments
Benford, S., Greenhalgh, C., Rodden, T. A., & Pycock, J. (2001) · Communications of the ACM · doi:10.1145/379300.379322 · Cited by 452
van Dam, A. (1997) · Communications of the ACM · doi:10.1145/253671.253708 · Cited by 432
Distant freehand pointing and clicking on very large, high resolution displays
Vogel, D., & Balakrishnan, R. (2005) · Proceedings of the 18th annual ACM symposium on User interface software and technology · doi:10.1145/1095034.1095041 · Cited by 430
A taxonomy for and analysis of tangible interfaces
Fishkin, K. (2004) · Personal and Ubiquitous Computing · doi:10.1007/s00779-004-0297-4 · Cited by 422
Making sense of sensing systems: five questions for designers and researchers
Bellotti, V., Back, M., Edwards, W. K., Grinter, R. E., Henderson, A., & Lopes, C. (2002) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/503376.503450 · Cited by 405
Leonardo's laptop: Human needs and the new computing technologies
(2003) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(03)80128-1 · Cited by 382
Nielsen, J. (1993) · Communications of the ACM · doi:10.1145/255950.153582 · Cited by 307
Direct Manipulation Interfaces
(2011) · SpringerReference · doi:10.1007/springerreference_64794 · Cited by 295
Design guidelines for landmarks to support navigation in virtual environments
Vinson, N. G. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303062 · Cited by 294
Interacting with eye movements in virtual environments
Tanriverdi, V., & Jacob, R. J. K. (2000) · Proceedings of the SIGCHI conference on Human Factors in Computing Systems · doi:10.1145/332040.332443 · Cited by 276
Self-citationToken+constraint systems for tangible interaction with digital information
Ullmer, B., Ishii, H., & Jacob, R. J. K. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1057237.1057242 · Cited by 259
Self-citationImage schemas and their metaphorical extensions: intuitive patterns for tangible interaction
Hurtienne, J., & Israel, J. H. (2007) · Proceedings of the 1st international conference on Tangible and embedded interaction · doi:10.1145/1226969.1226996 · Cited by 214
Streitz, N., Tandler, P., Müller-Tomfelde, C., & Konomi, S. (2001) · Cited by 194
Tabletop sharing of digital photographs for the elderly
Apted, T., Kay, J., & Quigley, A. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124887 · Cited by 170
Expected, sensed, and desired: A framework for designing sensing-based interaction
Benford, S., Schnädelbach, H., Koleva, B., Anastasi, R., Greenhalgh, C., Rodden, T., Green, J., Ghali, A., Pridmore, T., Gaver, B., et al. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1057237.1057239 · Cited by 165
Collaboration and learning within immersive virtual reality
Jackson, R. L., & Fagan, E. (2000) · Collaborative Virtual Environments · doi:10.1145/351006.351018 · Cited by 141
Embodied User Interfaces: Towards Invisible User Interfaces
Fishkin, K. P., Moran, T. P., & Harrison, B. L. (1999) · IFIP advances in information and communication technology · doi:10.1007/978-0-387-35349-4_1 · Cited by 120
Hands-only scenarios and video action walls: novel methods for tangible user interaction design
Buur, J., Jensen, M. V., & Djajadiningrat, T. (2004) · Designing Interactive Systems Conference · doi:10.1145/1013115.1013141 · Cited by 115
Calibration of locomotion resulting from visual motion in a treadmill-based virtual environment
Mohler, B. J., Thompson, W. B., Creem-Regehr, S. H., Willemsen, P., Pick, H. L., & Rieser, J. J. (2007) · ACM Transactions on Applied Perception · doi:10.1145/1227134.1227138 · Cited by 103
Mixed reality: a model of mixed interaction
Coutrix, C., & Nigay, L. (2006) · International Conference on Advanced Visual Interfaces (AVI) · doi:10.1145/1133265.1133274 · Cited by 100
The tangible video editor: collaborative video editing with active tokens
Zigelbaum, J., Horn, M., Shaer, O., & Jacob, R. J. K. (2007) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/1226969.1226978 · Cited by 73
Self-citationViewPointer: lightweight calibration-free eye tracking for ubiquitous handsfree deixis
Smith, J. D., Vertegaal, R., & Sohn, C. (2005) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1095034.1095043 · Cited by 64
The Laws of Simplicity: Design, Technology, Business, Life
Poggenpohl, S. (2007) · Visible Language · Cited by 55
Jacob, R. J. K., Girouard, A., Hirshfield, L., Horn, M., Shaer, O., Solovey, E., & Zigelbaum, J. (2007) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1240866.1241025 · Cited by 52
Self-citationMerrill, D. J., & Maes, P. (2007) · Springer eBooks · doi:10.1007/978-3-540-72037-9_1 · Cited by 37
Dickie, C., Vertegaal, R., Sohn, C., & Cheng, D. (2005) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1095034.1095050 · Cited by 37
A Design-Oriented Information-Flow Refinement of the ASUR Interaction Model
Dubois, E., & Gray, P. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-92698-6_28 · Cited by 24
Poupyrev, I., Newton-Dunn, H., & Bau, O. (2006) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1125451.1125683 · Cited by 20
Towards a new method for the evaluation of reality based interaction
Christou, G. (2007) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1240866.1240974 · Cited by 5
Research works printed but not linked: 16
- 10.1145/193173.195293 · doi:10.1145/193173.195293
- 10.1145/1124772.1124965 · doi:10.1145/1124772.1124965
- Ängeslevä , J. , Oakley , I. , Hughes , S. and O'Modhrain , S. , Body Mnemonics Portable device interaction design concept . in UIST , ( 2003 ). Ängeslevä, J., Oakley, I., Hughes, S. and O'Modhrain, S., Body Mnemonics Portable device interaction design concept. in UIST, (2003).
- 10.1145/1029632.1029646 · DOI
- 10.1007/s00779-006-0091-6 · doi:10.1007/s00779-006-0091-6
- Buxton , B. http://www.billbuxton.com/multitouchOverview.html , 2007 . Buxton, B. http://www.billbuxton.com/multitouchOverview.html, 2007.
- 10.5555/513034 · doi:10.5555/513034
- 10.5555/1023813.1023819 · doi:10.5555/1023813.1023819
- 10.1145/1095034.1095055 · doi:10.1145/1095034.1095055
- 10.1145/1242421.1242459 · doi:10.1145/1242421.1242459
- 10.5555/1758156.1758158 · doi:10.5555/1758156.1758158
- Milgram , P. and Kishino , F ., Augmented reality: A class of displays on the reality-virtuality continuum . in SPIE , ( 1994 ), 282--292. Milgram, P. and Kishino, F., Augmented reality: A class of displays on the reality-virtuality continuum. in SPIE, (1994), 282--292.
- Rohrer , T. Metaphors We Compute By: Bringing Magic into Interface Design , Center for the Cognitive Science of Metaphor, Philosophy Department, University of Oregon , 1995 . Rohrer, T. Metaphors We Compute By: Bringing Magic into Interface Design, Center for the Cognitive Science of Metaphor, Philosophy Department, University of Oregon, 1995.
- 10.1109/MCG.2003.1242376 · doi:10.1109/mcg.2003.1242376
- Tanriverdi , V. A Virtual Reality Interface Design (VRID) Model and Methodology , Tufts University , 2001 . Tanriverdi, V. A Virtual Reality Interface Design (VRID) Model and Methodology, Tufts University, 2001.
- Warren , J. A Wii Workout: When Videogames Hurt Wall Street Journal Online , 2006 . Warren, J. A Wii Workout: When Videogames Hurt Wall Street Journal Online, 2006.
Cited by
Villani, V., Pini, F., Leali, F., & Secchi, C. (2018) · Mechatronics · doi:10.1016/j.mechatronics.2018.02.009 · Cited by 1,237
Enhancing learning and engagement through embodied interaction within a mixed reality simulation
Lindgren, R., Tscholl, M., Wang, S., & Johnson, E. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.01.001 · Cited by 560
Ishii, H. (2008) · Proceedings of the 2nd international conference on Tangible and embedded interaction · doi:10.1145/1347390.1347392 · Cited by 532
A survey of 3D object selection techniques for virtual environments
Argelaguet, F., & Andujar, C. (2013) · Computers & Graphics · doi:10.1016/j.cag.2012.12.003 · Cited by 521
Hentout, A., Aouache, M., Maoudj, A., & Akli, I. (2019) · Advanced Robotics · doi:10.1080/01691864.2019.1636714 · Cited by 462
Metadata
- Authors
- Jacob, R. J. K., Girouard, A., Hirshfield, L. M., Horn, M. S., Shaer, O., Solovey, E. T., & Zigelbaum, J.
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2008-04-06
- Pages
- 201-210
- OpenAlex
- W1997447598
- Cited by
- 844
- References
- 43
- FWCI
- 40.71
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.