Gestures in the wild: studying multi-touch gesture sequences on interactive tabletop exhibits
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
In this paper we describe our findings from a field study that was conducted at the Vancouver Aquarium to investigate how visitors interact with a large interactive table exhibit using multi-touch gestures. Our findings show that the choice and use of multi-touch gestures are influenced not only by general preferences for certain gestures but also by the interaction context and social context they occur in. We found that gestures are not executed in isolation but linked into sequences where previous gestures influence the formation of subsequent gestures. Furthermore, gestures were used beyond the manipulation of media items to support social encounters around the tabletop exhibit. Our findings indicate the importance of versatile many-to-one mappings between gestures and their actions that, other than one-to-one mappings, can support fluid transitions between gestures as part of sequences and facilitate social information exploration.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Interaction Analysis: Foundations and Practice
Jordan, B., & Henderson, A. (1995) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0401_2 · Cited by 2,726 · cited 1×
“The collected video recordings of visitors’ gestures on the interactive surface from different perspectives form the basis for our interaction analysis [14].”
BackgroundUser-defined gestures for surface computing
Wobbrock, J. O., Morris, M. R., & Wilson, A. D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518866 · Cited by 1,317 · cited 3×
“[27, 35] to create user-generated gesture sets that reflect people’s expectations of the actions that will be triggered by specific gestures.”
BackgroundResultAsymmetric Division of Labor in Human Skilled Bimanual Action: The Kinematic Chain as a Model
Guiard, Y. (1987) · Journal of Motor Behavior · doi:10.1080/00222895.1987.10735426 · Cited by 1,134
Enticing People to Interact with Large Public Displays in Public Spaces.
Brignull, H., & Rogers, Y. (2003) · UCL Discovery (University College London) · Cited by 727
SmartSkin: an infrastructure for freehand manipulation on interactive surfaces
Rekimoto, J. (2002) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/503376.503397 · Cited by 637 · cited 2×
“Since the seminal work of Kruger in the 1970s advocated for the design of responsive interactive systems [15] there has been a large number of research and commercial systems that rely on touch and gesture to provide interactivity (e.g., [8, 24, 26, 25, 30, 32, 34, 36]).”
BackgroundTerritoriality in collaborative tabletop workspaces
Scott, S. D., Carpendale, M. S. T., & Inkpen, K. (2004) · Proceedings of the 2004 ACM conference on Computer supported cooperative work · doi:10.1145/1031607.1031655 · Cited by 622 · cited 1×
“The number of visitors interacting with the Collection Viewer influenced children’s and adults’ use of gestures in different ways: while children made use of gestures to keep their interaction radius relatively large, adults’ use of gestures shows a (learned) respect of other visitors’ personal territories that has be…”
BackgroundIt's Mine, Don't Touch!: interactions at a large multi-touch display in a city centre
Peltonen, P., Kurvinen, E., Salovaara, A., Jacucci, G., Ilmonen, T., Evans, J., Oulasvirta, A., & Saarikko, P. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357255 · Cited by 462 · cited 6×
“Several field studies have investigated people’s approach and interaction with large direct-touch surfaces in public settings [10, 11, 13, 23].”
BackgroundMethodInfluentialMulti-finger and whole hand gestural interaction techniques for multi-user tabletop displays
Wu, M., & Balakrishnan, R. (2003) · Proceedings of the 16th annual ACM symposium on User interface software and technology · doi:10.1145/964696.964718 · Cited by 427 · cited 1×
“’s set of multi-touch and pose-based hand gestures within the context of room planning, and a list of principles for the design of gesture sets [36, 37].”
BackgroundA Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI
Nielsen, M., Störring, M., Moeslund, T. B., & Granum, E. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24598-8_38 · Cited by 336 · cited 1×
“on how people spontaneously apply gestures to trigger given effects has greatly advanced the understanding of gesture use [21].”
BackgroundExhibiting Interaction: Conduct and Collaboration in Museums and Galleries
vom Lehn, D., Heath, C., & Hindmarsh, J. (2001) · Symbolic Interaction · doi:10.1525/si.2001.24.2.189 · Cited by 309
Cooperative gestures: multi-user gestural interactions for co-located groupware
Morris, M. R., Huang, A., Paepcke, A., & Winograd, T. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124952 · Cited by 257 · cited 2×
“Since the seminal work of Kruger in the 1970s advocated for the design of responsive interactive systems [15] there has been a large number of research and commercial systems that rely on touch and gesture to provide interactivity (e.g., [8, 24, 26, 25, 30, 32, 34, 36]).”
BackgroundUnderstanding users' preferences for surface gestures
Morris, M. R., Wobbrock, J. O., & Wilson, A. D. (2010) · Graphics Interface · Cited by 208
CHUNKING AND PHRASING AND THE DESIGN OF HUMAN-COMPUTER DIALOGUES
BUXTON, W. (1995) · Readings in Human–Computer Interaction · doi:10.1016/b978-0-08-051574-8.50051-0 · Cited by 199 · cited 2×
“, sequences of actions that are characterized by fluid transitions in-between and lead up to a compound task [3].”
BackgroundShallow-depth 3d interaction: design and evaluation of one-, two- and three-touch techniques
Hancock, M., Carpendale, S., & Cockburn, A. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240798 · Cited by 179 · cited 2×
“Since the seminal work of Kruger in the 1970s advocated for the design of responsive interactive systems [15] there has been a large number of research and commercial systems that rely on touch and gesture to provide interactivity (e.g., [8, 24, 26, 25, 30, 32, 34, 36]).”
BackgroundSelf-citationGesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces
Wu, M., Shen, C., Ryall, K., Forlines, C., & Balakrishnan, R. (2006) · First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06) · doi:10.1109/tabletop.2006.19 · Cited by 177 · cited 3×
“’s set of multi-touch and pose-based hand gestures within the context of room planning, and a list of principles for the design of gesture sets [36, 37].”
BackgroundResultEMDialog: Bringing Information Visualization into the Museum
Hinrichs, U., Schmidt, H., & Carpendale, S. (2008) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2008.127 · Cited by 162 · cited 2×
“At the same time, there is a growing use of interactive surfaces in public exhibition spaces such as museums [10, 11, 13], galleries [28], and urban spaces [23].”
BackgroundSelf-citationAffordances for manipulation of physical versus digital media on interactive surfaces
Terrenghi, L., Kirk, D. S., Sellen, A. J., & Izadi, S. (2007) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240799 · Cited by 145 · cited 3×
“As in an earlier study [31], it seems that visitors adopt this asymmetrical use of both hands from their previous experiences with manipulating objects on physical tables.”
BackgroundResultShadowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures
Freeman, D., Benko, H., Morris, M. R., & Wigdor, D. (2009) · Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces · doi:10.1145/1731903.1731935 · Cited by 138 · cited 1×
“While previous work generally establishes one-to-one mappings between actions and gestures that trigger them [5, 35, 37], our findings indicate that multi-touch gestures are part of integrated interaction sequences.”
ResultWorlds of information: designing for engagement at a public multi-touch display
Jacucci, G., Morrison, A., Richard, G. T., Kleimola, J., Peltonen, P., Parisi, L., & Laitinen, T. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753669 · Cited by 137 · cited 7×
“Several field studies have investigated people’s approach and interaction with large direct-touch surfaces in public settings [10, 11, 13, 23].”
BackgroundMethodInfluentialCrafting participation: designing ecologies, configuring experience
Heath, C., Luff, P., Lehn, D. V., Hindmarsh, J., & Cleverly, J. (2002) · Visual Communication · doi:10.1177/147035720200100102 · Cited by 133
A Comparison of User-Generated and Automatic Graph Layouts
Dwyer, T., Lee, B., Fisher, D., et al. (2009) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2009.109 · Cited by 99 · cited 1×
“This approach has been further applied to other contexts [4, 6, 22].”
BackgroundTse, E., Shen, C., Greenberg, S., & Forlines, C. (2006) · International Conference on Advanced Visual Interfaces (AVI) · doi:10.1145/1133265.1133336 · Cited by 93 · cited 2×
“Since the seminal work of Kruger in the 1970s advocated for the design of responsive interactive systems [15] there has been a large number of research and commercial systems that rely on touch and gesture to provide interactivity (e.g., [8, 24, 26, 25, 30, 32, 34, 36]).”
BackgroundSeparability of spatial manipulations in multi-touch interfaces
Nacenta, M. A., Baudisch, P., Benko, H., & Wilson, A. (2009) · Cited by 70
Interactions around a contextually embedded system
Hornecker, E. (2010) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/1709886.1709916 · Cited by 68 · cited 3×
“Previous studies showed that children quite assertively enforce their intentions and try to retain control through gestures on and above the table in small-group collaborative scenarios [17] as well as in the context of physical museum exhibits [12].”
BackgroundMulti-finger cursor techniques
Moscovich, T., & Hughes, J. F. (2006) · Graphics Interface · Cited by 68
Bimanual and unimanual image alignment: an evaluation of mouse-based techniques
Latulipe, C., Kaplan, C. S., & Clarke, C. L. A. (2005) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1095034.1095057 · Cited by 56 · cited 1×
“Guiard’s work on bimanual manipulation [7] forms the foundation for much of the current empirical work on multi-touch gestures (e.g., [16, 19]).”
BackgroundDiagram Editing on Interactive Displays Using Multi-touch and Pen Gestures
Frisch, M., Heydekorn, J., & Dachselt, R. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-14600-8_18 · Cited by 49
Cited by
Looking glass: a field study on noticing interactivity of a shop window
Müller, J., Walter, R., Bailly, G., Nischt, M., & Alt, F. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207718 · Cited by 288
Vatavu, R.-D., Cramariuc, G., & Schipor, D. M. (2015) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2014.10.007 · Cited by 172
“Hinrichs and Carpendale (2011) showed that users’ gesture preferences are influenced by the interaction and social context in which they occur, and that gestures are linked to previous articulations and form consistent patterns.”
Background(2015) · doi:10.1002/9781118829059.wbihms319 · Cited by 19
Anthony, L., Brown, Q., Nias, J., & Tate, B. (2015) · International Journal of Child-Computer Interaction · doi:10.1016/j.ijcci.2016.01.002 · Cited by 14
“Some work recently has explicitly compared and contrasted surface-gesture interaction design for children and adults (Anthony, Brown, Nias, Tate, & Mohan, 2012; Brown & Anthony, 2012; Hinrichs & Carpendale, 2011), but has not specifically looked at the question of feedback.”
Background
Metadata
- Authors
- Hinrichs, U., & Carpendale, S.
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2011-05-07
- Pages
- 3023-3032
- OpenAlex
- W2036674910
- Cited by
- 194
- References
- 27
- FWCI
- 19.11
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.