Embodied metaphors in tangible interaction design
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
For centuries, learning and development has been supported by physical activity and manipulating physical objects. With the introduction of embedded technologies, opportunities for employing tangible or embodied interaction for learning and development have emerged. As a result of previous research, we have seen that interaction models based on embodied knowledge (through embodied metaphors) can support children’s learning in abstract domains. Although metaphorical mappings are promoted in tangible and embodied interaction research, little is known about how to identify embodied metaphors, or how to implement them effectively into interaction models. In this paper, we introduce a people-centered, iterative approach to the design of tangible learning systems with embodied metaphor-based mappings. As a design case, we implemented our approach to the design of Moving Sounds (MoSo) Tangibles; a tangible system for learning abstract sound concepts. The system consists of a set of interactive tangibles with which children can manipulate pitch, volume, and tempo of ongoing tones. In a user study with 39 participants, we found that all children were able to reproduce sound samples with MoSo Tangibles.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lakoff, G., & Johnson, M. (2003) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226470993.001.0001 · Cited by 20,632
The origins of intelligence in children.
Piaget, J. (1952) · doi:10.1037/11494-000 · Cited by 10,687
The Body in the Mind: The Bodily Basis of Meaning, Imagination, and Reason
Johnson, M. (1987) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226177847.001.0001 · Cited by 6,465
Where the Action Is: The Foundations of Embodied Interaction
Dourish, P. (2001) · Cited by 3,148
Bruner, J. S., Olver, R. R., & Greenfield, P. M. (1966) · UT Back-in-Print Service eBooks · Cited by 2,205
Perceiving, Acting and Knowing: Toward an Ecological Psychology
(2017) · Routledge eBooks · doi:10.4324/9781315467931 · Cited by 2,065 · cited 1×
“Apparently, the affordance [15] of the puller, Pers Ubiquit Comput (2012) 16:433–449 447”
BackgroundPerceiving, Acting, and Knowing: Toward an Ecological Psychology
Mayzner, M. S., Shaw, R., & Bransford, J. (1978) · The American Journal of Psychology · doi:10.2307/1421838 · Cited by 1,917
Where the Action Is: The Foundations of Embodied Interaction
Dourish, P. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/7221.001.0001 · Cited by 1,866
Emerging frameworks for tangible user interfaces
Ullmer, B., & Ishii, H. (2000) · IBM Systems Journal · doi:10.1147/sj.393.0915 · Cited by 1,221 · cited 1×
“, [30, 32]) in the area of both embodied interaction [12] and tangible user interfaces [39] have revealed potential benefits of such interaction styles for learning and development (also see [31]).”
BackgroundThe reacTable: exploring the synergy between live music performance and tabletop tangible interfaces
Jordà, S., Geiger, G., Alonso, M., & Kaltenbrunner, M. (2007) · Proceedings of the 1st international conference on Tangible and embedded interaction · doi:10.1145/1226969.1226998 · Cited by 619
Do tangible interfaces enhance learning?
Marshall, P. (2007) · Proceedings of the 1st international conference on Tangible and embedded interaction · doi:10.1145/1226969.1227004 · Cited by 538 · cited 4×
“As underlined in several studies (e.g., [4, 29 ]), tangible interfaces seem particularly valuable for learning in abstract problem domains by relating abstract concepts to physical experiences or concrete examples.”
BackgroundInfluentialExtending tangible interfaces for education: digital montessori-inspired manipulatives
Zuckerman, O., Arida, S., & Resnick, M. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055093 · Cited by 463 · cited 2×
“Zuckerman et al. [ 42 ] describe ‘‘Montessoriinspired Manipulatives’’ (MiMs); technology enhanced building blocks that enable children to physically explore abstract concepts.”
BackgroundDigital manipulatives: new toys to think with
Resnick, M., Martin, F., Berg, R., Borovoy, R., Colella, V., Kramer, K., & Silverman, B. (1998) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '98 · doi:10.1145/274644.274684 · Cited by 427 · cited 1×
“An early example of a tangible interface developed for learning was introduced by Resnick et al. [35].”
BackgroundThe Educational Value of Multiple-representations when Learning Complex Scientific Concepts
Ainsworth, S. (2008) · Visualization: Theory and Practice in Science Education · doi:10.1007/978-1-4020-5267-5_9 · Cited by 352
Literature Review in Learning with Tangible Technologies
O’Malley, C. L., & Fraser, D. S. (2004) · HAL · Cited by 259
Image schemas and their metaphorical extensions: intuitive patterns for tangible interaction
Hurtienne, J., & Israel, J. H. (2007) · Proceedings of the 1st international conference on Tangible and embedded interaction · doi:10.1145/1226969.1226996 · Cited by 214 · cited 1×
“, [22, 23, 37]), little is known about how to identify embodied metaphors, or how to implement them effectively into interaction models for new systems.”
The CTI framework: informing the design of tangible systems for children
Antle, A. N. (2007) · Proceedings of the 1st international conference on Tangible and embedded interaction · doi:10.1145/1226969.1227010 · Cited by 177 · cited 1×
“Antle [4] states that embodied interaction engages children in active learning, which can support cognitive development.”
BackgroundSelf-citationPerspective-Taking and Object Construction: Two Keys to Learning
Ackermann, E. (2012) · doi:10.4324/9780203053492-8 · Cited by 164
Action-sound : developing methods and tools to study music-related body movement
Jensenius, A. R. (2007) · Duo Research Archive (University of Oslo) · Cited by 163
Conceptualising tangibles to support learning
Marshall, P., Price, S., & Rogers, Y. (2003) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/953536.953551 · Cited by 139 · cited 1×
“, [30, 32]) in the area of both embodied interaction [12] and tangible user interfaces [39] have revealed potential benefits of such interaction styles for learning and development (also see [31]).”
BackgroundTangible programming in the classroom with tern
Horn, M. S., & Jacob, R. J. K. (2007) · CHI '07 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1240866.1240933 · Cited by 131 · cited 1×
“Horn and Jacob [19] present ‘‘tern,’’ a tangible system consisting of jigsaw puzzle like artifacts used to create simple computer programs.”
BackgroundPlaying with the sound maker: do embodied metaphors help children learn?
Antle, A. N., Droumeva, M., & Corness, G. (2008) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/1463689.1463754 · Cited by 125 · cited 26×
“Unlike the Sound Maker system [6], the MoSo system presented in this design case relied on movement with tangible artifacts rather than whole-body movement.”
BackgroundMethodResultInfluentialSelf-citationMapping transparency through metaphor: towards more expressive musical instruments
Fels, S., Gadd, A., & Mulder, A. (2002) · Organised Sound · doi:10.1017/s1355771802002042 · Cited by 124 · cited 2×
“The approach we applied differs from other approaches to the design of metaphor-based interaction models described in literature [6, 14, 22], because we involved users at several stages of the process.”
BackgroundMethodDesign research & tangible interaction
van den Hoven, E., Frens, J. W., Aliakseyeu, D., Martens, J.-B., Overbeeke, K., & Peters, P. (2007) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/1226969.1226993 · Cited by 98 · cited 1×
“When looking at approaches recommended for the design of future intelligent systems [21], as well as those suggested in tangible interaction research [20], user involvement in many stages of the process is often recommended.”
BackgroundSmart Blocks: a tangible mathematical manipulative
Girouard, A., Solovey, E., Hirshfield, L., Ecott, S., Shaer, O., & Jacob, R. J. K. (2007) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/1226969.1227007 · Cited by 82 · cited 1×
“Girouard et al. [ 16 ] describe SmartBlocks, a tangible interface designed for exploring the volume and surface area of 3D objects.”
BackgroundFraming tangible interaction frameworks
Mazalek, A., & van den Hoven, E. (2009) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s0890060409000201 · Cited by 74 · cited 1×
“Many studies (e.g., [30, 32]) in the area of both embodied interaction [12] and tangible user interfaces [39] have revealed potential benefits of such interaction styles for learning and development (also see [31]).”
BackgroundIn search of metaphors for tangible user intefaces
Svanæs, D., & Verplank, W. L. (2000) · Designing Augmented Reality Environments (DARE) · doi:10.1145/354666.354679 · Cited by 70 · cited 1×
“, [22, 23, 37]), little is known about how to identify embodied metaphors, or how to implement them effectively into interaction models for new systems.”
Identifying embodied metaphors in children's sound-action mappings
Bakker, S., Antle, A. N., & van den Hoven, E. (2009) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/1551788.1551812 · Cited by 61 · cited 3×
“This means that the SMALL–BIG schema that became evident for pitch in user study 1 [8] may in a number of cases actually have been a”
BackgroundMethodInfluentialSelf-citationPrior Experience and Intuitive Use: Image Schemas in User Centred Design
Hurtienne, J., Weber, K., & Blessing, L. T. M. (2008) · Springer eBooks · doi:10.1007/978-1-84800-211-1_11 · Cited by 57 · cited 8×
“[22] does likely not contain all possible schemata and is still under construction, it would be interesting to compare the embodied schemata implemented in MoSo to the documented schemata.”
BackgroundMethodInfluentialHummels, C. C., & Frens, J. J. (2008) · TU/e Research Portal · Cited by 47
Designing to support reasoned imagination through embodied metaphor
Antle, A. N., Corness, G., Bakker, S., Droumeva, M., van den Hoven, E., & Bevans, A. (2009) · Creativity and Cognition · doi:10.1145/1640233.1640275 · Cited by 44
Self-citationZigelbaum, J., Millner, A., Desai, B., et al. (2006) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1125451.1125742 · Cited by 26 · cited 1×
“Body Beats [41] uses whole-body interaction to help children recognizing and creating sound patterns.”
BackgroundLearning abstract concepts through bodily engagement
Hashagen, A., Büching, C., & Schelhowe, H. (2009) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/1551788.1551839 · Cited by 15 · cited 1×
“[18] present ‘‘Der Schwarm,’’ a full-body interaction environment enabling children to learn about swarm or flock behavior.”
BackgroundThe value of multiple representations for learning about complex systems
Thompson, K. (2008) · QUT ePrints (Queensland University of Technology) · Cited by 6
(1977) · doi:10.4324/9781315740218-18 · cited 1×
“Apparently, the affordance [15] of the puller, clearly pointing toward near and far movement, has determined how children use the artifact, rather than their implicit embodied knowledge.”
Background
Cited by
The Cognitive Architecture of Digital Externalization
Skulmowski, A. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09818-1 · Cited by 76
“Indeed, the use of embodied metaphors (i.e., applying perceptually rich knowledge to process abstract knowledge) has been shown to be an effective instructional method (e.g., Bakker et al., 2012; for an overview, see Gallagher & Lindgren, 2015).”
BackgroundDesigning accessible musical instruments by addressing musician-instrument relationships
(2023) · doi:10.3389/fcomp.2023.1153232 · Cited by 7
Metadata
- Authors
- Bakker, S., Antle, A. N., & van den Hoven, E.
- Venue
- Personal and Ubiquitous Computing
- Published
- 2011-06-12
- Volume
- 16
- Issue
- 4
- Pages
- 433-449
- ISSN
- 1617-4909 (ISSN-L)
- 1617-4917
- OpenAlex
- W2111004320
- Cited by
- 177
- References
- 35
- FWCI
- 14.36
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.