Automatic Deictic Gestures for Animated Pedagogical Agents
The DOI matches its Crossref record; 83 of the 88 references it cites were found in a registry or an index.
Abstract
We present a system that automatically generates deictic gestures for animated pedagogical agents (APAs). The system takes audio and text as input, which define what the APA has to say, and generates animated gestures based on a set of rules. The automatically generated gestures point to the exact locations of elements on a whiteboard nearby the APA, which are calculated by searching for keywords mentioned in the speech. We conducted a study with 100 subjects, in which we compared lecture videos containing gestures automatically-scripted by the system to videos of the same lecture containing manually-scripted gestures. The study results show that the manually-scripted and automatically-scripted lectures had comparable number of gestures, and that the gestures were timed equally well.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“All of these systems are based on rules and/or procedural generation, which limits the degree of naturalness, fluidity, and variability that can be achieved in the resulting animations, and makes it difficult to match the gesture quality produced by contemporary generative models for co-speech gestures as described above.”
From Incorporating Spatial Awareness in Data-Driven Gesture Generation for Virtual Agents (2024) · cites this paper as [14]
Citations
Cites
Embodied Conversational Agents
(2000) · The MIT Press eBooks · doi:10.7551/mitpress/2697.001.0001 · Cited by 1,799
Moreno, R., & Mayer, R. (2007) · Educational Psychology Review · doi:10.1007/s10648-007-9047-2 · Cited by 1,666
Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments
Johnson, W. L., Rickel, J. W., & Lester, J. C. (2000) · Cited by 812
AutoTutor: an intelligent tutoring system with mixed-initiative dialogue.
Graesser, A. C., Chipman, P., Haynes, B. C., & Olney, A. (2005) · IEEE Transactions on Education · doi:10.1109/te.2005.856149 · Cited by 750
BEAT: the Behavior Expression Animation Toolkit
Cassell, J., Vilhjálmsson, H. H., & Bickmore, T. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383315 · Cited by 739 · cited 1×
“One of the first systems that used this approach was the BEAT toolkit [76], which generated nonverbal behavior and synthesized speech, taking”
MethodEmbodiment in Mathematics Teaching and Learning: Evidence From Learners' and Teachers' Gestures
Alibali, M. W., & Nathan, M. J. (2012) · Journal of the Learning Sciences · doi:10.1080/10508406.2011.611446 · Cited by 691
When do gestures communicate? A meta-analysis.
Hostetter, A. B. (2011) · Psychological Bulletin · doi:10.1037/a0022128 · Cited by 558
Gestures: Their Role in Teaching and Learning
Roth, W.-M. (2001) · Review of Educational Research · doi:10.3102/00346543071003365 · Cited by 496 · cited 1×
“Primary Rules: Research on instructor gesture has shown that a large number of important instructor gestures are deictic gestures [85], [86], which connect the graphical representation of lesson elements, appearing on a whiteboard, on paper, or in a textbook, to their utterance within the instructor speech.”
BackgroundResearch-Based Design of Pedagogical Agent Roles: a Review, Progress, and Recommendations
Kim, Y., & Baylor, A. L. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0055-y · Cited by 422
Brand, M. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311537 · Cited by 411
Research works printed but not linked: 5
- baylor, 0, Pedagogical agents as social models for engineering: The influence of agent appearance on female choice, Proc Conf Artif Intell Educ Supporting Learn Intell Socially Informed Technol, 125, 65
- baylor, 0, Designing effective nonverbal communication for pedagogical agents, Proc Conf Artif Intell Educ Supporting Learn Intell Socially Informed Technol, 744
- 10.1207/s15516709cog2001_1 · doi:10.1207/s15516709cog2001_1 · Paper page
- 10.1002/acp.1347 · DOI · Paper page
- rosenfelder, 2011, Fave (forced alignment and vowel extraction) program suite
Cited by
Dai, C.-P., & Ke, F. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100087 · Cited by 271
Shute, V., Rahimi, S., Smith, G., Ke, F., Almond, R., Dai, C., Kuba, R., Liu, Z., Yang, X., & Sun, C. (2021) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12473 · Cited by 132
How pedagogical agents communicate with students: A two-phase systematic review
Sikström, P., Valentini, C., Sivunen, A., & Kärkkäinen, T. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104564 · Cited by 103
Pérez‐Sanagustín, M., Sapunar‐Opazo, D., Álvarez, R. A. P., Hilliger, I., Bey, A., Maldonado‐Mahauad, J., & Baier, J. A. (2020) · Computer Applications in Engineering Education · doi:10.1002/cae.22337 · Cited by 89
Twenty-five Years of Learning with Pedagogical Agents: History, Barriers, and Opportunities
Siegle, R. F., Schroeder, N. L., Lane, H. C., & Craig, S. D. (2023) · TechTrends · doi:10.1007/s11528-023-00869-3 · Cited by 36
Metadata
- Authors
- Kappagantula, S. R. K., Adamo-Villani, N., Wu, M.-L., & Popescu, V.
- Affiliations
- Purdue University West Lafayette (US)
- Venue
- IEEE Transactions on Learning Technologies
- Published
- 2020-01-01
- Volume
- 13
- Issue
- 1
- Pages
- 1-13
- ISSN
- 1939-1382 (ISSN-L)
- 2372-0050
- OpenAlex
- W2952862469
- Cited by
- 13
- References
- 88
- Citations by year
- 2025: 2 · 2024: 3 · 2023: 1 · 2022: 3 · 2021: 2 · 2020: 2
- FWCI
- 0.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Learning Technologies (publishedVersion)
- Funders
- Institute of Education Sciences
- U.S. Department of Education (R305A130016)
- National Science Foundation (1217215)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Keywords
- pointing gestures, animated pedagogical agents, video lectures, gesture timing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automatic Deictic Gestures for Animated Pedagogical Agents. https://app.cochat.ai/papers/10.1109/tlt.2019.2922134
- The paper
- Kappagantula, S. R. K., Adamo-Villani, N., Wu, M.-L., & Popescu, V. (2020). Automatic Deictic Gestures for Animated Pedagogical Agents. IEEE Transactions on Learning Technologies. https://doi.org/10.1109/tlt.2019.2922134
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.