Animated agents for procedural training in virtual reality: Perception, cognition, and motor control
Open accessAbstract
This paper describes Steve , an animated agent that helps students learn to perform physical , procedural tasks . The student and Steve cohabit a three - dimensional , simulated mock - up of the student's work environment . Steve can demonstrate how to perform tasks and can also monitor students while they practice tasks , providing assistance when needed . This paper describes Steve's architecture in detail , including perception , cognition , and motor control . The perception module monitors the state of the virtual world , maintains a coherent representation of it , and provides this information to the cognition and motor control modules . The cognition module interprets its perceptual input , chooses appropriate goals , constructs and executes plans to achieve those goals , and sends out motor commands . The motor control module implements these motor commands , controlling Steve's voice , locomotion , gaze , and gestures , allowing Steve to manipulate objects in the virtual world .
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Situated gesture generation systems for virtual agents and human-robot communication are based on rules and/or procedural generation, which limits naturalness, fluidity and variability and makes it difficult to match contemporary generative co-speech gesture models.
“All of these systems are based on rules and/or procedural generation, which limits the degree of naturalness, fluidity, and variability that can be achieved in the resulting animations, and makes it difficult to match the gesture quality produced by contemporary generative models for co-speech gestures as described above.”
From Incorporating Spatial Awareness in Data-Driven Gesture Generation for Virtual Agents (2024) · cites this paper as [23]
Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 30
- Allen, J. F., B. W. Miller, E. K. Ringger, and T. Sikorski. 1996. Robust understanding in a dialogue system. In Proc. 34th Annual Meeting of the Association for Computational Linguistics, 62 70.
- Anderson, J. R., A. T. Corbett, K. R. Koedinger, and R. Pelletier. 1995. Cognitive tutors: Lessons learned. J . Learning Sci. 4(2):167 207.
- Andre, E., and T. Rist. 1996. Coping with temporal constraints in multimedia presentation planning. In Proc. 13th National Conference on Arti cial Intelligence (AAAI-96), 142 147. Menlo Park, Calif.: AAAI Press/MIT Press.
- Badler, N. I., C. B. Phillips, and B. L. Webber. 1993. Simulating humans. New York : Oxford University Press.
- Billinghurst, M., and J. Savage. 1996. Adding intelligence to the interface. In Proc. IEEE Virtual Reality Annual International Symposium (VRAIS '96), 168 175. Los Alamitos, Calif.: IEEE Computer Society Press.
- Billinghurst, M., J. Savage, P. Oppenheimer, and C. Edmond. 1996. The expert surgical assistant: An intelligent virtual environment with multimodal input. In Proc. Medicine Meets Virtual Reality IV.
- Burton, R. R. 1982. Diagnosing bugs in a simple procedural skill. In Intelligent tutoring systems, eds. D. Sleeman and J. Brown, 157 183. San Diego, Calif. : Academic Press.
- Cassell, J., C. Pelachaud, N. Badler, M. Steedman, B. Achorn, T. Becket, B. Douville, S. Prevost, and M. Stone. 1994. Animated conversation: Rule-based generation of facial expresion, gesture and spoken intonation for multiple conversational agents. In Proc. ACM SIGGRAPH '94.
- Cormen, T. H., C. E. Leiserson, and R. L. Rivest. 1989. Introduction to algorithms. New York : McGraw- Hill.
- Douville, B., L. Levison, and N. I. Badler. 1996. Task-level object grasping for simulated agents. Presence 5(4):416 430.
- Ferguson, G., J. Allen, and B. Miller. 1996. Trains-95: Towards a mixed-initiative planning assistant. In Proc. 3rd Conference on AI Planning Systems.
- Grosz, B. J., and C. L. Sidner. 1986. Attention, intentions, and the structure of discourse. Comput. Liguis- tics 12(3):175 204.
- Johnson, W. L. 1994. Agents that learn to explain themselves. In Proc. T welfth National Conference on Arti cial Intelligence (AAAI-94), 1257 1263. Menlo Park, Calif.: AAAI Press.
- Johnson, W. L., S. Marsella, and J. Rickel. 1998a. Pedagogical agents in virtual team training. In Proc. Virtual Worlds and Simulation Conference, vol. 30, Simulation Series. San Diego, Calif.: Society for Computer Simulation International.
- Korth, H. F., and A. Silberschatz. 1986. Database system concepts. New York : McGraw-Hill.
- Labrou, Y., and T. Finin. 1994. A semantics approach for KQML-A general purpose communication language for software agents. In Proc. 3rd International Conference on Information and Knowledge Management. New York : ACM Press.
- Laird, J. E., A. Newell, and P. S. Rosenbloom. 1987. Soar: An architecture for general intelligence. Arti cial Intelligence 33(1):1 64.
- McAllester, D., and D. Rosenblitt. 1991. Systematic nonlinear planning. In Proc. 9th National Conference on Arti cial Intelligence (AAAI-91), 634 639. Menlo Park, Calif.: AAAI Press.
- Moore, J. D. 1993. What makes human explanations eVective? In Proc. 15th Annual Conference of the Cognitive Science Society, 131 136.
- Munro, A., and D. Surmon. 1997. Primitive simulation-centered tutor services. In Proc. AI-ED Workshop on Architectures for Intelligent Simulation-Based Learning Environments.
- Munro, A., M. Johnson, D. Surmon, and J. Wogulis. 1993. Attribute-centered simulation authoring for instruction. In Proc. World Conference on Arti cial Intelligence in Education (AI-ED '93), 82 89. Association for the Advancement of Computing in Education.
- Newell, A. 1990. Uni ed theories of cognition. Cambridge, Mass.: Harvard University Press.
- Noma, T., and N. I. Badler. 1997. A virtual human presenter. In Proc. IJ CAI W orkshop on Animated Interface Agents: Making T hem Intelligent, 45 51.
- Rickel, J. 1988. An intelligent turtoring framework for task-oriented domains. In Proc. International Conference on Intelligent T utoring Systems.
- Sacerdoti, E. 1977. A structure for plans and behavior. New York : Elsevier North-Holland.
- Stiles, R., L. McCarthy, and M. Pontecorvo. 1995. Training studio: A virtual environment for training. In W orkshop on Simulation and Interaction in Virtual Environments (SIVE-95). Iowa City, Iowa : ACM Press.
- Stone, B. A., and J. C. Lester. 1996. Dynamically sequencing an animated pedagogical agent. In Proc. 13th National Conference on Arti cial Intelligence (AAAI-96), 424 431. Menlo Park, Calif.: AAAI Press/MIT Press.
- Thorisson, K. R. 1996. Communicative humanoids: A computational model of psychosocial dialogue skills. Ph.D. dissertation, Massachusetts Institute of Technology, Cambridge, Mass.
- Trias, T. S., S. Chopra, B. D. Reich, M. B. Moore, N. I. Badler, B. L. Webber, and C. W. Geib. 1996. Decision networks for integrating the behaviors of virtual agents and avatars. In Proc. IEEE Virtual Reality Annual International Symposium (VRAIS '96), 156 162. Los Alamitos, Calif.: IEEE Computer Society Press.
- Weld, D. S. 1994. An introduction to least commitment planning. AI Magazine 15(4):27 61.
Cited by
Sorted by citations
Social cues in multimedia learning: role of speaker’s voice
Mayer, R. E., Sobko, K., & Mautone, P. D. (2003) · Journal of Educational Psychology · doi:10.1037/0022-0663.95.2.419 · Cited by 429 · see citing works
Negotiated Collusion: Modeling Social Language and its Relationship Effects in Intelligent Agents
Cassell, J., & Bickmore, T. (2003) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1024026532471 · Cited by 253 · see citing works
Synthesizing multimodal utterances for conversational agents
Kopp, S., & Wachsmuth, I. (2004) · Computer Animation and Virtual Worlds · doi:10.1002/cav.6 · Cited by 243 · see citing works
Implementation and Evaluation of “Just Follow Me”: An Immersive, VR-Based, Motion-Training System
Yang, U., & Kim, G. J. (2002) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474602317473240 · Cited by 160 · see citing works
Polite web-based intelligent tutors: Can they improve learning in classrooms?
McLaren, B. M., DeLeeuw, K. E., & Mayer, R. E. (2011) · Computers & Education · doi:10.1016/j.compedu.2010.09.019 · Cited by 98 · see citing works
Virtual Affective Agents and Therapeutic Games
Hudlicka, E. (2016) · Artificial Intelligence in Behavioral and Mental Health Care · doi:10.1016/b978-0-12-420248-1.00004-0 · Cited by 34 · see citing works
Incorporating Spatial Awareness in Data-Driven Gesture Generation for Virtual Agents
Deichler, A., Alexanderson, S., & Beskow, J. (2024) · Proceedings of the ACM International Conference on Intelligent Virtual Agents · doi:10.1145/3652988.3673936
- Authors
- Rickel, J., & Johnson, W. L.
- Affiliations
- University of Southern California (US)
- ORCID
- Johnson, W. Lewis
- Venue
- Applied Artificial Intelligence
- Publisher
- Informa UK Limited
- Published
- 1999-05
- Volume
- 13
- Issue
- 4-5
- Pages
- 343-382
- ISSN
- 0883-9514 (ISSN-L)
- 1087-6545
- OpenAlex
- W2159973998
- Cited by
- 480
- References
- 0
- Citations by year
- 2026: 5 · 2025: 4 · 2024: 8 · 2023: 4 · 2022: 7 · 2021: 14 · 2020: 8 · 2019: 7 · 2018: 10 · 2017: 12 · 2016: 9 · 2015: 5 · 2014: 9 · 2013: 9 · 2012: 14
- FWCI
- 37.68
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Applied Artificial Intelligence (publishedVersion)
- Funders
- Office of Naval Research (N00014)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Keywords
- animated agents, procedural training, virtual reality, student monitoring, perception, cognition, motor control, goal selection, planning, gesture control, virtual environment simulation, agent architecture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review