The DOI matches its Crossref record; 60 of the 63 references it cites were found in a registry or an index.
Believable and Effective AI Agents in Virtual Worlds: Current State and Future Perspectives
Abstract
The rapid development of complex virtual worlds (most notably, in 3D computer and video games) introduces new challenges for the creation of virtual agents, controlled by artificial intelligence (AI) systems. Two important subproblems in this topic area which need to be addressed are (a) believability and (b) effectiveness of agents’ behavior, i.e., human-likeness of the characters and high ability to achieving their own goals. In this paper, the authors study current approaches to believability and effectiveness of AI behavior in virtual worlds. They examine the concepts of believability and effectiveness, and analyze several successful attempts to address these challenges.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Flow: the psychology of optimal experience
(1990) · Choice Reviews Online · doi:10.5860/choice.28-0597 · Cited by 12,637
I.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290 · cited 1×
“One of the possible approaches to the problem is to adapt a well-known Turing test (Turing, 1950) to intelligent agents, behaving in a virtual world.”
BackgroundFlow: The Psychology of Optimal Experience
Buchanan, R., & Csikszentmihalyi, M. (1991) · Design Issues · doi:10.2307/1511458 · Cited by 9,394
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
Computing Machinery and Intelligence (1950)
Turing, A. (2004) · The Essential Turing · doi:10.1093/oso/9780198250791.003.0017 · Cited by 6,118
Sweetser (2005) · doi:10.1145/1077246.1077253 · Cited by 2,124 · cited 1×
“These observations were applied to the domain of game worlds by Sweetser and Wyeth (2005), who list the following factors, affecting user enjoyment: 1.”
MethodCooperative Multi-Agent Learning: The State of the Art
Panait, L., & Luke, S. (2005) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-005-2631-2 · Cited by 1,237
Serious games : mechanisms and effects
Ritterfeld, U., Cody, M. J., & Vorderer, P. (2009) · MADOC (University of Mannheim) · Cited by 841
Toward a Definition of “Virtual Worlds”
Bell, M. W. (1970) · Journal For Virtual Worlds Research · doi:10.4101/jvwr.v1i1.283 · Cited by 456
Woolley, B. (1992) · Cited by 363
Ad Hoc Autonomous Agent Teams: Collaboration without Pre-Coordination
Stone, P., Kaminka, G., Kraus, S., & Rosenschein, J. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7529 · Cited by 323
Adaptive game AI with dynamic scripting
Spronck, P., Ponsen, M., Sprinkhuizen-Kuyper, I., & Postma, E. (2006) · Machine Learning · doi:10.1007/s10994-006-6205-6 · Cited by 262
Case-Based Planning and Execution for Real-Time Strategy Games
Ontañón, S., Mishra, K., Sugandh, N., & Ram, A. (2007) · International Conference on Case-Based Reasoning · doi:10.1007/978-3-540-74141-1_12 · Cited by 173
A Turing Test for Computer Game Bots
Hingston, P. (2009) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2009.2032534 · Cited by 167
RoboCup: A challenge problem for AI and robotics
Kitano, H., Asada, M., Kuniyoshi, Y., Noda, I., Osawai, E., & Matsubara, H. (1998) · Lecture Notes in Computer Science · doi:10.1007/3-540-64473-3_46 · Cited by 166
UCT for tactical assault planning in real-time strategy games
Balla, R.-K., & Fern, A. (2009) · Cited by 158
Spatial Social Behavior in Second Life
Friedman, D., Steed, A., & Slater, M. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74997-4_23 · Cited by 158
Turing's test and believable AI in games
Livingstone, D. (2006) · Computers in entertainment · doi:10.1145/1111293.1111303 · Cited by 134
Gamebots: A 3D Virtual World Test-Bed For Multi-Agent Research
Adobbati, R., Marshall, A. N., Scholer, A., Tejada, S., Kaminka, G. A., Schaffer, S. R., & Sollitto, C. (2001) · Cited by 130
TOWARDS OPTIMIZING ENTERTAINMENT IN COMPUTER GAMES
Yannakakis, G. N., & Hallam, J. C. T. (2007) · Applied Artificial Intelligence · doi:10.1080/08839510701527580 · Cited by 123
Using a genetic algorithm to tune first-person shooter bots
Cole, N., Louis, S. J., & Miles, C. E. (2004) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2004.1330849 · Cited by 113
Evolving Opponents for Interesting Interactive Computer Games
Yannakakis, G. N., & Hallam, J. C. T. (2004) · The MIT Press eBooks · doi:10.7551/mitpress/3122.003.0062 · Cited by 110
Research in human-level AI using computer games
Laird, J. E. (2002) · Communications of the ACM · doi:10.1145/502269.502290 · Cited by 100
Question answering in the context of stories.
Graesser, A. C., Lang, K. L., & Roberts, R. M. (1991) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.120.3.254 · Cited by 99
Learning Human-like Movement Behavior for Computer Games
Thurau, C., Bauckage, C., & Sagerer, G. (2004) · The MIT Press eBooks · doi:10.7551/mitpress/3122.003.0040 · Cited by 84
Bots trained to play like a human are more fun
Soni, B., & Hingston, P. (2008) · IEEE World Congress on Computational Intelligence · doi:10.1109/ijcnn.2008.4633818 · Cited by 78
Teaching Bayesian behaviours to video game characters
Hy, R. L., Arrigoni, A., Bessìère, P., & Lebeltel, O. (2004) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2004.03.012 · Cited by 74
Rapid and Reliable Adaptation of Video Game AI
Bakkes, S. C. J., Spronck, P. H. M., & van den Herik, H. J. (2009) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2009.2029084 · Cited by 71
Learning Human-Like Opponent Behavior for Interactive Computer Games
Bauckhage, C., Thurau, C., & Sagerer, G. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-45243-0_20 · Cited by 63
An Objective Character Believability Evaluation Procedure for Multi-agent Story Generation Systems
Riedl, M. O., & Young, R. M. (2005) · Lecture notes in computer science · doi:10.1007/11550617_24 · Cited by 53
RETALIATE: learning winning policies in first-person shooter games
Smith, M. L., Lee-Urban, S., & Muñoz‐Avila, H. (2007) · Cited by 51
Game Bot Detection via Avatar Trajectory Analysis
Pao, H.-K., Chen, K.-T., & Chang, H.-C. (2010) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2010.2072506 · Cited by 51
Believability Testing and Bayesian Imitation in Interactive Computer Games
Gorman, B., Thurau, C., Bauckhage, C., & Humphrys, M. (2006) · Lecture notes in computer science · doi:10.1007/11840541_54 · Cited by 50
Manojlovich, J., Prasithsangaree, P., Hughes, S., Chen, J., & Lewis, M. (2004) · International Conference on Machine Learning and Cybernetics · doi:10.1109/wsc.2003.1261517 · Cited by 46
Zyda, M., Hiles, J. E., Mayberry, A., Wardynski, C., Capps, M. V., Osborn, B., Shilling, R. D., Robaszewski, M., & Davis, M. (2003) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2003.1159611 · Cited by 42
Ijaz, K., Bogdanovych, A., & Simoff, S. J. (2011) · Figshare · Cited by 41
Toward the construction of fun computer games: Differences in the views of developers and players
Choi, D.-S., Kim, H., & Kim, J. (1999) · Personal and Ubiquitous Computing · doi:10.1007/bf01305334 · Cited by 39
UT⁁2: Human-like behavior via neuroevolution of combat behavior and replay of human traces
Schrum, J., Karpov, I. V., & Miikkulainen, R. P. (2011) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2011.6032024 · Cited by 38
Dynamic formations in real-time strategy games
van der Heijden, M., Bakkes, S. C. J., & Spronck, P. H. M. (2008) · IEEE Symposium on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2008.5035620 · Cited by 34
A Multiagent Potential Field‐Based Bot for Real‐Time Strategy Games
Hagelbäck, J., & Johansson, S. J. (2008) · International Journal of Computer Games Technology · doi:10.1155/2009/910819 · Cited by 29
A Generic Approach for Obtaining Higher Entertainment in Predator/Prey Computer Games
Yannakakis, G. N., & Hallam, J. C. T. (2005) · OAR@UM (University of Malta) · Cited by 25
How to construct a believable opponent using cognitive modeling in the game of set
Taatgen, N., van Oploo, M., Braaksma, J., & Niemantsverdriet, J. (2003) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 23
Game Development Essentials: Game Artificial Intelligence
Ahlquist, J. S., & Novak, J. (2007) · Medical Entomology and Zoology · Cited by 22
CERA-CRANIUM: a test bed for machine consciousness research
Arrabales, R., Es, M., Ledezma, A., & Sanchis, A. (2009) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 21
Interfacing a cognitive agent platform with a virtual world: a case study using Second Life
Ranathunga, S., Cranefield, S., & Purvis, M. (2011) · doi:10.5555/2034396.2034477 · Cited by 17
EVOLVING A TEAM IN A FIRST-PERSON SHOOTER GAME BY USING A GENETIC ALGORITHM
Liaw, C., Wang, W., Tsai, C.-T., Ko, C., & Hao, G. (2013) · Applied Artificial Intelligence · doi:10.1080/08839514.2013.768883 · Cited by 14
Monte-Carlo Planning for Pathfinding in Real-Time Strategy Games
Naveed, M., Kitchin, D. E., & Crampton, A. (2010) · Huddersfield Research Portal (University of Huddersfield) · Cited by 12
Automatable Evaluation Method Oriented toward Behaviour Believability for Video GamesPreprint
Tencé, F., & Buche, C. (2010) · arXiv (Cornell University) · Cited by 9
Evolving Teams of Cooperating Agents for Real-Time Strategy Game
Lichocki, P., Krawiec, K., & Jaśkowski, W. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-01129-0_37 · Cited by 9
Is human-like and well playing contradictory for Diplomacy bots?
Kemmerling, M., Ackermann, N., Beume, N., Preuß, M., Uellenbeck, S., & Walz, W. (2009) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2009.5286472 · Cited by 9
Building a Believable Agent for a 3D Boxing Simulation Game
Mozgovoy, M., & Umarov, I. (2010) · International Conference on Computer Research and Development · doi:10.1109/iccrd.2010.11 · Cited by 8
Self-citationA Hybrid Fuzzy ANN System for Agent Adaptation in a First Person Shooter
Rhalibi, A. E., & Merabti, M. (2007) · International Journal of Computer Games Technology · doi:10.1155/2008/432365 · Cited by 8
Evolutionary neural networks for Non-Player Characters in Quake III
Westra, J., & Dignum, F. P. M. (2009) · IEEE Symposium on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2009.5286460 · Cited by 8
Lee, F. J., & Gamard, S. (2003) · eScholarship (California Digital Library) · Cited by 7
Beyond individualism: modeling team playing behavior in robot soccer through case-based reasoning
Ros, R., Veloso, M., de Mántaras, R. L., Carles Sierra, A., & Arcos, J. L. (2007) · DIGITAL.CSIC (Spanish National Research Council (CSIC)) · Cited by 5
Agent design to pass computer games
Glende, A. (2004) · ACM Southeast Regional Conference (ACMSE) · doi:10.1145/986537.986640 · Cited by 5
Building a believable and effective agent for a 3D boxing simulation game
Mozgovoy, M., & Umarov, I. (2010) · doi:10.1109/iccsit.2010.5564876 · Cited by 5
Self-citationA CBR Inspired Approach to Rapid and Reliable Adaption of Video Game Al
Bakkes, S. C. J., Spronck, P. H. M., & van den Herik, H. J. (2011) · Research portal (Tilburg University) · Cited by 3
Storytelling with Storyteller Agents in Second Life®
Morie, J. F., Chance, E., Haynes, K., & Purohit, D. (2012) · International Conference on Cyberworlds (CW) · doi:10.1109/cw.2012.30 · Cited by 2
(1990)
Research works printed but not linked: 14
- S.Bonacina, 2008, Evolving dodging behavior for OpenArena using neuroevolution of augmenting topologies., Urbana (Caracas, Venezuela), IL
- R.Bonse, 2004, Learning agents in Quake III (Tech. Rep.)
- Booth, M. (2004). The official counter-strike bot. In Proceedings of the Game Developers Conference.
- Chernova, S., & Veloso, M. (2007). Multiagent collaborative task learning through imitation. In Proceedings of the 4th International Symposium on Imitation in Animals and Artifacts (pp. 74-79).
- Choi, D., Konik, T., Nejati, N., Park, C., & Langley, P. (2007). A believable agent for first-person perspective games. In Proceedings of the 3rd Artificial Intelligence and Interactive Digital Entertainment International Conference.
- Hirono, D., & Thawonmas, R. (2009). Implementation of a human-like bot in a first person shooter: Second place bot at BotPrize 2008. In Proceedings of the Asia Simulation Conference.
- Isla, D. (2005). Handling complexity in the Halo 2 AI. In Proceedings of the Game Developers Conference.
- P.Langley, 2005, Interleaving learning, problem-solving, and execution in the ICARUS architecture (Tech. Rep.)
- T.Malone, 1981, What makes computer games fun?, Byte, 6, 258
- Mehta, M., Ontañón, S., & Ram, A. (2010). Meta-level behavior adaptation in real-time strategy games. In Proceedings of the Workshop on Case Based Reasoning for Computer Games.
- Orkin, J. (2006). Three states and a plan: the AI of FEAR. In Proceedings of the Game Developers Conference.
- Robertson, J., & Good, J. (2005). Adventure author: An authoring tool for 3D virtual reality story construction. In Proceedings of the Workshop on Narrative Learning Environments (pp. 63-69).
- Ros, R., Veloso, M., de Mántaras, R., Sierra, C., & Arcos, J. (2007). Beyond individualism: Modeling team playing behavior. In Proceedings of the National Conference on Artificial Intelligence (Vol. 2, pp. 1671-1674).
- S.Wintermute, 2007, SORTS (Tech. Rep.)
Cited by
Generative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J. C., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · arXiv · doi:10.48550/arxiv.2304.03442 · Cited by 2,173
Generative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606763 · Cited by 2,187
Agent Supported Serious Game Environment
Terzidou, T., Tsiatsos, Τ., Miliou, C., & Sourvinou, A. (2016) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2016.2521649 · Cited by 43
“[17],”
Applying Behavior characteristics to decision-making process to create believable game AI
Simonov, A., Сергеевич, З. А., & Fedorov, V. (2019) · Procedia Computer Science · doi:10.1016/j.procs.2019.08.222 · Cited by 22
Miyashita, S., Lian, X., Zeng, X., Matsubara, T., & Uehara, K. (2017) · ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD) · doi:10.1109/snpd.2017.8022767 · Cited by 16
“AI agent from the perspective of the satisfaction of the players rather than of high level of skill [5] Currently, in most commercial games, game AI is made by rule-based hard coding and takes an action according to conditional branching prepared in advance [6] However, it takes much workload to make game AI for vario…”
Background
Metadata
- Authors
- Umarov, I., & Mozgovoy, M.
- Affiliations
- TruSoft International Inc., USA
- University of Aizu (JP)
- ORCID
- Mozgovoy, Maxim
- Venue
- International Journal of Gaming and Computer-Mediated Simulations
- Publisher
- IGI Global Scientific Publishing
- Published
- 2012-04-01
- Volume
- 4
- Issue
- 2
- Pages
- 37-59
- ISSN
- 1942-3888 (ISSN-L)
- 1942-3896
- OpenAlex
- W2098535914
- Semantic Scholar
- e923908c24fb95a266d66cfd812fbb2efbafb2ac
- Cited by
- 32
- References
- 63
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 3 · 2023: 3 · 2022: 2 · 2019: 4 · 2018: 1 · 2017: 1 · 2016: 5 · 2015: 3 · 2014: 1 · 2013: 2 · 2012: 1
- FWCI
- 2.20
- Type
- journal article
- Language
- ng
- Open access
- closed
- Locations
- International Journal of Gaming and Computer-Mediated Simulations (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Sociology and Political Science › Digital Games and Media
- Keywords
- virtual agents, believable agents, virtual worlds, 3D computer games, video games, human-likeness, goal achievement, game AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.