A Systematic Survey of 15 Years of User Studies Published in the Intelligent Virtual Agents Conference
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
The field of intelligent virtual agents (IVAs) has evolved immensely over the past 15 years, introducing new application opportunities in areas such as training, health care, and virtual assistants. In this survey paper, we provide a systematic review of the most influential user studies published in the IVA conference from 2001 to 2015 focusing on IVA development, human perception, and interactions. A total of 247 papers with 276 user studies have been classified and reviewed based on their contributions and impact. We identify the different areas of research and provide a summary of the papers with the highest impact. With the trends of past user studies and the current state of technology, we provide insights into future trends and research challenges.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ten challenges for making automation a ‘team player’ in joint human-agent activity
Klein, G., Woods, D. D., Bradshaw, J. M., Hoffman, R. R., & Feltovich, P. J. (2004) · IEEE Intelligent Systems · doi:10.1109/mis.2004.74 · Cited by 590 · cited 1×
“With researchers studying the challenges and requirements of creating supportive “team-player” agents [24, 58], we believe human-agent collaboration is a valuable avenue for future research.”
BackgroundCreating Rapport with Virtual Agents
Gratch, J., Wang, N., Gerten, J., Fast, E., & Duffy, R. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74997-4_12 · Cited by 419 · cited 1×
“Studying rapport, researchers experimented with different aspects of BC signals such as contingency and frequency [41, 76], quantity, type, and timings [75], and testing with responsive and non-responsive agents [42], while some studied correlations be-”
BackgroundBridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing
Vinciarelli, A., Pantic, M., Heylen, D., Pelachaud, C., Poggi, I., D'Errico, F., & Schroeder, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.27 · Cited by 381
Gratch, J., Okhmatovskaia, A., Lamothe, F., Marsella, S., Morales, M., van der Werf, R. J., & Morency, L.-P. (2006) · Lecture Notes in Computer Science · doi:10.1007/11821830_2 · Cited by 247
Designing Relational Agents as Long Term Social Companions for Older Adults
Vardoulakis, L. P., Ring, L., Barry, B., Sidner, C. L., & Bickmore, T. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33197-8_30 · Cited by 166
Bergmann, K., Eyssel, F., & Kopp, S. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33197-8_13 · Cited by 136 · cited 2×
“While some verbal aspects, such as pitch or prosody, and the impact of empathic speech content have been developed and discussed as an aspect of IVA systems or a component of user studies, they were generally not the main contribution of the paper [7, 9, 13, 19, 21, 37, 47, 48, 66, 69, 70, 76, 77, 81, 85].”
BackgroundVirtual Agents as Daily Assistants for Elderly or Cognitively Impaired People
Yaghoubzadeh, R., Kramer, M., Pitsch, K., & Kopp, S. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40415-3_7 · Cited by 98 · cited 1×
“In this field researchers have experimented with using IVAs for explaining health documents [17] and assisting the elderly and cognitively impaired with scheduling and organizational tasks [91].”
MethodSearching for prototypical facial feedback signals,
Heylen, D., Bevacqua, E., Tellier, M., & Pelachaud, C. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74997-4_14 · Cited by 41
Modeling Warmth and Competence in Virtual Characters
Nguyen, T.-H. D., Carstensdottir, E., Ngo, N., El-Nasr, M. S., Gray, M., Isaacowitz, D., & Desteno, D. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-21996-7_18 · Cited by 34
Cited by
A Systematic Review of Ten Years of Research on Human Interaction with Social Robots
Lambert, A., Norouzi, N., Bruder, G., & Welch, G. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1801172 · Cited by 89
“Our process for choosing keywords was inspired by methods from previous review papers (Cabibihan et al., 2013; Fong et al., 2003; Kim et al., 2018; Leite et al., 2013; N. Norouzi, Bruder et al., 2019; N. Norouzi et al., 2018; Pennisi et al., 2016), contextualized in robotics.”
MethodSelf-citationAware Intelligent Virtual Agent's Effect on Social Presence and Empathy of Caregivers
Ahmmed, A., Butts, E., Naeiji, K., Thiamwong, L., Ancis, J., & Daher, S. (2024) · Proceedings of the ACM International Conference on Intelligent Virtual Agents · doi:10.1145/3652988.3673951 · Cited by 8
Self-citation
Metadata
- Authors
- Norouzi, N., Kim, K., Hochreiter, J., Lee, M., Daher, S., Bruder, G., & Welch, G.
- Venue
- Proceedings of the 18th International Conference on Intelligent Virtual Agents
- Publisher
- ACM
- Published
- 2018-11-05
- Pages
- 17-22
- OpenAlex
- W2901752164
- Cited by
- 68
- References
- 9
- FWCI
- 11.27
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.