CoChat

Virtual character performance from speech

Marsella, Stacy, Xu, Yuyu, Lhommet, Margaux, Feng, Andrew, Scherer, Stefan, Shapiro, Ari · 2013 · Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation

The DOI matches its Crossref record; 55 of the 59 references it cites were found in a registry or an index.

Abstract

We demonstrate a method for generating a 3D virtual character performance from the audio signal by inferring the acoustic and semantic properties of the utterance. Through a prosodic analysis of the acoustic signal, we perform an analysis for stress and pitch, relate it to the spoken words and identify the agitation state. Our rule-based system performs a shallow analysis of the utterance text to determine its semantic, pragmatic and rhetorical content. Based on these analyses, the system generates facial expressions and behaviors including head movements, eye saccades, gestures, blinks and gazes. Our technique is able to synthesize the performance and generate novel gesture animations based on coarticulation with other closely scheduled animations. Because our method utilizes semantics in addition to prosody, we are able to generate virtual character performances that are more appropriate than methods that use only prosody. We perform a study that shows that our technique outperforms methods that use prosody alone.

Overview

Integrity signals

Registry

Crossref · 10.1145/2485895.2485900

Cites

55 of 55 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 55 references

Research works printed but not linked: 9

  1. Bergmann K., Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems-Volume 1, 361--368
  2. Cao Y., Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SCA '03, 225--231
  3. 10.5555/974305.974323 · doi:10.5555/974305.974323
  4. 10.1002/cav.v15:1 · doi:10.1002/cav.v15:1
  5. Drugman T., 1973, Proceedings of Interspeech 2011
  6. Kane J., International Conference on Acoustics, Speech, and Signal Processing (ICASSP).
  7. Lafferty J., In Proceedings of the AAAI Fall Symposium on Probabilistic Approaches to Natural Language, 89--97
  8. Mishra T., 2012, Proceedings of Interspeech
  9. Niewiadomski R., Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems -, 2

Cited by

See all 168

Metadata

Authors
Marsella, S., Xu, Y., Lhommet, M., Feng, A., Scherer, S., & Shapiro, A.
Affiliations
University of Southern California (US)
Venue
Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Publisher
ACM
Published
2013-07-19
Pages
25-35
OpenAlex
W2024536104
Cited by
168
References
59
Citations by year
2026: 3 · 2025: 12 · 2024: 18 · 2023: 20 · 2022: 13 · 2021: 20 · 2020: 12 · 2019: 18 · 2018: 10 · 2017: 9 · 2016: 9 · 2015: 14 · 2014: 9 · 2013: 1
FWCI
15.03
Type
conference paper
Language
en
Open access
closed
Locations
ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA) (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Human Motion and Animation
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
Keywords
speech-driven animation, prosodic analysis, semantic analysis, pragmatic analysis, facial expression synthesis, head movement, eye saccades, gesture synthesis, coarticulation, rule-based systems

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Virtual character performance from speech. https://app.cochat.ai/papers/10.1145/2485895.2485900
The paper
Marsella, S., Xu, Y., Lhommet, M., Feng, A., Scherer, S., & Shapiro, A. (2013). Virtual character performance from speech. Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation. https://doi.org/10.1145/2485895.2485900

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.