CoChat
Sign Up
Cited by 842Emotion and Mood RecognitionHealth, Education, and Physical CultureLanguage, Discourse, Communication Strategies

Social signal processing: Survey of an emerging domain

Open access
Vinciarelli, Alessandro, Pantic, Maja, Bourlard, Hervé·2009·Image and Vision Computing
DOI 10.1016/j.imavis.2008.11.007
Open this paper in CoChat — free accountOpen PDF

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.imavis.2008.11.007

Cites

195 of 195 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Intent classification in current systems often only relies on text from ASR, whereas a classifier of feedback and grounding would also need to take prosody and visual signals into account.

    “Moreover, intent classification in current systems often only relies on the text (from the ASR), whereas a classifier of feedback and grounding would also need to take prosody (and visual signals) into account, which brings it closer to the area of social signal processing (Vinciarelli et al., 2009).”

    From Modeling Feedback in Interaction With Conversational Agents—A Review (2022) · cites this paper as Vinciarelli et al., 2009

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 61

  1. J. Ajmera, Robust Audio Segmentation, Ph.D. thesis, École Polytechnique Fédérale de Lausanne (EPFL), 2004.
  2. K.AlbrechtSocial Intelligence: The New Science of Success2005, John Wiley & Sons Ltd., 2005.
  3. N. Ambady, F. Bernieri, J. Richeson, Towards a histology of social behavior: judgmental accuracy from thin slices of behavior, in: M.P. Zanna (Ed.), Advances in Experimental Social Psychology, 2000, pp. 201-272.
  4. M.ArgyleThe Psychology of Interpersonal Behaviour1967, Penguin, Harmondsworth, 1967.
  5. C. Barras, X. Zhu, S. Meignier, J.L. Gauvain, Improving speaker diarization, in: Proceedings of the Rich Transcription Workshop, 2004.
  6. R. Barzilay, M. Collins, J. Hirschberg, S. Whittaker, The rules behind the roles: identifying speaker roles in radio broadcasts, in: Proceedings of American Association of Artificial Intelligence Symposium, 2000, pp. 679-684.
  7. J.K.Burgoon, L.A.Stern, L.DillmanInterpersonal Adaptation: Dyadic Interaction Patterns1995, Cambridge University Press, Cambridge, 1995.
  8. N.CampbellConversational speech synthesis and the need for some laughterIEEE Transactions on Speech and Language Processing 14 (4)2006 1171-1178.
  9. D.CrystalProsodic Systems and Intonation in English1969, Cambridge University Press, Cambridge, 1969.
  10. T.Darrell, G.Gordon, M.Harville, J.WoodfillIntegrated person tracking using stereo, color, and pattern detectionInternational Journal of Computer Vision 37 (2)2000 175-185.
  11. A.Dielmann, S.RenalsAutomatic meeting segmentation using dynamic bayesian networksIEEE Transactions on Multimedia 9 (1)2007 25.
  12. P.Ekman (Ed.)Emotion in the Human Face1982, Cambridge University Press, Cambridge, 1982.
  13. P. Ekman, T.S. Huang, T.J. Sejnowski, J.C. Hager (Eds.), Final Report to NSF of the Planning Workshop on Facial Expression Understanding, Human Interaction Laboratory, University of California, San Francisco, 1993.
  14. R.R.Faden, T.L.Beauchamp, N.M.P.KingA History and Theory of Informed Consent1986, Oxford University Press, Oxford, 1986.
  15. T.Gandhi, M.M.TrivediPedestrian protection systems: issues, survey, and challengesIEEE Transactions on Intelligent Transportation Systems 8 (3)2007 413-430.
  16. L.Gorelick, M.Blank, E.Shechtman, M.Irani, R.BasriActions as space-time shapesIEEE Transactions on Pattern Analysis and Machine Intelligence 29 (12)2007 2247-2253.
  17. K. Greene, 10 Emerging Technologies 2008, MIT Technology Review, February 2008.
  18. M.R.Greenwald, A.G.BanajiImplicit social cognition: attitudes, self-esteem, and stereotypesPsychological Review 102 (1)1995 4-27.
  19. M.M. Gross, E.A. Crane, B.L. Fredrickson, Effect of felt and recognized emotions on body movements during walking, in: Proceedings of the International Conference on the Expression of Emotions in Health and Disease, 2007.
  20. J.B.Hayfron-Acquah, M.S.Nixon, J.N.CarterAutomatic gait recognition by symmetry analysisPattern Recognition Letters 24 (13)2003 2175-2183.
  21. C.R.L.Hsu, M.Abdel-Mottaleb, A.K.JainFace detection in colour imagesIEEE Transactions on Pattern Analysis and Machine Intelligence 24 (5)2002 696- 706.
  22. D. Keltner, P. Ekman, Facial expression of emotion, in: M. Lewis, J.M. Haviland-Jones (Eds.), Handbook of Emotions, 2000, pp. 236-249.
  23. L. Kennedy, D. Ellis, Laughter detection in meetings, in: Proceedings of the NIST Meeting Recognition Workshop, 2004.
  24. Z.KundaSocial Cognition1999, MIT Press, Cambridge, MA, 1999.
  25. X.Li, S.J.Maybank, S.Yan, D.Tao, D.XuGait components and their application to gender recognitionIEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 38 (2)2008 145-155.
  26. Y. Liu, E. Shriberg, A. Stolcke, M. Harper, Comparing HMM, maximum entropy, and conditional random fields for disfluency detection, in: Proceedings of the European Conference on Speech Communication and Technology, 2005.
  27. L.Lu, H.J.Zhang, H.JiangContent analysis for audio classification and segmentationIEEE Transactions on Speech and Audio Processing 10 (7)2002 504-516.
  28. L.Z.McArthur, R.M.BaronToward an ecological theory of social perceptionPsychological Review 90 (3)1983 215-238.
  29. I.McCowan, D.Gatica-Perez, S.Bengio, G.Lathoud, M.Barnard, D.ZhangAutomatic analysis of multimodal group actions in meetingsIEEE Transactions on Pattern Analysis and Machine Intelligence 27 (3)2005 305- 317.
  30. D.McNeillHand and Mind: What Gestures Reveal about Thought1996, University Of Chicago Press, IL, 1996.
  31. K.P. Murphy, Dynamic Bayesian Networks: Representation, Inference and Learning, Ph.D. thesis, University of California Berkeley, 2002.
  32. I.Oikonomopoulos, I.Patras, M.PanticSpatiotemporal salient points for visual recognition of human actionsIEEE Transactions on Systems, Man, and Cybernetics -Part B 36 (3)2006 710-719.
  33. S.OviattUser-centered modeling and evaluation of multimodal interfacesProceedings of the IEEE 912003 1457-1468.
  34. S.Oviatt, C.Darves, R.CoulstonToward adaptive conversational interfaces: modeling speech convergence with animated personasACM Transactions on Computer-Human Interaction 11 (3)2004 300-328.
  35. P. Pal, A.N. Iyer, R.E. Yantorno, in: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 2, 2006, pp. 721- 724.
  36. M.Pantic, M.S.BartlettMachine analysis of facial expressions, in: K.Delac, M.Grgic (Eds.)Handbook of Face Recognition2007, I-Tech Education and Publishing, 2007, pp. 377-416.
  37. M.Pantic, L.J.M.RothkrantzAutomatic analysis of facial expressions: the state of the artIEEE Transactions on Pattern Analysis and Machine Intelligence 22 (12)2000 1424-1445.
  38. M.Pantic, L.J.M.RothkrantzToward an affect-sensitive multimodal human- computer interactionProceedings of the IEEE 91 (9)2003 1370-1390.
  39. A. Pentland, Social dynamics: signals and behavior, in: International Conference on Developmental Learning, 2004.
  40. A.PentlandHonest Signals: How They Shape Our World2008, MIT Press, Cambridge, MA, 2008.
  41. J.O.PicklesAn Introduction to the Physiology of Hearing1982, Academic Press, New York, 1982.
  42. G.PsathasConversation Analysis -The Study of Talk-in-Interaction1995, Sage Publications, Beverley Hills, 1995.
  43. R.Rienks, D.HeylenDominance detection in meetings using easily obtainable featuresLecture Notes in Computer Science, vol. 38692006, Springer, Berlin, 2006, pp. 76-86.
  44. H.A.Rowley, S.Baluja, T.KanadeNeural network-based face detectionIEEE Transactions on Pattern Analysis and Machine Intelligence 20 (1)1998 23-38.
  45. J.A.Russell, J.M.Fernandez-Dols (Eds.)The Psychology of Facial Expression1997, Cambridge University Press, Cambridge, 1997.
  46. N.RussoConnotation of seating arrangementsCornell Journal of Social Relations 2 (1)1967 37-44.
  47. K.R.SchererPersonality markers in speech1979, Cambridge University Press, Cambridge, 1979.
  48. K.R.SchererVocal communication of emotion: a review of research paradigmsSpeech Communication 40 (1-2)2003 227-256.
  49. U.Segerstrale, P.Molnar (Eds.)Nonverbal Communication: Where Nature Meets Culture1997, Lawrence Erlbaum Associates, London, 1997.
  50. E. Shriberg, A. Stolcke, D. Baron, Observations of overlap: findings and implications for automatic processing of multiparty conversation, in: Proceedings of Eurospeech, 2001, pp. 1359-1362.
  51. K.K.Sung, T.PoggioExample-based learning for view-based human face detectionIEEE Transactions on Pattern Analysis and Machine Intelligence 20 (1)1998 39-51.
  52. C.ThurauBehavior histograms for action recognition and human detectionLecture Notes in Computer Science, vol. 48142007, Springer- Verlag, Berlin, 2007, pp. 271-284.
  53. S.E.Tranter, D.A.ReynoldsAn overview of automatic speaker diarization systemsIEEE Transactions on Audio, Speech, and Language Processing 14 (5)2006 1557-1565.
  54. H.C.TriandisCulture and Social Behavior1994, McGraw-Hill, New York, 1994.
  55. A.Vinciarelli, J.-M.OdobezApplication of information retrieval technologies to presentation slidesIEEE Transactions on Multimedia 8 (5)2006 981-995.
  56. S.Wasserman, K.FaustSocial Network Analysis: Methods and Applications1994, Cambridge University Press, Cambridge, 1994.
  57. Y.Yacoob, L.DavisDetection and analysis of hairIEEE Transactions on Pattern Analysis and Machine Intelligence 28 (7)2006 1164-1169.
  58. M.H.Yang, D.Kriegman, N.AhujaDetecting faces in images: a surveyIEEE Transactions on Pattern Analysis and Machine Intelligence 24 (1)2002 34-58.
  59. J. Yao, J.-M. Odobez, Fast human detection from videos using covariance features, in: Proceedings of European Conference on Computer Vision Visual Surveillance Workshop, 2008.
  60. G.YulePragmatics1996, Oxford University Press, Oxford, 1996.
  61. Q. Zhu, S. Avidan, M.C. Yeh, K.T. Cheng, Fast human detection using a cascade of histograms of oriented gradients, in: Proceedings of Computer Vision and Pattern Recognition, 2006, pp. 1491-1498.

Cited by

Sorted by citations

Related

Authors
Vinciarelli, A., Pantic, M., & Bourlard, H.
Affiliations
École Polytechnique Fédérale de Lausanne (CH)
Corresponding author
Vinciarelli, Alessandro
ORCID
Vinciarelli, Alessandro
Venue
Image and Vision Computing
Publisher
Elsevier BV
Published
2009-11
Volume
27
Issue
12
Pages
1743-1759
ISSN
0262-8856 (ISSN-L)
DOI
10.1016/j.imavis.2008.11.007
OpenAlex
W4211153864
Cited by
842
References
195
Citations by year
2026: 35 · 2025: 37 · 2024: 29 · 2023: 34 · 2022: 36 · 2021: 61 · 2020: 65 · 2019: 53 · 2018: 46 · 2017: 72 · 2016: 56 · 2015: 65 · 2014: 55 · 2013: 53 · 2012: 61
FWCI
35.23
Type
journal article
Language
en
Open access
Licence
Locations
  • Image and Vision Computing (publishedVersion)
  • Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
  • University of Twente Research Information (submittedVersion)
  • ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (submittedVersion)
  • Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
Funders
  • Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung
  • Seventh Framework Programme (211486, 231287)
  • European Research Council (ERC-2007-StG-203143)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
  • Social Sciences › Psychology › Social Psychology › Health, Education, and Physical Culture
  • Social Sciences › Arts and Humanities › Language and Linguistics › Language, Discourse, Communication Strategies
Keywords
social signal processing, social intelligence, turn-taking, politeness, disagreement, nonverbal cues, human-computer interaction, social psychology

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review