Guidelines for Assessing and Minimizing Risks of Emotion Recognition Applications
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Society has witnessed a rapid increase in the adoption of commercial uses of emotion recognition. Tools that were traditionally used by domain experts are now being used by individuals who are often unaware of the technology’s limitations and may use them in potentially harmful settings. The change in scale and agency, paired with gaps in regulation, urge the research community to rethink how we design, position, implement and ultimately deploy emotion recognition to anticipate and minimize potential risks. To help understand the current ecosystem of applied emotion recognition, this work provides an overview of some of the most frequent commercial applications and identifies some of the potential sources of harm. Informed by these, we then propose 12 guidelines for systematically assessing and reducing the risks presented by emotion recognition applications. These guidelines can help identify potential misuses and inform future deployments of emotion recognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
Self-citationEcological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
Guidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 1×
“In Amershi et al. [33], the authors synthesized over 20 years of guidance around the design of human-AI interaction and provided a set of 18 AI usability guidelines to help design more useful and acceptable AI-based products and prototypes.”
BackgroundSelf-citationEmotional expressions reconsidered: Challenges to inferring emotion from human facial movements
Barrett, L. F., Adolphs, R., Marsella, S., Martinez, A. M., & Pollak, S. D. (2019) · Psychological Science in the Public Interest · doi:10.1177/1529100619832930 · Cited by 1,748
Russell, J. A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.1.102 · Cited by 1,640 · cited 1×
“However, emotion theory continues to evolve and be hotly debated [69], [70].”
BackgroundAffective computing: challenges
Picard, R. W. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00052-1 · Cited by 978 · cited 2×
“However, current commercial applications of emotion recognition are still far from these scenarios due to well-known research challenges such as the idiosyncratic nature of emotion perception, the need for better emotion theory, and the difficulty of creating truly representative models [17].”
BackgroundSelf-citationAutomation Bias in Intelligent Time Critical Decision Support Systems
Cummings, M. (2004) · AIAA 1st Intelligent Systems Technical Conference · doi:10.2514/6.2004-6313 · Cited by 269 · cited 1×
“While these observations may seem obvious to the general affective computing researcher, we have observed that the terminology and the models used to represent emotion recognition technology can be confusing and that new practitioners might overestimate the predictive power of AI [15].”
BackgroundLarge-scale wearable data reveal digital phenotypes for daily-life stress detection
Smets, E., Rios Velazquez, E., Schiavone, G., Chakroun, I., D’Hondt, E., De Raedt, W., Cornelis, J., Janssens, O., Van Hoecke, S., Claes, S., et al. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0074-9 · Cited by 250
Automation bias in intelligent time critical decision support systems
Cummings, M. L. (2017) · Decision Making in Aviation · doi:10.4324/9781315095080-17 · Cited by 233
Cultural regulation of emotion: individual, relational, and structural sources.
De Leersnyder, J., Boiger, M., & Mesquita, B. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00055 · Cited by 232 · cited 2×
“Differences in individual styles or cultural norms for emotional expressiveness and suppression can lead to an obvious mismatch between felt emotions, expressed emotions, and perceived emotions [71]–[73].”
Background
Cited by
Luetke Lanfer, H., Reifegerste, D., Weber, W., Memenga, P., Baumann, E., Geulen, J., Klein, S., Müller, A., Hahne, A., & Weg-Remers, S. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-10785-8 · Cited by 30
High-risk artificial intelligence
Sunyaev, A., Benlian, A., Pfeiffer, J., Jussupow, E., Thiebes, S., Maedche, A., & Gawlitza, J. (2025) · Business & Information Systems Engineering · doi:10.1007/s12599-025-00942-6 · Cited by 16
Rethinking technology innovation for mental health: framework for multi-sectoral collaboration
Suh, J., Pendse, S. R., Lewis, R., Howe, E., Saha, K., Okoli, E., Amores, J., Ramos, G., Shen, J., Borghouts, J., et al. (2024) · Nature Mental Health · doi:10.1038/s44220-024-00232-2 · Cited by 8
“…in algorithm-driven mental health technologies (that is, the absence of a clear responsible party for the outcomes or consequences of these technologies) has raised both ethical and legal concerns, underscoring the need for ethical guidelines for their research, creation and deployment 31–36 .”
Self-citation
Metadata
- Authors
- Hernandez, J., Lovejoy, J., McDuff, D., Suh, J., O'Brien, T., Sethumadhavan, A., Greene, G., Picard, R., & Czerwinski, M.
- Venue
- 2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII)
- Publisher
- IEEE
- Published
- 2021-09-28
- Pages
- 1-8
- OpenAlex
- W3189062941
- Cited by
- 51
- References
- 12
- FWCI
- 8.83
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Guidelines for Assessing and Minimizing Risks of Emotion Recognition Applications. https://app.cochat.ai/papers/10.1109/acii52823.2021.9597452
- The paper
- Hernandez, J., Lovejoy, J., McDuff, D., Suh, J., O'Brien, T., Sethumadhavan, A., Greene, G., Picard, R., & Czerwinski, M. (2021). Guidelines for Assessing and Minimizing Risks of Emotion Recognition Applications. 2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII). https://doi.org/10.1109/acii52823.2021.9597452
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.