CoChat

Designing for Responsible Trust in AI Systems: A Communication Perspective

Open access
Liao, Q.Vera, Sundar, S. Shyam · 2022 · 2022 ACM Conference on Fairness Accountability and Transparency

The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index; 7 of the 79 sources its claims cite were checked for support.

Abstract

Current literature and public discourse on “trust in AI” are often focused on the principles underlying trustworthy AI, with insufficient attention paid to how people develop trust. Given that AI systems differ in their level of trustworthiness, two open questions come to the fore: how should AI trustworthiness be responsibly communicated to ensure appropriate and equitable trust judgments by different users, and how can we protect users from deceptive attempts to earn their trust? We draw from communication theories and literature on trust in technologies to develop a conceptual model called MATCH, which describes how trustworthiness is communicated in AI systems through trustworthiness cues and how those cues are processed by people to make trust judgments. Besides AI-generated content, we highlight transparency and interaction as AI systems’ affordances that present a wide range of trustworthiness cues to users. By bringing to light the variety of users’ cognitive processes to make trust judgments and their potential limitations, we urge technology creators to make conscious decisions in choosing reliable trustworthiness cues for target users and, as an industry, to regulate this space and prevent malicious use. Towards these goals, we define the concepts of warranted trustworthiness cues and expensive trustworthiness cues, and propose a checklist of requirements to help technology creators identify appropriate cues to use. We present a hypothetical use case to illustrate how practitioners can use MATCH to design AI systems responsibly, and discuss future directions for research and industry efforts aimed at promoting responsible trust in AI.

Overview

CoChat Summary

TL;DR

The paper argues that trust in AI should be studied as communication: model trustworthiness is conveyed through cues embedded in AI-generated content, transparency, and interaction affordances, then processed via systematic or heuristic routes. It proposes the MATCH conceptual model and defines warranted and expensive trustworthiness cues to guide responsible design and regulation.

Key findings

  • MATCH decouples underlying model trustworthiness attributes—ability, intention benevolence, and process integrity—from trustworthiness cues presented through three AI system affordances: AI-generated content, transparency, and interaction.
  • Users process cues through dual processes: systematic processing or heuristic processing; heuristics can be founded or unfounded, and individual differences in ability/motivation can create inequitable trust outcomes, such as XAI features leading to over-trust for AI novices or cognitively constrained users.
  • The paper defines warranted trustworthiness cues as satisfying truthfulness, relevance, and calibration conditions, and proposes expensive trustworthiness cues as costly signals to help guard against deceptive trust-seeking.
  • It illustrates MATCH with a hypothetical HealthChecker symptom-checker use case, analyzing cues such as diagnosis suggestions, normative metrics, explanations, provenance/governance documentation, customization, and socialization for two personas, Eric and Jessie, and plotting calibration likelihood against expense.

Methods

  • Conceptual/theoretical paper; synthesizes communication theories (ELM, HSM), trust in automation, web credibility/trust, and the affordance-cue-heuristic approach (MAIN model) to develop MATCH.
  • No primary empirical data or sample; uses a hypothetical AI symptom checker use case with two personas to demonstrate a four-step design analysis.
  • Main analysis is conceptual model development plus proposed checklist/conditions for warranted cues and a calibration-expense analysis; the paper calls for future empirical work.

Limitations

  • The paper states it is conceptual and a starting point; it invites future research to empirically investigate trustworthiness cues and heuristics, and notes that conceptual analysis alone is not enough.
  • The paper states it assumes a single underlying model for simplicity and focuses on trust as an attitude, not behavioral outcomes like reliance; ecological factors are acknowledged but outside scope.
  • Evident from the text: the MATCH model and checklist are not empirically validated in this paper; the HealthChecker use case is hypothetical, and the calibration-expense ratings are illustrative rather than measured.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/3531146.3533182

Cites

57 of 57 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

5 Valid · 0 Not valid · 41 Not checked · 62 Own results and interpretations

40 more claims

Create a free account to see all 108 claims and to verify the 72 references still open.

See all claims — free account
  • Probably not a substantial claim. 52
  • It may state two separate claims as one. 30

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 57 references

Research works printed but not linked: 14

  1. Rebecca BliegeBird and EricAlden Smith. 2005. Signaling theory, strategic interaction, and symbolic capital. Current anthropology 46, 2 (2005), 221–248.
  2. Graham Dietz and Deanne N Den Hartog. 2006. Measuring trust inside organisations. Personnel review (2006).
  3. Andrew J Flanagin and Miriam J Metzger. 2007. The role of site features, user attributes, and information verification behaviors on the perceived credibility of web-based information. New media & society 9, 2 (2007), 319–342.
  4. James J Gibson. 1977. The theory of affordances. Hilldale, USA 1, 2 (1977), 67–82.
  5. Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Franco Turini, Fosca Giannotti, and Dino Pedreschi. 2018. A survey of methods for explaining black box models. ACM computing surveys (CSUR) 51, 5 (2018), 1–42.
  6. Monique WM Jaspers, Thiemo Steen, Cor Van Den Bos, and Maud Geenen. 2004. The think aloud method: a guide to user interface design. International journal of medical informatics 73, 11-12(2004), 781–795.
  7. Daniel Kahneman. 2011. Thinking, fast and slow. Macmillan.
  8. John D Lee and Katrina A See. 2004. Trust in automation: Designing for appropriate reliance. Human factors 46, 1 (2004), 50–80.
  9. Zachary C Lipton. 2018. The Mythos of Model Interpretability: In machine learning, the concept of interpretability is both important and slippery.Queue 16, 3 (2018), 31–57.
  10. 10.5555/1315930.1315940 · doi:10.5555/1315930.1315940
  11. Soo Young Rieh and David R Danielson. 2007. Credibility: A multidisciplinary framework. Annual review of information science and technology 41, 1(2007), 307–364.
  12. Keng Siau and Weiyu Wang. 2018. Building trust in artificial intelligence, machine learning, and robotics. Cutter business technology journal 31, 2 (2018), 47–53.
  13. S Shyam Sundar. 2008. The MAIN model: A heuristic approach to understanding technology effects on credibility. MacArthur Foundation Digital Media and Learning Initiative.
  14. Harini Suresh, Natalie Lao, and Ilaria Liccardi. 2020. Misplaced Trust: Measuring the Interference of Machine Learning in Human Decision-Making. In 12th ACM Conference on Web Science. 315–324.

Cited by

See all 165

Metadata

Authors
Liao, Q. V., & Sundar, S. S.
Affiliations
  • Microsoft (Canada) (CA)
  • Pennsylvania State University (US)
Venue
2022 ACM Conference on Fairness Accountability and Transparency
Publisher
ACM
Published
2022-06-20
Pages
1257-1268
OpenAlex
W4225295761
Cited by
165
References
57
Citations by year
2026: 60 · 2025: 52 · 2024: 32 · 2023: 19 · 2022: 1
FWCI
25.77
Type
conference paper
Language
en
Open access
Locations
  • ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
Keywords
trust in AI, trustworthy AI, MATCH model, responsible AI design, transparency, AI-generated content, trust judgments, AI affordances

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Designing for Responsible Trust in AI Systems: A Communication Perspective. https://app.cochat.ai/papers/10.1145/3531146.3533182
The paper
Liao, Q. V., & Sundar, S. S. (2022). Designing for Responsible Trust in AI Systems: A Communication Perspective. 2022 ACM Conference on Fairness Accountability and Transparency. https://doi.org/10.1145/3531146.3533182

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.