Conversational Agency in Augmentative and Alternative Communication
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Augmented communicators (ACs) use augmentative and alternative communication (AAC) technologies to speak. Prior work in AAC research has looked to improve efficiency and expressivity of AAC via device improvements and user training. However, ACs also face constraints in communication beyond their device and individual abilities such as when they can speak, what they can say, and who they can address. In this work, we recast and broaden this prior work using conversational agency as a new frame to study AC communication. We investigate AC conversational agency with a study examining different conversational tasks between four triads of expert ACs, their close conversation partners (paid aide or parent), and a third party (experimenter). We define metrics to analyze AAC conversational agency quantitatively and qualitatively. We conclude with implications for future research to enable ACs to easily exercise conversational agency.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“It is then often the case that AAC users participate much less than their non-AAC user counterparts in conversation, are left behind in group conversation, or struggle to demonstrate the relevance of their comment that is shared some minutes delayed after their topic they are addressing has passed [29, 30, 35].”
From “The less I type, the better”: How AI Language Models can Enhance or Impede Communication for AAC Users (2023) · cites this paper as [35]
In the citing paper
“As a result, they may feel pressure to respond in time or struggle to participate in a conversation.”
From “The less I type, the better”: How AI Language Models can Enhance or Impede Communication for AAC Users (2023) · cites this paper as [35]
Citations
Cites
The Presentation of Self in Everyday Life.
Naegele, K. D., & Goffman, E. (1956) · American Sociological Review · doi:10.2307/2089106 · Cited by 25,991
A simplest systematics for the organization of turn-taking for conversation
Sacks, H., Schegloff, E. A., & Jefferson, G. (1974) · Language · doi:10.2307/412243 · Cited by 11,350 · cited 1×
“Agency is expressed through actions that further an individual’s objective in the face of outside structure or constraints [7, 11, 15, 30].”
BackgroundEmirbayer, M., & Mische, A. (1998) · American Journal of Sociology · doi:10.1086/231294 · Cited by 6,165
Clark, H. H., & Brennan, S. E. (1991) · Perspectives on socially shared cognition. · doi:10.1037/10096-006 · Cited by 4,555
Studies in the Organization of Conversational Interaction
(1978) · Elsevier eBooks · doi:10.1016/c2013-0-11461-4 · Cited by 867
Beukelman, D. R., & Mirenda, P. (2006) · Medical Entomology and Zoology · Cited by 757
The co-operative, transformative organization of human action and knowledge
Goodwin, C. (2013) · Journal of Pragmatics · doi:10.1016/j.pragma.2012.09.003 · Cited by 726
The Presentation of Self in Everyday Life. Harmondsworth (Penguin) 1959.
Goffman, E. (1959) · Cited by 607
Interdependence as a Frame for Assistive Technology Research and Design
Bennett, C. L., Brady, E., & Branham, S. M. (2018) · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3234695.3236348 · Cited by 493 · cited 1×
“We observe beneficial interdependence [3] between the AC-CCP pair, and acknowledging the unique importance of the contributions of each communicative partner can inform new interactions.”
BackgroundLight, J., & McNaughton, D. (2014) · Augmentative and Alternative Communication · doi:10.3109/07434618.2014.885080 · Cited by 406
Light, J. (1989) · Augmentative and Alternative Communication · doi:10.1080/07434618912331275126 · Cited by 392 · cited 1×
“Research from communication science has focused on increasing communicative competence of ACs [23, 25].”
BackgroundThe experience of agency in human-computer interactions: a review
Limerick, H., Coyle, D., & Moore, J. W. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00643 · Cited by 241 · cited 1×
“Prior work in HCI has generally defined agency as a sense of control over the external environment and one’s body [26].”
BackgroundI did that! Measuring users' experience of agency in their own actions
Coyle, D., Moore, J., Kristensson, P. O., Fletcher, P., & Blackwell, A. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208350 · Cited by 162
Ashby, C. E. (2011) · Disability Studies Quarterly · doi:10.18061/dsq.v31i4.1723 · Cited by 157 · cited 2×
“Prior observational [16, 17, 20], survey [13], and interview [1, 21, 22] studies have investigated AAC conversations among augmented communicators and close conversational partners identifying challenges to CCP-assisted conversation.”
BackgroundLight, J., Collier, B., & Parnes, P. (1985) · Augmentative and Alternative Communication · doi:10.1080/07434618512331273591 · Cited by 141 · cited 2×
“We considered the amount of conversational contributions made by CCPs and ACs and classified them with specific communicative function types as in [8, 24].”
MethodMicbot: A Peripheral Robotic Object to Shape Conversational Dynamics and Team Performance
Tennent, H., Shen, S., & Jung, M. (2019) · 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2019.8673013 · Cited by 125 · cited 1×
“For example, prior work aimed at balancing group speaking participation used a rotating robotic microphone that oriented to each speaker in turn [33].”
BackgroundClarke, M., & Kirton, A. (2003) · Child Language Teaching and Therapy · doi:10.1191/0265659003ct248oa · Cited by 106 · cited 3×
“We considered the amount of conversational contributions made by CCPs and ACs and classified them with specific communicative function types as in [8, 24].”
MethodSeizing the Moment: The Problem of Conversational Agency
Gibson, D. R. (2000) · Sociological Theory · doi:10.1111/0735-2751.00106 · Cited by 91 · cited 3×
“We specifi-cally consider Gibson’s definition from sociology [14], which explains that individuals can exercise agency when conversational constraints loosen enough for them to contribute to the conversation.”
BackgroundInfluentialClarke, M., & Wilkinson, R. (2008) · Augmentative and Alternative Communication · doi:10.1080/07434610701390400 · Cited by 84 · cited 1×
“Communication scientists studying AAC in-person conversations have used methods such as conversational micro-analysis, examining interactions at the utterance level to understand participation in conversations [8, 9, 19, 24, 29].”
MethodDesigning interaction, voice, and inclusion in AAC research
Pullin, G., Treviranus, J., Patel, R., & Higginbotham, J. (2017) · Augmentative and Alternative Communication · doi:10.1080/07434618.2017.1342690 · Cited by 73 · cited 2×
“expressivity, with awareness displays [32] and customizable voices [12, 27, 29].”
BackgroundMethodBabb, S., Gormley, J., McNaughton, D., & Light, J. (2018) · Journal of Special Education Technology · doi:10.1177/0162643418795842 · Cited by 55 · cited 1×
“As a first step towards making communication possible and efficient, designers and researchers of AAC have focused on improving device throughput, for example via text prediction [34], and vocabulary sorting [2, 21], and improving Figure 1.”
BackgroundDesign Opportunities for AAC and Children with Severe Speech and Physical Impairments
Ibrahim, S. B., Vasalou, A., & Clarke, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173801 · Cited by 51 · cited 3×
“Recent AAC research has started to take a critical view of how AAC technology mediates communication [20], but there is still no model of how constraints specific to AAC impact the expression of agency in AAC in-person interactions.”
BackgroundKane, S. K., Morris, M. R., Paradiso, A., & Campbell, J. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998284 · Cited by 50 · cited 5×
“Prior observational [16, 17, 20], survey [13], and interview [1, 21, 22] studies have investigated AAC conversations”
BackgroundInfluentialFiannaca, A., Paradiso, A., Shah, M., & Morris, M. R. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998215 · Cited by 49 · cited 5×
“Prior observational [16, 17, 20], survey [13], and inter-view [1, 21, 22] studies have investigated AAC conversations among augmented communicators and close conversational partners identifying challenges to CCP-assisted conversation.”
BackgroundMethodInfluentialTowards Personalized Speech Synthesis for Augmentative and Alternative Communication
Mills, T., Bunnell, H. T., & Patel, R. (2014) · Augmentative and Alternative Communication · doi:10.3109/07434618.2014.924026 · Cited by 44 · cited 1×
“…( e.g. , who can speak, who can be addressed), the task at hand, the relationship with other speakers, and the device being used can all impact the expression of an augmented communicator’s (AC) agency in conversation. expressivity, with awareness displays [32] and customizable voices [12, 27, 29].”
BackgroundExploring the Design Space of AAC Awareness Displays
Sobel, K., Fiannaca, A. J., Campbell, J., Kulkarni, H., Paradiso, A., Cutrell, E., & Morris, M. R. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025610 · Cited by 38 · cited 2×
“…( e.g. , who can speak, who can be addressed), the task at hand, the relationship with other speakers, and the device being used can all impact the expression of an augmented communicator’s (AC) agency in conversation. expressivity, with awareness displays [32] and customizable voices [12, 27, 29].”
BackgroundThe effect of context priming and task type on augmentative communication performance
Higginbotham, D. J., Bisantz, A. M., Sunm, M., Adams, K., & Yik, F. (2009) · Augmentative and Alternative Communication · doi:10.1080/07434610802131869 · Cited by 30 · cited 3×
“Higginbotham et al. [18, 19] found that CCP often set rules or strategies to solve the map task in an efficient way, so we hypothesize the setting of rules or strategies as a potential action from CCPs that can impact ACs’ expression of agency.”
BackgroundMethodWisenburn, B., & Higginbotham, D. J. (2009) · Augmentative and Alternative Communication · doi:10.1080/07434610902739876 · Cited by 29 · cited 1×
“As a first step towards making communication possible and efficient, designers and researchers of AAC have focused on improving device throughput, for example via text prediction [34], and vocabulary sorting [2, 21], and improving”
BackgroundNakano, Y., Yoshino, T., Yatsushiro, M., & Takase, Y. (2015) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2743028 · Cited by 24 · cited 1×
“Prior work that monitors dominant speakers and uses gaze of a social robot to guide attention to less dominant speakers [28] could be extended to increase AC agency when necessary.”
BackgroundVoicesetting: Voice Authoring UIs for Improved Expressivity in Augmentative Communication
Fiannaca, A. J., Paradiso, A., Campbell, J., & Morris, M. R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173857 · Cited by 21 · cited 1×
“…( e.g. , who can speak, who can be addressed), the task at hand, the relationship with other speakers, and the device being used can all impact the expression of an augmented communicator’s (AC) agency in conversation. expressivity, with awareness displays [32] and customizable voices [12, 27, 29].”
BackgroundKane, S. K., & Morris, M. R. (2017) · Proceedings of the 2017 Conference on Designing Interactive Systems · doi:10.1145/3064663.3064762 · Cited by 20 · cited 3×
“As a first step towards making communication possible and efficient, designers and researchers of AAC have focused on improving device throughput, for example via text prediction [34], and vocabulary sorting [2, 21], and improving Figure 1.”
Background
Research works printed but not linked: 5
- Sarah W Blackstone. 1999. Circles of communication partners. Augmentative Communication News 12 (1999), 1--2.
- Sarah W. Blackstone and Barbara Collier. 2008. Communication assistants: Human supports for communication access. Augmentative Communication News 20, 3 (2008), 1--15.
- Charles Goodwin. 2011. Contextures of action. Embodied interaction: Language and body in the material world (2011), 182--193.
- DJ Higginbotham, K Fulcher, and J Seale. 2016. Time and timing in interactions involving individuals with ALS, their unimpaired partners and their speech generating devices. The silent partner (2016), 199--229.
- Ben Shneiderman. 1986. Eight golden rules of interface design. Disponible en (1986).
Cited by
How does HCI Understand Human Agency and Autonomy?
Bennett, D., Metatla, O., Roudaut, A., & Mekler, E. D. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580651 · Cited by 111
“adaptation both during supported communication [162], and in interaction with intelligent technologies [108, 155, 176].”
BackgroundInfluentialValencia, S., Cave, R., Kallarackal, K., Seaver, K., Terry, M., & Kane, S. K. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581560 · Cited by 97
“Informed by prior work that uncovered challenges in AAC-based social interactions [16, 20, 35], we created multiple prompts using the transformer-based large language model LaMDA developed for dialogue applications [32].”
BackgroundMethodSelf-citationCo-designing Socially Assistive Sidekicks for Motion-based AAC
Valencia, S., Luria, M., Pavel, A., Bigham, J. P., & Admoni, H. (2021) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3434073.3444646 · Cited by 41
“)” Based on the online survey and along with prior work [58], we identifed that it would be worthwhile to explore whether an embodied technology could play a supportive role similar to a”
BackgroundMethodInfluentialSelf-citationDesigning AACs for People with Aphasia Dining in Restaurants
Obiorah, M. G., Piper, A. M., & Horn, M. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445280 · Cited by 41
“investigate constraints that afect the conversational agency of people who use AACs [57].”
BackgroundCOMPA: Using Conversation Context to Achieve Common Ground in AAC
Valencia, S., Huynh, J., Jiang, E. Y., Wu, Y., Wan, T., Zheng, Z., Admoni, H., Bigham, J. P., & Pavel, A. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642762 · Cited by 36
Self-citation
Metadata
- Authors
- Valencia, S., Pavel, A., Santa Maria, J., Yu, S. (., Bigham, J. P., & Admoni, H.
- Affiliations
- Carnegie Mellon University (US)
- Carnegie Mellon University, Pittsburgh, PA, USA
- Venue
- Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2020-04-21
- Pages
- 1-12
- OpenAlex
- W3030185973
- Cited by
- 31
- References
- 31
- Citations by year
- 2025: 12 · 2024: 5 · 2023: 4 · 2022: 2 · 2021: 8
- FWCI
- 6.84
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by-nd)
- Topics
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Keywords
- augmentative and alternative communication, AAC users, communication partners
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.