Fig. 1: A conversation between two AAC users. We find that backchanneling (active-listening) plays a crucial role in communication. However, here to enter text, both users engage with their devices, missing out on non-verbal cues from their interlocutor. We identify a need for better support of backchanneling for AAC, while respecting their established micro-culture.

Abstract

Backchanneling (e.g., "uh-huh", "hmm", a simple nod) encompasses a big part of everyday communication; it is how we negotiate the turn to speak, it signals our engagement, and shapes the flow of our conversations. For people with speech and motor impairments, backchanneling is limited to a reduced set of modalities, and their Augmentative and Alternative Communication (AAC) technology requires visual attention, making it harder to observe non-verbal cues of conversation partners. We explore how users of AAC technology approach backchanneling and create their own unique channels and communication culture. We conducted a workshop with 4 AAC users to understand the unique characteristics of backchanneling in AAC. We explored how backchanneling changes when pairs of AAC users communicate vs when an AAC user communicates with a non-AAC user. We contextualize these findings through four in-depth interviews with speech-language pathologists (SLPs). We conclude with a discussion about backchanneling as a micro‑cultural practice, rethinking embodiment and mediation in AAC technology, and providing design recommendations for timely multi-modal backchanneling while respecting different communication cultures.

Video

Citation

Acknowledgements

We extend our sincere gratitude to YAI (Young Adult Institute) for providing the space and facilities that enabled this research. We are especially thankful to Judith Baley-Hung, BIS Coordinator and Supervisor of the Center for Engagement and Innovation at YAI, for her mentorship and support throughout the project. We also thank Julia Shulman for connecting us with a generous and insightful network of speech-language pathologists. This work was supported by the Siegel Public Interest Technology Impact Fellowship (PiTech), whose funding made this research possible.

The website template was borrowed from Michaël Gharbi.