Captioning for Small Groups: Integrating Social, Environmental, and Technical Factors for Enhanced Accessibility

Why It Matters

This research highlights that user experience with captioning is deeply intertwined with social relationships, physical surroundings, and the technical limitations of the system. Designers must move beyond purely technical metrics to create solutions that genuinely support diverse user needs in real-world, informal settings.

Key Finding

The effectiveness of real-time captioning in informal group settings depends on social context, the environment, and technical performance, with users desiring more information about conversational cues and features that promote better communication from all participants.

Key Findings

• Participants' experiences with captioned small-group conversations are influenced by social factors (e.g., interlocutor relationships), environmental factors (e.g., display types), and technical factors (e.g., caption lag).
• Future captioning tools are desired to provide feedback on non-speech elements like speaker identity and speech rate, and to assist hearing interlocutors in communicating more accessibly.

Research Evidence

Aim: What are the social, environmental, and technical factors influencing the use of real-time captioning in small-group conversations, and what are the design preferences for future captioning tools to better support d/Deaf and hard of hearing (DHH) individuals?

Method: Qualitative research

Procedure: Semi-structured interviews and design probe activities were conducted with d/Deaf and hard of hearing participants to explore their experiences with existing captioning services and gather input on future design preferences for small-group communication.

Sample Size: 15 participants

Context: Informal, interactive small-group conversations (in-person and remote)

Design Principle

Accessibility solutions must be context-aware, considering the multifaceted nature of user interaction.

How to Apply

When designing communication tools, conduct user research that explores not just functional requirements but also the social and environmental conditions under which the tool will be used.

Limitations

Findings are specific to the experiences of the interviewed DHH participants and may not generalize to all users or all types of informal conversations.

Student Guide (IB Design Technology)

Simple Explanation: For captioning to work well in casual chats, it needs to be good technically, but also consider who is talking to whom and where they are. People want captions to show who's speaking and how loud they are, not just the words.

Why This Matters: This research shows that making technology accessible isn't just about making it work perfectly; it's about making it work for real people in real life, with all its complexities.

Critical Thinking: How can designers proactively anticipate and design for the complex interplay of social, environmental, and technical factors in diverse informal communication settings, beyond just direct user feedback?

IA-Ready Paragraph: This research highlights the critical need to integrate social, environmental, and technical considerations into the design of communication technologies. By understanding how factors like interlocutor relationships, display environments, and caption lag affect user experience, designers can create more effective and inclusive solutions. The study's emphasis on user preferences for non-speech elements, such as speaker identification and prosody, further underscores the importance of a holistic, user-centered approach to accessibility design.

Project Tips

• When researching accessibility features, think about the whole situation, not just the technology.
• Interview users about their experiences in different settings to uncover hidden needs.

How to Use in IA

• Use this study to justify the need for user research that explores social and environmental factors in your design project.
• Reference the findings to support your design decisions regarding contextual information in your interface.

Examiner Tips

• Demonstrate an understanding that user needs are shaped by more than just functional requirements.
• Show how your design addresses the social and environmental context of use.

Independent Variable: ["Social factors (e.g., interlocutor relationships)","Environmental factors (e.g., type of captioning displays)","Technical factors (e.g., caption lag)"]

Dependent Variable: ["User experience with existing captioning services","Preferences for future captioning tools"]

Controlled Variables: ["Type of conversation (small-group)","Participant group (d/Deaf and hard of hearing)"]

Strengths

• Focuses on an under-researched area (small-group informal captioning).
• Employs user-centered methods (interviews, probes) to gather rich qualitative data.

Critical Questions

• To what extent can technical solutions alone address the social and environmental barriers identified?
• How can future captioning systems be designed to be adaptable to a wide range of social and environmental contexts?

Extended Essay Application

• Investigate the impact of different display technologies (e.g., projected, personal devices) on the usability of real-time captioning in a small group.
• Explore how the social dynamics of a group (e.g., power dynamics, familiarity) influence the perceived effectiveness of captioning.

Source

Social, Environmental, and Technical: Factors at Play in the Current Use and Future Design of Small-Group Captioning · Proceedings of the ACM on Human-Computer Interaction · 2021 · 10.1145/3479578