Framing 'You are the problem' motivates programmers to detect bias more effectively than 'You are the solution'.
Category: User-Centred Design · Effect: Strong effect · Year: 2023
Programmers are more likely to identify and address bias in their work when presented with a framing that acknowledges their potential role in the problem, particularly when the communicator shares certain demographic characteristics.
Design Takeaway
When aiming to encourage programmers to identify and address bias, frame the issue as a shared problem they can help solve, and consider the demographic alignment between the communicator and the audience for maximum impact.
Why It Matters
Understanding how to motivate technical professionals to engage with ethical considerations like bias is crucial for developing responsible technology. This insight highlights that the way a message is framed and who delivers it can significantly influence a programmer's willingness to actively seek out and mitigate bias in their designs.
Key Finding
Programmers are more motivated to find and fix bias when told they are part of the problem, especially if the person telling them is white and male, but this effect depends on the programmer's own views on social hierarchy.
Key Findings
- A 'problem' framing ('You are part of the problem') was more effective than a 'solution' framing ('You are part of the solution') in motivating bias detection.
- The effectiveness of framing was moderated by the speaker's race and gender, and the recipient's social dominance orientation-egalitarianism (SDO-E) levels.
- For individuals with low SDO-E, a white male speaker with a problem framing was more effective.
- For individuals with high SDO-E, the framing and speaker demographics had a reversed effect.
Research Evidence
Aim: To investigate how different motivational appeals (problem vs. solution framing) and speaker demographics (race and gender) influence programmers' detection of bias, considering individual differences in social dominance orientation-egalitarianism.
Method: Experimental study
Procedure: Programmers were presented with scenarios involving potential bias in technology. Their ability to detect this bias was measured under different conditions, varying the framing of the appeal (problem vs. solution) and the demographic characteristics of the speaker delivering the appeal.
Sample Size: 575 participants
Context: Software development and technology design
Design Principle
Motivational framing and communicator demographics significantly influence the engagement of technical professionals in ethical design practices.
How to Apply
When developing training materials or internal communications about bias in design, experiment with different message framings and consider who will deliver the message to best resonate with the target audience.
Limitations
The study focused on US programmers and may not generalize to other cultural contexts or professional groups. The specific SDO-E thresholds for reversed effects were not explicitly detailed.
Student Guide (IB Design Technology)
Simple Explanation: Telling programmers they might be part of the problem makes them more likely to look for and fix bias than telling them they are part of the solution. Who tells them also matters, and it depends on how much they believe in social equality.
Why This Matters: This research helps understand how to encourage designers and engineers to be more mindful of bias in their work, leading to more equitable and user-centred products.
Critical Thinking: How might the effectiveness of these framings change if the bias being addressed is highly systemic or deeply ingrained in societal structures, rather than individual design choices?
IA-Ready Paragraph: This research by Román Almanzár et al. (2023) demonstrates that framing messages around 'being part of the problem' is more effective than 'being part of the solution' in motivating programmers to detect bias. This effect is further influenced by the speaker's demographics and the recipient's individual differences, suggesting that careful consideration of communication strategy is vital for promoting ethical design practices.
Project Tips
- When designing interventions or guidelines for ethical design, consider how you will motivate users or team members to engage.
- Think about the language and tone you use in your design documentation and communication.
How to Use in IA
- Reference this study when discussing strategies for promoting ethical considerations within a design team or for end-users.
- Use the findings to justify the choice of framing or communication strategy in your design project.
Examiner Tips
- Demonstrate an understanding of how psychological factors influence user behaviour in design contexts.
- Show how you have considered motivational aspects in your design process.
Independent Variable: ["Message framing (problem vs. solution)","Speaker demographics (white male vs. black female)"]
Dependent Variable: ["Programmers' ability to detect bias"]
Controlled Variables: ["Individual differences in social dominance orientation-egalitarianism (SDO-E)"]
Strengths
- Large sample size of actual programmers.
- Empirical testing of a conceptual framework.
Critical Questions
- To what extent can these motivational appeals be generalized to other professional groups involved in design?
- What are the ethical implications of using 'problem' framing, and how can it be implemented without causing undue defensiveness or demotivation?
Extended Essay Application
- Investigate the impact of different communication strategies on user adoption of sustainable design features.
- Explore how framing influences user engagement with accessibility features in digital products.
Source
Persuading programmers to detect and mitigate bias in technology design: The role of motivational appeals and the speaker · 2023 · 10.31234/osf.io/jbxeq