Quantifiable Human-Centredness: A Metric for Evaluating Design Process Quality
Category: User-Centred Design · Effect: Mixed findings · Year: 2023
A novel metric can provide an early, quantitative assessment of how effectively human-centred design principles have been integrated into product concepts.
Design Takeaway
Develop and apply metrics that quantify the integration of user needs and principles throughout the design process, even in its early stages, to ensure a more robustly human-centred outcome.
Why It Matters
This metric offers a way to benchmark and improve the application of human-centred design methodologies during the early stages of a design project. By providing a quantifiable score, design teams can identify areas where user considerations might be lacking and make targeted improvements before significant resources are committed.
Key Finding
While the study indicated that using human-centred design methods might lead to better outcomes, the results weren't strong enough to prove it statistically, possibly because the study was small and concepts were early-stage.
Key Findings
- Trends suggest that the application of specific human-centred design methods can positively influence the human-centredness score of product concepts.
- Statistical significance was not achieved, likely due to limitations in concept complexity, sample size, and the developmental stage of the concepts.
Research Evidence
Aim: How can the quality of human-centred design activities be assessed early in the design process by evaluating the resulting product concepts?
Method: Metric development and application
Procedure: A Human-Centredness Metric (HCM) was developed based on the four goals of human-centred design. This metric was then applied to evaluate 16 product concepts generated by students using different human-centred design methods, with scores recorded on a 4-point Likert scale.
Sample Size: 16 concepts
Context: Product design education and practice
Design Principle
Quantify user-centricity throughout the design lifecycle to ensure consistent and effective integration of user needs.
How to Apply
Create a checklist or scoring system based on core human-centred design principles (e.g., user research integration, empathy, usability considerations) and apply it to your design concepts at various milestones.
Limitations
The study's findings were limited by the small number of concepts evaluated, the complexity of the concepts themselves, and the early stage of their development, which may have obscured statistically significant results.
Student Guide (IB Design Technology)
Simple Explanation: This research created a way to score how 'human-centred' a design idea is, even early on. It found that using specific design methods might help, but more research is needed to be sure.
Why This Matters: It shows how you can measure the success of your user-centred design approach, which is important for demonstrating the value of your design decisions.
Critical Thinking: Given the limitations, how could the Human-Centredness Metric be refined to be more sensitive to the nuances of different design methods and product types?
IA-Ready Paragraph: The study by Sankowski and Krause (2023) highlights the challenge of quantifying the effectiveness of human-centred design activities. Their development of a 'Human-Centredness Metric' (HCM) suggests that even early in a design project, it is possible to assess the degree to which user-centric principles have been integrated into product concepts. While their initial application showed promising trends, they noted limitations such as small sample sizes and concept complexity, underscoring the need for robust evaluation frameworks in design practice.
Project Tips
- When evaluating your design process, consider creating your own metric to score how well you've incorporated user needs.
- Be aware that small sample sizes and early-stage concepts can make it hard to find clear results.
How to Use in IA
- Reference this study when discussing the importance of evaluating the effectiveness of your chosen design methodologies.
- Use the concept of a 'human-centredness metric' as inspiration for developing your own evaluation criteria for your design process.
Examiner Tips
- Look for evidence that students have considered how to evaluate the quality of their human-centred design process, not just the final product.
- Assess if students can articulate the limitations of their evaluation methods.
Independent Variable: Use of specific human-centred design methods
Dependent Variable: Human-Centredness Metric (HCM) score
Controlled Variables: Concept complexity, developmental stage of concepts, number of students involved
Strengths
- Introduces a novel metric for early assessment of human-centred design quality.
- Provides a framework for quantitative evaluation of design processes.
Critical Questions
- How can the HCM be validated across a wider range of design projects and industries?
- What are the most critical indicators of human-centredness that should be prioritized in such a metric?
Extended Essay Application
- Investigate the correlation between a quantitatively measured 'human-centredness' score and actual user satisfaction or usability test results for a developed product.
- Develop and pilot a refined version of the HCM for a specific design domain (e.g., software, physical products).
Source
The Human-Centredness Metric: Early Assessment of the Quality of Human-Centred Design Activities · Applied Sciences · 2023 · 10.3390/app132112090