Metahuman-based digital textbooks achieve high user usability but require expert-driven refinement for error prevention and control.

Why It Matters

This research highlights the importance of balancing user experience with expert-level design principles. Even with intuitive interfaces, the robustness and reliability of digital learning tools can be significantly enhanced by incorporating expert feedback to address potential pitfalls.

Key Finding

Nursing students found the Metahuman digital textbook easy to use and visually appealing, but experts pointed out significant design flaws related to preventing user errors, maintaining consistency, and giving users control over their experience.

Key Findings

• Students rated the overall usability of the Metahuman-based digital textbook as high (mean uMARS score = 4.25/5), with positive feedback on layout and graphics.
• Expert heuristic evaluation identified critical issues in error prevention, consistency, and user control, resulting in a moderately positive rating (mean = 3.71/5).
• Qualitative feedback from both groups emphasized the need for automatic data saving, clearer navigation, improved source credibility, and enhanced interactivity.

Research Evidence

Aim: To evaluate the usability and identify areas for improvement in a Metahuman-based computer-based training digital textbook for nursing interventions through user testing and expert heuristic analysis.

Method: Mixed-methods (User Testing and Heuristic Evaluation)

Procedure: Undergraduate nursing students and nursing education experts used a Metahuman-based digital textbook featuring two clinical scenarios. Students completed the Mobile App Rating Scale (uMARS) for usability, while experts conducted a heuristic evaluation based on established usability principles. Qualitative feedback was also collected and analyzed.

Sample Size: 16 participants (12 students, 4 experts)

Context: Nursing education and digital learning tools

Design Principle

Usability is a multi-faceted construct that requires both end-user validation and expert critique to ensure a robust and effective design.

How to Apply

When designing interactive digital learning platforms, conduct both user testing with target audiences and heuristic evaluations with usability experts to identify a comprehensive set of design improvements.

Limitations

The study involved a small sample size, and the findings are specific to the evaluated nursing interventions and the particular Metahuman-based tool.

Student Guide (IB Design Technology)

Simple Explanation: Even if users think an app is easy to use, experts can find hidden problems with how it handles mistakes or lets users control things.

Why This Matters: This shows that just because something looks good and is easy to navigate doesn't mean it's perfectly designed. Expert feedback is crucial for making sure a design is reliable and robust.

Critical Thinking: How might the perceived 'ease of use' by novice users mask underlying design flaws that could lead to significant errors in a critical application like nursing education?

IA-Ready Paragraph: This research highlights the necessity of a multi-faceted evaluation approach, combining end-user feedback with expert heuristic analysis to ensure comprehensive usability. While student users reported high satisfaction with the intuitive layout and graphics of the Metahuman-integrated digital textbook, expert review identified critical areas for improvement in error prevention, consistency, and user control, underscoring the value of expert insights in refining digital learning tools.

Project Tips

• When testing your design, consider getting feedback from both potential users and someone with expertise in design principles.
• Think about how your design might lead users to make mistakes and how you can prevent or help them recover from those mistakes.

How to Use in IA

• Use this study to justify the need for both user testing and expert reviews in your own design project's evaluation phase.
• Cite this research when discussing how different evaluation methods can reveal different types of design issues.

Examiner Tips

• Ensure your evaluation methods are diverse, incorporating both subjective user feedback and objective expert analysis.
• Demonstrate an understanding of how different user groups (e.g., novices vs. experts) might perceive usability differently.

Independent Variable: Type of evaluation (user testing vs. heuristic evaluation), features of the Metahuman-based digital textbook.

Dependent Variable: Usability ratings (uMARS score), identification of usability issues, qualitative feedback themes.

Controlled Variables: The specific digital textbook content and scenarios used, the participant pool (nursing students and experts).

Strengths

• Employs a mixed-methods approach for a comprehensive evaluation.
• Utilizes established evaluation tools (uMARS, heuristic principles).

Critical Questions

• To what extent do the identified expert-identified issues (error prevention, consistency, control) impact the actual learning outcomes for nursing students?
• How could the interactivity of the Metahuman elements be leveraged to improve not just aesthetics but also user control and error prevention?

Extended Essay Application

• Investigate the usability of immersive technologies for training in other complex fields, such as surgery, aviation, or engineering, using similar mixed-methods evaluation.
• Explore the development of adaptive learning systems within immersive environments that dynamically adjust based on user interaction and potential error detection.

Source

Evaluating a Metahuman-Integrated Computer-Based Training Tool for Nursing Interventions: Usability and Expert Heuristic Analysis · Applied Sciences · 2025 · 10.3390/app152111650