Tailored Evidence Summaries Enhance Health Professional Comprehension and Efficiency

Why It Matters

In time-sensitive professional environments, the effective delivery of critical information is paramount. Designing summaries that address user comprehension barriers, like jargon and complex data presentation, can lead to more informed and efficient decision-making.

Key Finding

Health professionals struggle to understand complex evidence summaries, but well-designed, tailored summaries like 'Summary of Findings Tables' significantly improve comprehension and speed up information retrieval.

Key Findings

• Users experienced comprehension issues with original systematic reviews, including misunderstanding document types and risk presentations, and confusion due to unfamiliar language.
• Including a Summary of Findings Table in a Cochrane Review improved user satisfaction and understanding of main results compared to reviews without a table.
• Key findings were identified more quickly in reviews that included a Summary of Findings Table.
• User feedback informed the development of tailored summary templates for specific user groups, such as policymakers in low and middle-income countries.

Research Evidence

Aim: How can the design of evidence summaries for systematic reviews be improved to enhance user comprehension, satisfaction, and efficiency for health professionals?

Method: Mixed-methods research, including user testing, iterative feedback, and comparative evaluation.

Procedure: The research involved observing health professionals' interaction with existing evidence platforms, gathering feedback on prototype summaries (Summary of Findings Tables and short summary templates), and conducting comparative trials to assess the impact of these tailored summaries on user satisfaction, understanding, and time to find key messages.

Context: Evidence-informed healthcare, specifically the use of systematic reviews by health professionals and policymakers.

Design Principle

Information clarity and contextual relevance are critical for effective knowledge transfer in professional settings.

How to Apply

When developing reports, dashboards, or any information-heavy product for professionals, conduct user research to identify comprehension barriers and design simplified, context-specific summaries.

Limitations

The studies involved small trials, and the generalizability of findings to all types of evidence or all professional groups may be limited.

Student Guide (IB Design Technology)

Simple Explanation: Making complicated health research easier to read and understand helps doctors and nurses make better decisions faster.

Why This Matters: This research shows that how you present information is just as important as the information itself, especially for busy professionals who need to make quick, informed decisions.

Critical Thinking: While tailored summaries improve comprehension, what are the potential risks of oversimplification, and how can designers ensure critical nuances of complex evidence are not lost?

IA-Ready Paragraph: This research highlights the critical role of user-centred design in improving the usability of complex information. By tailoring evidence summaries and addressing comprehension barriers, as demonstrated in studies on healthcare systematic reviews, designers can significantly enhance user understanding and efficiency. This principle is directly applicable to my design project, where simplifying [mention your project's complex information] through [mention your design solution, e.g., a dashboard, a summary report] aims to achieve similar improvements for its target users.

Project Tips

• When designing a product, think about who will use it and what information they *really* need.
• Test your designs with actual users to see if they understand them easily.

How to Use in IA

• Use this research to justify designing simplified summaries or dashboards for your own design project, explaining how it will improve user understanding and efficiency.

Examiner Tips

• Demonstrate an understanding of how user experience principles can be applied to the presentation of complex information, not just physical products.

Independent Variable: Format of evidence presentation (e.g., full review vs. summary table).

Dependent Variable: User satisfaction, user understanding of key messages, time taken to find key messages.

Controlled Variables: Type of systematic review, user profession, user experience with evidence synthesis.

Strengths

• Employs a user-centred approach with iterative design and testing.
• Uses a mixed-methods approach to gather both qualitative and quantitative data.

Critical Questions

• To what extent do the findings generalize beyond the healthcare domain?
• What are the long-term effects of using simplified summaries on users' ability to engage with original, complex sources?

Extended Essay Application

• Investigate the impact of different visualisations on the comprehension of complex data sets for a specific professional audience.

Source

Improving the user experience of evidence : a design approach to evidence-informed health care · BIBSYS Brage (BIBSYS (Norway)) · 2011