Transdisciplinary Research Quality Framework Enhances Stakeholder Relevance and Problem-Solving Effectiveness

Why It Matters

In design practice, projects often involve diverse stakeholders and aim for tangible impact. Understanding how to assess the quality of research that bridges academic knowledge with practical application is crucial for ensuring that design solutions are not only technically sound but also socially significant and effective.

Key Finding

The quality of research that spans multiple disciplines and engages with external stakeholders should be judged not only on its scientific rigor but also on its relevance to societal needs, its ability to integrate diverse knowledge, its legitimacy in representing all stakeholders, and its actual or potential effectiveness in solving problems.

Key Findings

• Traditional academic criteria for research quality are insufficient for transdisciplinary research.
• Four main principles for TDR quality are: relevance (social significance, applicability), credibility (integration, reflexivity, rigor), legitimacy (inclusion, fair representation), and effectiveness (problem-solving contributions, social change).

Research Evidence

Aim: What are appropriate principles and criteria for defining and assessing transdisciplinary research quality?

Method: Systematic Review and Framework Development

Procedure: A systematic review of literature was conducted to identify arguments for expanding research quality definitions, purposes of evaluation, proposed principles, criteria, indicators, measures, and processes for assessing transdisciplinary research. This information was synthesized with practical experience to develop a prototype quality assessment framework presented as an evaluation rubric.

Context: Transdisciplinary Research (TDR) contexts, aiming to bridge knowledge generation with real-world problem-solving.

Design Principle

Research quality in applied design contexts is a multi-faceted construct encompassing scientific rigor, stakeholder relevance, knowledge integration, and demonstrable problem-solving effectiveness.

How to Apply

When planning a design research project, develop an evaluation rubric based on the four principles (relevance, credibility, legitimacy, effectiveness) to guide the research process and assess its success beyond traditional academic metrics.

Limitations

The framework is a prototype and may require further refinement and validation across diverse transdisciplinary research settings. The specific indicators and measures for each criterion may need adaptation to different project contexts.

Student Guide (IB Design Technology)

Simple Explanation: To judge if research is good when it mixes different subjects and involves people from outside academia, we need to look at more than just how scientifically correct it is. We also need to see if it's useful for society, if it brings different ideas together well, if it's fair to everyone involved, and if it actually helps solve problems.

Why This Matters: This research helps you understand that the success of a design project isn't just about making something that works technically, but also about making something that is relevant, fair, and truly solves a problem for the people and contexts it's intended for.

Critical Thinking: How might the emphasis on 'effectiveness' and 'social change' in TDR potentially conflict with the pursuit of pure scientific knowledge or aesthetic innovation in design?

IA-Ready Paragraph: The evaluation of this design research project draws upon principles of transdisciplinary research quality, recognizing that effective solutions require more than just technical merit. Criteria such as relevance to stakeholder needs, credibility through integrated knowledge, legitimacy in representing diverse interests, and demonstrable effectiveness in problem-solving were considered to ensure a holistic assessment of the project's success and impact.

Project Tips

• When defining the scope of your design project, consider who the stakeholders are and how their input will be integrated.
• Plan how you will measure the 'effectiveness' of your design solution beyond just user satisfaction, considering its real-world impact.

How to Use in IA

• Reference this framework when discussing the criteria you used to evaluate the success or quality of your design research, especially if it involved interdisciplinary collaboration or significant stakeholder input.

Examiner Tips

• Look for evidence that the student has considered the broader impact and stakeholder engagement of their design project, not just its technical feasibility.

Independent Variable: ["Principles of TDR quality (relevance, credibility, legitimacy, effectiveness)"]

Dependent Variable: ["Assessment of TDR quality"]

Controlled Variables: ["Traditional academic research quality criteria"]

Strengths

• Provides a structured framework for evaluating complex, multi-stakeholder research.
• Integrates both academic rigor and real-world impact into quality assessment.

Critical Questions

• How can the 'effectiveness' of a design solution be reliably measured, especially for long-term or systemic impacts?
• What are the practical challenges in ensuring 'legitimacy' and 'fair representation' when dealing with highly diverse or conflicting stakeholder interests?

Extended Essay Application

• An Extended Essay could investigate the application of this TDR quality framework to a specific design field (e.g., sustainable urban design, inclusive technology) to explore how different design disciplines might prioritize and operationalize these principles.

Source

Defining and assessing research quality in a transdisciplinary context · Research Evaluation · 2015 · 10.1093/reseval/rvv025