DEA-based sustainability indicator enhances university rankings by reducing subjective weighting

Why It Matters

This research provides a robust framework for evaluating and comparing institutions based on their commitment to sustainable development. By minimizing subjective biases in ranking methodologies, it offers a more reliable benchmark for stakeholders, including policymakers, educational institutions, and the public, to assess progress towards sustainability goals.

Key Finding

A novel ranking system using Data Envelopment Analysis (DEA) provides a more objective way to assess universities' sustainability performance by using flexible weights, leading to more reliable comparisons and insights into national progress on Sustainable Development Goals.

Key Findings

• DEA models with flexible weights offer improved discrimination power in university sustainability rankings.
• The DEA approach reduces the reliance on subjective weighting schemes common in traditional composite indicators.
• Rankings derived from DEA can reveal different institutional performance profiles concerning sustainability.
• The study established connections between national sustainability performance (SDGs) and university rankings within European countries.

Research Evidence

Aim: Can Data Envelopment Analysis (DEA) with flexible weights provide a more objective and discriminating method for ranking universities based on sustainability indicators compared to traditional composite indicator approaches?

Method: Quantitative research using Data Envelopment Analysis (DEA)

Procedure: The study applied a Benefit of the Doubt DEA model, followed by super-efficiency calculations and weight restrictions, to existing university sustainability data (UI-GreenMetric). The results were analyzed to compare rankings and identify implications for European universities and countries in relation to Sustainable Development Goals (SDGs).

Context: Higher education sector, sustainability assessment, university rankings

Design Principle

Objective evaluation through flexible data-driven weighting.

How to Apply

When designing a system to rank or compare organizations based on multiple performance criteria, explore DEA as an alternative to traditional weighted scoring to enhance objectivity and reveal performance frontiers.

Limitations

The effectiveness of DEA is sensitive to the selection of indicators and the dataset used. The 'super-efficiency' and 'weight restriction' models introduce further complexities that might require careful interpretation.

Student Guide (IB Design Technology)

Simple Explanation: This study shows that using a math technique called DEA can make university rankings about sustainability fairer and more accurate because it doesn't rely on people deciding how important each factor is.

Why This Matters: Understanding how to create objective and reliable ranking systems is crucial for evaluating design solutions, comparing product performance, or assessing the impact of different design strategies.

Critical Thinking: How might the principles of DEA be adapted to evaluate the sustainability of different product designs, rather than just institutions?

IA-Ready Paragraph: This research highlights the challenges of subjective weighting in composite indicator development, particularly for complex evaluations like sustainability. The study proposes Data Envelopment Analysis (DEA) as a robust alternative, employing flexible weights to enhance objectivity and discrimination power in university rankings. This approach offers a more reliable method for benchmarking and understanding institutional performance against sustainability goals, which is relevant for evaluating design solutions that aim for objective performance metrics.

Project Tips

• Clearly define the scope of sustainability indicators relevant to your design project.
• Consider using DEA if your project involves comparing multiple entities based on various performance metrics.

How to Use in IA

• Reference this study when discussing the limitations of subjective weighting in your design evaluation methods and proposing objective alternatives.

Examiner Tips

• Demonstrate an understanding of the limitations of subjective weighting in composite indicators and how alternative methods like DEA can address these.

Independent Variable: Weighting methodology (subjective vs. flexible DEA weights)

Dependent Variable: University sustainability ranking

Controlled Variables: Set of sustainability indicators, university data

Strengths

• Introduces a novel, more objective methodology for sustainability rankings.
• Provides practical insights for stakeholders in higher education and policy-making.

Critical Questions

• What are the ethical implications of using different ranking methodologies?
• How can the selection of indicators in DEA be made more transparent and less prone to manipulation?

Extended Essay Application

• An Extended Essay could investigate the application of DEA to rank the sustainability performance of different design approaches for a specific product category, using publicly available lifecycle assessment data.

Source

Ranking of European Universities by DEA-Based Sustainability Indicator · Journal on Efficiency and Responsibility in Education and Science · 2023 · 10.7160/eriesj.2023.160403