MAR educational tools lack rigorous evaluation, hindering effective design.
Category: User-Centred Design · Effect: Moderate effect · Year: 2019
The current development and evaluation of Mobile Augmented Reality (MAR) educational tools often lack scientific rigor, leading to inconsistent quality and uncertain benefits.
Design Takeaway
Incorporate rigorous, evidence-based evaluation into the design process for MAR educational tools, moving beyond developer intuition to user-validated outcomes.
Why It Matters
For designers creating educational technologies, this highlights a critical gap. Without robust evaluation methods, it's difficult to ascertain user experience, learning effectiveness, and true value, making it challenging to iterate and improve designs based on solid evidence.
Key Finding
The review found that the creation of MAR educational tools is often driven by developer expertise, and their effectiveness is rarely assessed using scientifically sound methods, making it hard to trust the results.
Key Findings
- Technical requirements for MAR development are often based on the expertise of the development team rather than user needs or pedagogical goals.
- Most evaluations of MAR educational approaches lack appropriate scientific rigor in their research design.
Research Evidence
Aim: What are the current trends and challenges in the development and evaluation of Mobile Augmented Reality (MAR) applications for educational purposes?
Method: Systematic Literature Review
Procedure: A systematic review of 57 academic articles was conducted to analyze the application, development, and evaluation of MAR in educational contexts.
Sample Size: 57 articles
Context: Educational Technology
Design Principle
Educational technology design and evaluation must be grounded in empirical evidence and user-centered methodologies to ensure efficacy and continuous improvement.
How to Apply
When designing or evaluating MAR educational tools, establish clear, measurable learning objectives and employ robust research designs (e.g., controlled trials) for assessment.
Limitations
The review's findings are limited by the quality and scope of the existing literature on MAR in education.
Student Guide (IB Design Technology)
Simple Explanation: Many educational apps using augmented reality aren't tested properly, so we don't really know if they work well or how to make them better.
Why This Matters: This research shows that just creating a cool AR experience isn't enough; you need to prove it helps people learn and do it in a way that others can trust.
Critical Thinking: Given the lack of rigorous evaluation, how can designers of MAR educational tools proactively build in mechanisms for objective assessment of learning outcomes and user experience?
IA-Ready Paragraph: The systematic review by Herpich et al. (2019) highlights a critical gap in the development and evaluation of Mobile Augmented Reality (MAR) educational tools, noting that technical development often relies on developer expertise and that evaluations frequently lack scientific rigor. This underscores the importance of incorporating robust, user-centered evaluation methodologies into design projects to ensure the efficacy and continuous improvement of educational technologies.
Project Tips
- When designing your MAR project, think about how you will measure its success beyond just 'it works'.
- Look for existing research on how to evaluate educational technology effectively.
How to Use in IA
- Reference this study to justify the need for rigorous testing and evaluation in your own design project, especially if you are developing an educational tool.
Examiner Tips
- Ensure your evaluation methodology is clearly defined and scientifically sound, not just based on personal opinion or informal feedback.
Independent Variable: Development approach (e.g., developer expertise-driven vs. user-need-driven)
Dependent Variable: Quality and benefits of MAR educational approaches (as measured by evaluation rigor and reported outcomes)
Controlled Variables: Knowledge areas where MAR is applied, types of MAR approaches used
Strengths
- Provides a broad overview of the state-of-the-art in MAR for education.
- Identifies specific weaknesses in current evaluation practices.
Critical Questions
- What specific evaluation frameworks could be adapted or developed for MAR educational tools?
- How can the technical development process be better aligned with pedagogical goals and user needs?
Extended Essay Application
- An Extended Essay could investigate the development and rigorous evaluation of a novel MAR application for a specific educational subject, comparing its effectiveness against traditional methods.
Source
How Mobile Augmented Reality Is Applied in Education? A Systematic Literature Review · Creative Education · 2019 · 10.4236/ce.2019.107115