AI Assistance May Hinder, Not Help, Long-Term Student Self-Regulation
Category: User-Centred Design · Effect: Moderate effect · Year: 2023
Over-reliance on AI tools for learning can diminish a student's ability to self-regulate and learn independently, suggesting a need for careful integration of AI in educational design.
Design Takeaway
When designing AI-driven educational tools, prioritize features that encourage active learning and skill transfer, rather than simply providing solutions or prompts that bypass the learning process.
Why It Matters
As AI tools become more prevalent in educational settings, understanding their impact on user agency is crucial. This research highlights a potential pitfall where AI, intended to support learning, might inadvertently create dependency, hindering the development of essential self-regulation skills.
Key Finding
The study found that students became dependent on AI for learning tasks and did not develop independent self-regulation skills. While self-monitoring tools could help when AI was removed, they were less effective than AI, and combining them didn't improve outcomes beyond AI alone.
Key Findings
- Students tended to rely on AI assistance rather than learn from it.
- Removing AI assistance led to a decrease in performance, though self-regulated strategies could partially mitigate this.
- Hybrid approaches combining AI and self-regulation strategies were not more effective than AI alone.
Research Evidence
Aim: To investigate the impact of AI assistance on student agency and self-regulated learning behaviours, particularly when AI support is removed.
Method: Randomised Controlled Experiment
Procedure: An experiment was conducted with students over two four-week periods. During the initial phase, all students received AI-guided assistance for peer feedback. In the subsequent phase, students were divided into four groups: control (continued AI prompts), no prompts (AI removed), self-monitoring checklists, and a hybrid group with both AI and self-monitoring checklists.
Sample Size: 1625 participants
Context: Educational technology, specifically AI-assisted peer feedback in academic courses.
Design Principle
Design AI educational tools to scaffold learning and promote independent agency, not to create dependency.
How to Apply
When developing or implementing AI in educational platforms, include features that prompt reflection, encourage critical thinking, and gradually reduce AI support to foster independent learning.
Limitations
The study focused on a specific type of AI assistance (peer feedback) and may not generalize to all AI educational applications. The long-term effects of AI removal were not assessed.
Student Guide (IB Design Technology)
Simple Explanation: Using AI tools for schoolwork might make you good at using the AI, but it might not help you learn the actual subject or how to study on your own. If the AI is taken away, you might struggle.
Why This Matters: This research is important for design projects involving AI because it shows that simply adding AI might not lead to better learning outcomes if users become too reliant on it.
Critical Thinking: To what extent should AI be used to automate tasks in educational settings, and what are the ethical considerations regarding user autonomy and skill development?
IA-Ready Paragraph: Research by Darvishi et al. (2023) indicates that AI assistance in educational contexts can lead to user dependency, potentially hindering the development of self-regulated learning skills. Their study found that students tended to rely on AI prompts rather than internalizing the learning processes, suggesting that the design of AI-driven educational tools must carefully balance support with the promotion of user agency and independent skill acquisition.
Project Tips
- Consider how your design might create user dependency.
- Explore ways to build user skills that transfer beyond the use of your specific design.
How to Use in IA
- Reference this study when discussing the potential negative impacts of AI on user autonomy and skill development in your design project.
Examiner Tips
- Evaluate whether the design considers the long-term development of user skills beyond the immediate assistance provided by AI.
Independent Variable: Type of assistance provided (AI prompts, no prompts, self-monitoring checklists, hybrid).
Dependent Variable: Student agency, self-regulated learning behaviours, performance on tasks.
Controlled Variables: Course, duration of AI assistance, nature of peer feedback task.
Strengths
- Large sample size across multiple courses.
- Randomised controlled experimental design.
Critical Questions
- How can AI be designed to actively promote learning and skill development rather than just task completion?
- What are the ethical implications of AI potentially reducing human agency in learning?
Extended Essay Application
- Investigate the impact of AI-driven feedback on user creativity and problem-solving skills in a specific design domain.
Source
Impact of AI assistance on student agency · Computers & Education · 2023 · 10.1016/j.compedu.2023.104967