Digital mental health interventions require high user engagement for efficacy

Why It Matters

This highlights a critical challenge in the design of digital health solutions. Simply providing a tool is insufficient; the design must actively foster sustained user interaction and adherence to achieve desired outcomes. Designers need to consider motivational strategies and user experience to ensure the technology is not only functional but also engaging.

Key Finding

While the app didn't significantly reduce depression symptoms compared to the control, higher engagement with the app was linked to better outcomes, suggesting engagement is key to effectiveness.

Key Findings

• No statistically significant difference in depression symptoms between the intervention group (Motherly app) and the active control group at post-treatment.
• The intervention showed a statistically significant effect on some secondary outcomes.
• Exploratory analyses suggested a dose-response relationship between engagement with the Motherly app and treatment outcomes.

Research Evidence

Aim: To evaluate the efficacy of a standalone CBT-based smartphone app in reducing symptoms of postpartum depression and explore the relationship between app engagement and treatment response.

Method: Randomized Controlled Trial (RCT)

Procedure: Women with symptoms of postpartum depression were randomized into two groups: one receiving a CBT-based smartphone app (Motherly) and an active control group receiving a different app (COMVC). Symptoms of depression, anxiety, parental stress, sleep quality, and behavioral activation were measured at post-treatment and at a 1-month follow-up. App engagement was also analyzed in relation to treatment outcomes.

Sample Size: 215 participants provided primary outcome data

Context: Digital mental health interventions, postpartum depression treatment

Design Principle

Digital interventions should be designed with a strong focus on user engagement strategies to maximize their therapeutic potential.

How to Apply

When designing digital health or wellness applications, integrate gamification, personalized feedback, progress tracking, and community features to boost user engagement and adherence.

Limitations

The study did not find significant differences in primary outcomes, and the negative findings might be associated with insufficient app engagement. The readiness of standalone app interventions for clinical practice is questioned.

Student Guide (IB Design Technology)

Simple Explanation: Just giving someone an app to help with depression isn't enough. They have to actually use it a lot for it to work, and this study showed that people didn't use this particular app enough to make a big difference.

Why This Matters: This research shows that for digital products, especially those aimed at health and well-being, user engagement is as important as the core functionality. A poorly engaging design can render even a well-intentioned product ineffective.

Critical Thinking: If engagement is the key, what specific design elements are most effective in driving engagement for different user groups and types of digital products?

IA-Ready Paragraph: The efficacy of digital interventions is heavily reliant on sustained user engagement, as demonstrated by research indicating that standalone apps may fail to achieve desired outcomes if users do not interact with them sufficiently. This underscores the need for designers to prioritize features that foster adherence and active participation in digital product development.

Project Tips

• Consider how your design will encourage users to return to it regularly.
• Think about what makes an app 'sticky' – what keeps people coming back?

How to Use in IA

• Reference this study when discussing the importance of user engagement in digital design projects, particularly if your project involves an app or digital platform.
• Use it to justify the inclusion of specific features designed to increase user interaction and adherence.

Examiner Tips

• Demonstrate an understanding of how user engagement impacts the success of digital products.
• Justify design choices by explaining how they aim to increase user interaction and adherence.

Independent Variable: Use of the Motherly app vs. use of the COMVC app

Dependent Variable: Symptoms of depression (EPDS scores), anxiety symptoms, parental stress, quality of sleep, behavioral activation, clinical improvement

Controlled Variables: Age of participants, symptoms of postpartum depression, randomization process

Strengths

• Randomized controlled trial design provides a strong basis for causal inference.
• Inclusion of secondary outcomes and follow-up measures offers a comprehensive view of the intervention's impact.

Critical Questions

• What specific features of the COMVC app contributed to it being an 'active control' and how might these have influenced the results?
• How can app developers better predict or encourage 'sufficient' engagement for therapeutic benefit?

Extended Essay Application

• Investigate the psychological principles behind user engagement and apply them to the design of a digital product aimed at behavior change.
• Conduct a comparative analysis of engagement features in successful and unsuccessful digital health applications.

Source

Efficacy of a standalone smartphone application to treat postnatal depression: a randomized controlled trial · 2023 · 10.31219/osf.io/48nrh