Wearable Sensors on Gloves Enhance Expressive Musical Performance by Amplifying Corporeal Presence

Why It Matters

This research highlights how wearable technology, specifically in the form of sensor-laden gloves, can bridge the gap between physical movement and digital sound. For designers, this means opportunities to create interfaces that not only capture motion but also imbue performances with deeper emotional resonance and a stronger sense of the performer's physical being.

Key Finding

Sensor gloves used in electronic music performance can make performances more expressive and engaging by translating physical movements into sound, and these performances can reveal deeper insights into the performer's physical presence and emotional connection.

Key Findings

• Wearable sensing in gloves enables expressive musical performance styles through real-time digital sound production and transformation.
• These performances are rich in intersections of technical, cognitive, and cultural dimensions.
• Computational approaches to movement translation and analysis offer both limitations and opportunities.
• The performances act as potent amplifiers for investigating corporeal presence and affective engagement.

Research Evidence

Aim: How can wearable sensor technology integrated into gloves be leveraged to enhance gestural electronic music performance by amplifying corporeal presence and affective engagement?

Method: Qualitative research, case study analysis, and reflective practice.

Procedure: The study investigated the origins and development of gesture-based musical performance using on-body sensing, focusing on sensor gloves. It analyzed a specific use case, considering technical, cognitive, and cultural dimensions to reflect on the value, limitations, and opportunities of computational approaches to movement translation and analysis in performance.

Context: Gestural electronic music performance and wearable technology interfaces.

Design Principle

Amplify embodied expression through intuitive and responsive human-computer interfaces.

How to Apply

When designing wearable devices for creative expression, prioritize the seamless translation of subtle physical movements into rich, responsive digital feedback that enhances the user's sense of presence and emotional connection.

Limitations

The study is focused on a specific domain (electronic music performance) and may not generalize to all wearable sensing applications. The subjective nature of 'affective engagement' can be challenging to quantify.

Student Guide (IB Design Technology)

Simple Explanation: Putting sensors on gloves for music can make performances feel more real and emotional because the music responds directly to how the musician moves their hands.

Why This Matters: This research shows how technology can be used to make creative performances more expressive and engaging by connecting physical actions to digital outcomes, which is relevant for many design projects involving interaction and performance.

Critical Thinking: To what extent does the 'amplification' of corporeal presence through technology risk overshadowing the performer's genuine emotional intent, potentially leading to a more performative than authentic expression?

IA-Ready Paragraph: The integration of wearable sensor technology into performance tools, such as gloves for electronic music, has been shown to amplify corporeal presence and affective engagement by enabling nuanced gestural translation into sonic output (Schacher, 2022). This suggests that design interventions focusing on the direct mapping of physical movement to digital feedback can lead to richer and more expressive user experiences.

Project Tips

• Consider how the physical form of a wearable device impacts the user's ability to perform natural movements.
• Explore how different sensor types can capture various aspects of gesture (e.g., speed, pressure, orientation).

How to Use in IA

• Reference this study when discussing how wearable technology can enhance user experience in interactive systems, particularly those involving physical expression or performance.

Examiner Tips

• Demonstrate an understanding of how the physical design of a wearable impacts its functional and expressive capabilities.

Independent Variable: Integration of sensors into performance gloves.

Dependent Variable: Expressiveness of musical performance, corporeal presence, affective engagement.

Controlled Variables: Type of music, performer's skill level, specific gestures being mapped, sound synthesis parameters.

Strengths

• Provides a rich qualitative exploration of a specific application of wearable technology.
• Connects technical design aspects to cognitive and cultural implications in performance.

Critical Questions

• How can the design of wearable interfaces be optimized to capture a wider range of subtle human gestures beyond simple motion?
• What are the ethical considerations when using technology to 'amplify' or potentially manipulate a performer's affective engagement with an audience?

Extended Essay Application

• Investigate the potential for wearable sensors in other performance arts (e.g., dance, theatre) to enhance audience connection and performer expression.
• Design and prototype a wearable interface for a specific artistic discipline, focusing on capturing and translating unique gestural languages.

Source

Capture and express, question and understand: Gloves in gestural electronic music performance · Wearable Technologies · 2022 · 10.1017/wtc.2022.3