Inclusive musical instruments benefit from incorporating wearable interfaces into digital musical instrument design, creating opportunities for bodily felt experiences and movement-based interactions. In this article, we discuss the evolution of our inclusive design approach behind the design and performance practices of three wearable musical instruments. By focusing on the embodied, somatic, and tacit dimensions of movement-based musical interaction, we evaluate these case studies, combining the third and first-person perspectives. The design and implementation of the wearable sensing, utilizing the additive manufacturing techniques, are discussed for each instrument and its performer in specific cases of musical expression. This article further discusses how our approach integrates music performance as a crucial step into design and evaluation, utilizing these performance practices and such collaborative settings for improved diversity and inclusion. Finally, we examine how our design approach evolves from user-centered design to more participatory practices, offering people with diverse abilities a shared music performance space.
This article presents design and performance practices for movement-based digital musical instruments. We develop the notion of borrowed gestures, which is a gesture-first approach that composes a gestural vocabulary of nonmusical body movements combined with nuanced instrumental gestures. These practices explore new affordances for physical interaction by transferring the expressive qualities and communicative aspects of body movements; these body movements and their qualities are borrowed from nonmusical domains. By merging musical and nonmusical domains through movement interaction, borrowed gestures offer shared performance spaces and cross-disciplinary practices.Our approach centers on use of the body and the design with body movement when developing digital musical instruments. The performer's body becomes an intermediate medium, physically connecting and uniting the performer and the instrument. This approach creates new ways of conceptualizing and designing movement-based musical interaction: (1) offering a design framework that transforms a broader range of expressive gestures (including nonmusical gestures) into sonic and musical interactions, and (2) creating a new dynamic between performer and instrument that reframes nonmusical gestures—such as dance movements or sign language gestures—into musical contexts. We aesthetically evaluate our design framework and performance practices based on three case studies: Bodyharp, Armtop, and Felt Sound. As part of this evaluation, we also present a set of design principles as a way of thinking about designing movement-based digital musical instruments.
This article describes the design, implementation, and evaluation of vibrotactile concert furniture, aiming to improve the live music experience of people with hearing loss using hearing technology such as cochlear implants (CI). The system was the result of a series of participatory design sessions involving CI users with different hearing assistive setups (bi-implant, bimodal, and monoimplant), and it was evaluated in a concert scenario (drums, bass, and female vocals) at the Royal Danish Academy of Music. The project aimed to improve the music appreciation for CI users by providing a multisensory concert designed with CI challenges in mind, but not excluding normal-hearing individuals or individuals with other forms of hearing aids from participating in the event. The evaluation was based on (video-recorded) observations and postexperience semistructured interviews; the data were analyzed using event analysis and meaning condensation. The results indicate that tactile augmentation provides a pleasant experience for CI users. However, concertgoers with residual hearing reported being overwhelmed if the tactile stimulation amplitude exceeds a certain threshold. Furthermore, devices that highlight instrument segregation are preferred over ones that present a tactile mixdown of multiple auditory streams.
Over the past two decades, the music information retrieval (MIR) community has grown significantly in both the volume and diversity of research contributions. However, questions remain about who is represented within the community—and who is not. The influence of Western views shapes MIR research, affecting author representation, topic selection, cross-cultural considerations, and reproducibility. While discussions on the impact of Western centricity have gained traction in adjacent fields, there remains a need to critically assess its presence and limitations within MIR. This study analyzes the corpus of 2,458 ISMIR conference papers published from 2000–2024 to examine the geographic and institutional distribution of authors. Our findings indicate that International Society for Music Information Retrieval research remains Western-centric, with disproportionate representation from the Global North yet with increasing cross-institutional collaborations. We provide design suggestions to support a more geographically diverse authorship. In support of our findings and to facilitate future research, we release the aggregated data as an open dataset, ISMIR25Meta, along with a topic-based visualizer, ISMIR25Viz.
The increasing number of haptic interfaces for musical applications offers opportunities to create new auditory-tactile mappings. However, the innate, bodily correspondences between music and vibrotactile stimuli remain unexplored and a challenge to articulate. In this paper, we investigate how new mappings can be created based on the somatic, felt experiences from vibrotactile devices. We utilize an embedded HCI method to collect, articulate, and document such bodily experiences through body maps. Through an exploratory workshop with mixed-background participants and a focus group analysis, the participants reported their bodily experiences using two categories of haptic devices on the body maps and ideated new mappings through co-design. Based on the results of these sessions, we report three annotated auditory-tactile mapping schemes, each of which offers different strategies. The themes that emerged in the workshop interactions help us examine implicit associations of auditory-tactile stimuli on bodily sensations and how body maps can be used to articulate these sensations while offering an opportunity to generate new ones.