Research labs are peculiar phenomena consisting of a defined research programme, technical infrastructure and social context — all crucial for generating, preserving, and disseminating new knowledge. A lab functions as an ecosystem in which we think and develop ideas, but this requires a productive technical and social platform. This paper presents the Organium, a system for improvisatory design thinking in the domain of musical instruments and the experimental humanities in general. The Organium is a dynamic library of technical elements, spatially arranged for rapid prototyping and systemic experimentation, serving as a central hub of our Intelligent Instruments Lab. Furthermore, the paper discusses the lab culture and research methodology for which the Organium was designed, framing the lab as an experimental ecosystem where technological assemblages act as boundary objects for transdisciplinary collaboration and discourse. We outline how the Organium supports our research methodology and present selected projects that demonstrate its functionality and impact.
We report on the initial design steps of an audio-visual installation to be set up in a hospital guest house for children and their caregivers. The goal of the project is twofold: on one hand we aim to design a playful experience which can support children physical activity and their communication skills. On the other, we intend to develop an automated tool to assess a few basic qualities of child-caregiver interaction by interpreting users’ upper-body motion. We focus on the early stages of the project, situating it in the context of a collaboration between two institutions: an HCI lab and a paediatric hospital. We describe our efforts for the identification of a suitable dyadic activity to be first analysed using motion capture techniques and later augmented with audio-visual feedback. We also outline the strategies identified for the evaluation of the automated measurements of embodied child-caregiver interactions. Finally, we present two basic prototypes developed to stimulate a hands-on debate within our research team on the project’s design challenges and outcomes.
Stacco is a novel Digital Musical Instrument (DMI) with embedded magnets and sensors. It attracts and repels magnetic spheres and detects the changes in its magnetic fields upon interaction. It is designed to perform with neural audio synthesis models such as RAVE, in which sound features are represented and distributed within entangled multidimensional sonic spaces. Stacco allows drawing and embedding scores into the interface itself, and by bridging gesture and notation, it overcomes some of the inherent limitations of traditional notational methods as applied to neural synthesis. Our demo will provide the opportunity to try the instrument first hand. Moreover, we will invite participants to compose musical sketches for neural synthesis models, by drawing, embedding and layering tracing paper sheets on top of Stacco’s surface.