Outside-Interactions
UKRI Future Leaders Fellowship
Read the audio description
The film begins with a UWE ident before cutting to Tom Mitchell, a white man in his forties, with grey hair, wearing a blue shirt. Tom is in a lab called the Centre for Print Research and in the background printing equipment and robot arms can be seen. Throughout the film footage cuts between Tom in the lab to footage of Tom working with a dancer wearing MiMU Gloves which are being used for music performance. The footage also cuts to a variety of music software interfaces and a number of music performances using gestural technology as well as synthesisers and keyboards. During the Outside Interactions description, slides that show hand drawn illustrations of several gestural musical instruments and tactile musical instruments are shown, and a finger pressing a button on a music interface where technology inside the instrument disappears before devices on the hand appear.
The x-io Technologies section shows a wheelchair tennis athlete in the background with plots showing their real-time motion data in the foreground. The Watershed section shows footage of the Bristol harbourside and the front of the Watershed. The Drake Music and B&As music school footage shows their respective websites.
For the description of UWE the film cuts to drone footage of the Frenchay Campus and then some architectural drawings and 3D imagery of the Bridge showing a mixture of robotics, prototyping and immersive arts technology.
The Outside Interactions project is supported by a UKRI Future Leaders Fellowship and will explore a novel approach to human computer interaction along with new methods for co-designing digital musical instruments (DMIs) with non-technical and physically impaired musicians.
The project takes a disruptive and inclusive approach that will reshape the fundamental practice of DMI design, inviting broader participation in the development of new musical instruments and future visions of musicianship.
Motion capture and gestural interaction technologies have shifted the locus of interaction away from physical objects and onto the body, realising human movement as the interface for performing music. The development of musical objects and gestural music interaction are often considered and pursued separately. By focusing on musical objects, instrument development is often framed as a technical challenge assuming normative players and overlooking the diversity of musicians, audiences, and their environments. Gestural music interaction has shown great potential for music performance and accessibility; however, it neglects the significant role of tactile feedback in music training and the development of virtuosic performance.
The Outside Interactions project will take a holistic approach, coupling gestural interaction and physical prototyping, departing from the conventional practice of embedding sensing technologies within an instrument and relocating the technology onto the body, sensing player interactions using wearable devices on the wrist and hand. A radical switch in both technical and design approach that opens innovative new research directions for low-cost, rapidly produced musical instruments, which can be designed to have any shape, scale or structure. Crucially, this provides new ways for people to participate in the rapid co-design of novel, customised musical instruments that are tailored to their unique artistic identity and access requirements.