The RAPID-MIX consortium accelerates the production of the next generation of Multimodal Interactive eXpressive (MIX) technologies by producing hardware and software tools and putting them in the hands of users and makers. We have devoted years of research to the design and evaluation of embodied, implicit and wearable human-computer interfaces and are bringing cutting edge knowledge from three leading European research labs to a consortium of five creative companies.
We draw upon techniques from user-centred design to put the end users of our tools and products at centre stage. Uniquely, the “users” in our project include both individuals and small companies, ranging from musicians to health professionals, hackers, programmers, game developers and more. We will share what we learn about bringing these varied users directly into the development process. We will also be developing methodologies for evaluating the success of our technologies in people’s lives and artistic practices, and share our experiences of these methods.
The RAPID-MIX API will be a comprehensive, easy to use toolkit that brings together different software elements necessary to integrate a whole range of novel sensor technologies into products, prototypes and performances. Users will have access to advanced machine learning algorithms that can transform masses of sensor data into expressive gestures that can be used for music or gaming. A powerful but lightweight audio library provides easy to use tools for complex sound synthesis.
We need fast product design cycles to reduce the gap between laboratory-based academic research and everyday artistic or commercial use of these technologies, and rapid prototyping is one way of achieving this. Our api tools are designed to help produce agile prototypes that can then feed back into how we tweak our API to make it as usable, accessible and useful as possible.
We anticipate that our technologies will be used in a variety of products, ranging from expressive new musical instruments to next generation game controllers, interactive mobile apps and quantified self tools. We want to provide a universal toolkit for plugging the wide ranging expressive potentials of human bodies directly into digital technologies.
RAPID-MIX is an Innovation Action funded by the European Commision (H2020-ICT-2014-1 Project ID 644862).