RAPID-API will facilitate the rapid development of and experimentation with machine learning in real-time domains such as music performance, health and gaming. It allows users to build interactive systems by demonstrating human actions and computer responses, rather than by programming. It offers a significant range of learning methods such as including neural networks, AdaBoost, support vector machines, k-nearest-neighbor, and decision trees, provided by Gesture Variation Follower and Wekinator.
HapticWave
The HapticWave is a haptic audio waveform display device that has been developed in collaboration with a group of audio engineers and producers with visual impairments for use in real world recording studio environments.
OpenSignals
OpenSignals is an easy-to-use, versatile and scalable software for real-time biosignals visualization, capable of direct interaction with an acquisition device, the BITalino.
Products
Resulting new and augmented products – based on multimodal devices, adaptive apps, wearables – will be validated in the context of major creative industries including video games, music technology, and broader industries of quantified self and e-Health. These prototypes will be evaluated by first units’ sales to business-to- business and business-to-consumer customers, market valuation and investment reports, market-replication and job creation.
Prototypes
Starting from Proofs of Concept technologies existing in our research labs, which will be validated in relevant environments presented by partner SMEs use cases, the new multimodal interfaces will be designed following both the needs of the end users and also tackling the market needs as expressed by the partner SMEs and also those envisioned by external market experts.
RAPID API
The RAPID-API toolkit (hardware & software) for product integration includes:
- Low cost, miniaturised hardware solutions for fast prototyping
- Interactive machine learning algorithms for motion recognition and classification
- Real-time machine learning and feature extraction for biosignal analysis
- Context-aware machine listening and computer vision techniques
- Physiological data sonification methods
- Haptic feedback interfaces
- Agile coding frameworks for mobile, multi-touch applications
- Online multimodal data storage and visualisation
- Social media platforms for collaborative music meta-tagging