The Interactive audio engine (IAE) is an embeddable synthesis engine in C++ for content based audio processing. The engine extracts audio descriptors from recorded audio materials and provides asynchronous/synchronous granular synthesis and additive synthesis. The IAE includes the following libraries:
- Mubu: container for audio, audio descriptor, and motion capture data
- ZsaZsa: overlap-add audio synthesis
- AddLib: additive synthesis
- PiPo: audio and motion data stream processing plugins
- RTAlib: audio analysis modules
- PsyAna: voice analysis.
Some of the functionalities of the IAE are implemented in the MuBu modules available in MaxMSP
REFERENCES
- N. Schnell, A. Röbel, D. Schwarz, G. Peeters, and R. Borghesi, “MuBu & Friends – Assembling Tools for Content Based Real-Time Interactive Audio Processing in Max/MSP,” in ICMC, Montreal, 2009. [Download PDF]