The nn~ motion controller application

[RUUDIBOO]

Hey everyone,

I am just looking into all of this as a music producer, and after trying to wrap my mind around the possible applications of RAVE and also watching the linked YouTube video of the embedded RAVE - I have one question:

It seems to me that the main two applications here are processing/altering incoming audio and generating audio from latent space. Using the motion controller in that example, it seems to be possible to send some kind of values in real time to play RAVE like an instrument?

How is that possible? Does the motion controller simply trigger conventional samples that then get altered in real time by RAVE? Or does it trigger actual events in RAVE itself somehow? The whole drum example sounds so organic, and there are not only kick and snare sounds, but a whole soundscape in between those, and I would absolutely love to be able to create something similar after training some models on my own. Maybe someone here has some kind of an idea what is happening there and can point me in a general direction at least?

Any help would be immensely appreciated!!