Audio Synthesis with Augmented Reality (AuSynthAR) is a personal project implemented in Unity and using the AR framework Vuforia, focused on the creation of a digital instrument based on Augmented Reality (AR) inspired by the iconic Reactable and based on a previous project related to electrical circuits and AR (Virtual Circuits). AuSynthAR allows sound synthesis modules to create simple sound networks. It only requires a mobile device, a set of tokens, a sound output device and, optionally, a MIDI controller, which makes it an affordable instrument. An application running on the device generates the sounds and the graphical augmentations over the tokens.
The tokens are special components, like-knobs, to control parameters from modules, so that the device screen becomes just a visor that interprets what is happening with these physical components. It also includes 3D characters that move according to the sound interactions. The physical setup, application screenshot, and tokens, are presented in the next images, as well as a video that shows an improvised music performance.
Public Demo
Anyone who want to test AuSynthAR can download an .apk file for Android devices (versions >= 6.0) from here.