A collaboration with Soroush Azari & Amirpasha Mobini Tehrani | @ NP3 RE:Search:Gallery | 2024
This VR project is a research initiative that explores the sensation of digitally touching one's internal organs and investigates the possible sensory experiences associated with this interaction. The project was exhibited as part of the Talent van Hier X ESNS ART 2024, a side project for the Eurosonic Festival.
I collaborated with two other artists to create sounds using neural network AI-generated throat sounds and worked alongside a game developer to develop the head-mounted Leap Motion device and hand tracking functionalities. This collaboration aimed to create an immersive and multisensory experience for users, blending visual, auditory, and tactile elements to deepen the understanding of digital interaction with the human body.
Video Description
The main experience is a one-on-one interaction where each participant sits on a stool while wearing a VR headset equipped with Leap Motion 2 for hand tracking. Participants see their own body in the virtual space within a framed area that acts like a mirror, showing a replica of themselves that mirrors their movements in real-time. When participants touch their virtual body, the data gathered from their hand movements and joint poses trigger sounds generated by a neural network inside Max/MSP, which they hear through headphones.
Below, I have included some renders and snapshots taken during the design process and the main experience.