Overview

In this project, I wanted to use gesture to control the quality of sound and produce a visual sound map as trails. Using handtrack.js and p5.sound libraries, I connected hand coordinates to ADSR and sound waves to produce sound, using x-axis as pitch and y-axis as echo. I aimed at exploring the qualities of gesture and the use of body as an instrument, as well as how the expressive and poetic quality of sound can be related back to something natural as human motion.

Time

Apr 2020

Project Type

Creative Coding, Web Design

Tools

p5.js, HTML/CSS/JavaScript, handtrack.js, p5.sound