Real-time Sound-driven Imaging

Visualizing sound has interested and influenced artists and composers for centuries. (In cases of synesthesia, certain individuals even associate particular colors and sounds.)

I began this effort after discussions with the music trio Neoteric about providing visual accompaniment to some of their performances. The challenge in designing such work is that a tight, literal visual interpretation of the music can become predictable. Sufficient variation and detail must be introduced into the code to create images just as interesting to watch as the music is to hear.

This is a real-time screen-recording of the first phase of my research. My next step with Neoteric would be to individually mike the three instruments, so that each musician's performance can be separately interpreted before visually mixing it with the others.

"Evening Escapade" by Bernard Hoffer. Performed by Neoteric