Visualized Piano

Tuesday, August 7th, 2018 | Blog, Downloads

I bought a piano off craigslist for $800 that has MIDI out. I’ve been doing semi‐regular experiments to see what I can make with it. The first thing I had to do was dust the cobwebs off my playing ability. I’m still very rusty but improving bit by bit!

Comptine d‘un autre ete — l‘apres-midi



I’ve experimented with audio analysis and MIDI control of ISF (shader code) with VDMX. This is a demo for a training series that will be up at Vidvox. It will have figurative examples and downloads.



I’ve also had a friend bring over a Lightform and we projection mapped the piano and controlled the graphics via OSC protocol. Music is a little Phillip Glass.



Red Rubber Gloves

I’ve tried lots of experiments as far as capture and output is concerned. Here I’m live keying red rubber gloves with chroma key and using the image to drive a little some feedback. This is a poor man’s depth camera. I tried to a leap motion controller to try to pull out some 3D point data from my hands but it seems to be optimized only for hands in space with no obstructions.

… Stay tuned. I’m just beginning to explore possibilities.