Oscilla visualizes the relationship between pure tones as the sum of oscillatory waveforms. “Discordances” in tones show up correspondingly as “messy”-looking waveforms.
"Oscilla is a site-specific interactive audio-visual installation that explores the oscillatory roots of sound and its visualization. The position and moement of people space (or that of objects a long a surface) generates sinusoidal sounds and controls their amplitude and frequency. The graphic representations of the relationship between frequency, phase, and amplitude of the generated sounds gives life to real-time animated "sound paintings". Participants can thus create morphing chords and harmonies, explore intervals and microtones and discover the connections between sound and image."
"Techniques in Swept Frequency Capacitive Sensing: An Open Source Approach."
MIT Media Lab member Xiao Xiao has created interactive work of exceeding elegance, simplicity, and expressiveness.
This isn’t the presentation that Hiroshi Ishii did at NIME2014, but it’s nearly identical. And equally impressive!
I stumbled on a comment made by a reader at FastCo:
ould someone build a version that has, instead of solid extrusions moving up and down, just a cube top for each pixel, so the cubes float in the air above the plane? combine the sam x-y grid layout with a second set of cubes that move down the negative “z” axis. (even below the virtual table top.) that allows floating shapes, rather than just the bas-relief shapes shown above. I’ve been trying to do that with physical sculptures for 20 years.
It’s an interesting idea! The problem is that you get issues with the stuff “above” the floaties: what does a user do in that space?
When I think back of that time, there was a very strong interplay between political-social activism and artistic exploration. Those two things were, in my mind anyway, were part of the same process. I didn’t think of them as at odds with each other.Bill Viola in the BBC documentary, The Eye of the Heart (someone’s posted the video online)