Color Corpus: video controlled instrument

Color Corpus is an audio instrument controlled by camera input. Made for Claudia Schmitz.

In initial setup, overhead camera was placed over a turntable. On the turntable was a rotating paper that Claudia would make drawings on. This patch would track the motion of selected color areas and use that to create sounds. The sound engine can be supplied with samples that would be chopped in tiny bits. All those bits would be analyzed for various sound properties, for example dominant frequency and loudness. After the anayisis sound bits would be spread thruought the 2d space but sorted and clustered according to their characteristics, so for example all the noisy samples would be in one corner, high-frequency in antoher etc. That way the artist can play the instrument by placing the colored objects or drawings on the specific areas of the turntable that correspond to the type of sound they would like to hear.