A sound exists not only when it is heard, but in its role as one small part of a whole, defining the trajectory of a phrase and passing momentum onwards. With the speed and complexity of a typical song, it is difficult to appreciate the impact of every single note. The motivation behind the audio visualization was to make the reverberations of every sound a bit more tangible.
Every key on the piano is tied to a certain medium like a ripped up piece of paper, a sticker, or a piece of tissue and by pressing on a key the image is placed randomly on the screen. Each image exists for 10 seconds and then disappears, creating an evolving collage of the last 10 seconds of the song. The arbitrary lifespan assigned to the images enables every sound and its impact to be visible.
Every note (C D E F G A B C, sharp/flat) has its own color/type. For example, all C keys are tied to green images. However, each C key triggers a slightly different green image - green origami, green paper, or a ripped photo of trees. The same logic is applied to all notes - A is purple, G sharp/A flat is sheet music and receipts, giving every key signature/scale its own color scheme.
Made in Isadora using MIDI output from a piano.