That Which Pulls


short film

In his book "Digital Harmony," John Whitney describes his technique of "differential motion," an approach to animation derived from musical theories of harmonic structure. Studying his techniques has led me to apply these methods to sonic and visual content as a method of generating integrated audiovisual works. While Whitney's pieces generate gestalt formations by positioning visual elements along similar paths at harmonically related rates, That Which Pulls resynthesizes sounds and images by using differential motion to shuffle their data. Within this piece I apply this process to the pixels of a single image and the samples of a single note to generate the audiovisual material.

The manipulated image takes on gestural qualities that are functionally similar to Whitney's animated elements: the pixels arrange and rearrange themselves, alternately descending into chaos and resurfacing in a new order. An unexpected side effect was the Moiré patterns that emerge as the pixels realign near the different nodes, emphasizing the resolution. Within the audio, the single note quickly becomes multiple notes as the samples realign near the nodes, with complex syncopated rhythms appearing in the later iterations. These two streams of raw material were cut up, layered, and recombined to create a piece that explores the dynamic interplay between the emergent auditory and visual gestures, focusing on the counterpoint between their patterns of chaos and resolution.