Latest

Sausage Making 2012

Today, I made a project that combines my repeaters with the wonderful New York Times Campaign Finance API. Called Sausage Making 2012, it visualizes the total campaign contributions of Barack Obama and Mitt Romney as the speed at which meat is ground— evoking the famous quote, “Laws, like sausages, cease to inspire respect in proportion as we know how they are made,” often falsely attributed to Otto von Bismarck, but likely first written by the American poet John Godfrey Saxe.

I created this as a study in how user interfaces can employ practices that deepen their complexity and increase their aesthetic appeal over time, which I call “digital patination.” As the data updates each time the page is loaded, the project will evolve as the Times updates their data (which should be on a monthly basis, although you can see they’re currently a bit behind). This means that as we near the election in November, both images will continuously speed up and the relation between the two will change in response to events such as the Republican National Convention. As an added bonus, the Times provides blurbs to contextualize the data.

repeaters video documentation

I put together some video documentation of repeaters for those whose connection is too slow or browser too old to support them. It’s also a quick way to get a sense for several dozen pieces as a gestalt. At the end, it also shows a couple of pieces that are not on Tumblr as they employ sets of multiple images. I plan to have them published as part of an online magazine or gallery in the near future.

repeaters from Zach Gold on Vimeo.

iOS app update (now here on Github)

I believe I’ve mentioned the iOS version of my Scrubber application at least a couple times here as I’ve been working on it on and off for about a year now. Although developed with openFrameworks, it was the initial impetus for me to learn Objective C and Cocoa Touch. At the time, Apple had just released a real video API for iOS 4 in the form of the AVFoundation framework, since ported to OSX Lion as an eventual replacement for Quicktime. However, AVFoundation still does not implement several low level features necessary for my own video work as well as that of most artists and designers developing proprietary video applications, particularly the ability to alter playback speed and jump to specific points in time as well as the ability to access the raw pixels from a given frame. Therefore, I decided to develop an openFrameworks addon that would implement these features, particularly the former by way of the latter.

While this was completely successful, it was also very particular to my needs in terms of performance tradeoffs and the fact that longer videos would cause it to crash because I hadn’t written code to swap out smaller frame buffers as playback advanced rather than trying to load one huge one into RAM. At the same time, the core openFrameworks developers integrated support for iOS video playback in version .007. Although I still intended the code I had to be the basis of my application, I never ended up releasing it as an oF addon.

The second piece of my app proved much more difficult. I needed to develop an interface both to drive playback and load video files from the iTunes library. For the former, I wanted to use a bezier spline, where the user could move the control points of each curve with the pinch gesture, essentially a touch enabled version of this Processing IDE tool. I managed to develop a working version of this, but lost steam in the debugging process.

Quadratic Bezier Curve

I revisited this project this fall with the idea that I would abandon my initial intentions of producing a full-fledged authoring application in favor of the easier goal to produce an app as interactive art piece, similar to my repeaters web project. Porting the timing algorithm I developed in JavaScript, I was able to replicate a repeater in native iOS code easily. I began experimenting with a simple oF GUI addon (whose hard-edge pure data-esque design I appreciate as a rejoinder to that of Cocoa Touch) to allow the user to switch between a bank of included clips, among other functions.

Anyway, a year later and trying to psyche myself up to make the final push to the app store, I decided to just throw the code up on Github under an MIT license in the hopes that someone else will see some utility in it and either integrate the code into their own app or collaborate with me on bringing mine in a new direction that points outside the solipsism of my own studio practice. Do with it whatever you like and please contact me with any questions or, better yet, answers.

Paul Ryan’s Earthscore Notational System

I recently discovered the work of pioneering video artist Paul Ryan (no relation to this asshole), whose theory of motion picture articulated through his Earthscore Notational System and concept of “Threeing” touches on many themes I have been exploring in my repeaters body of work as well as essays such as this one. A good introduction can be found here. I found a particular affinity in the following quotes:

“I would avoid the term visual to describe video. You can see a bottle of perfume, but sight is not the sense it really affects. You can see video images but their effect is primarily kinesthetic or proprioceptive when you see yourself. Video is about perceiving events with the nervous system, not visualizing in a pictorial way.”

“The moving image allows the natural event to occur in the mind like a fist in the hand.”

In his application of the semiotic theory of C. S. Peirce to motion picture, many will see a parallel to Deleuze’s film theory. However, I think I prefer Ryan’s formulation— at least for the examples discussed, though not for its metaphysical conclusions.

Where Ryan and I differ is in his reading of Peirce’s semiotics as a form of Kantian categorical perception (in the text linked to above, he made several references to William James’ “blooming, buzzing confusion”) in order to reinforce the ecological naturalism that underlies the subject matter of his video work. This is best summarized by the following quotation:

“Once we know the score we can observe and monitor how the ecosystem actually performs or fails to perform in compliance with that score. Failure to comply would mean that we need to reinterpret our score and/or to correct any behavior of ours that is making the ecosystem incapable of performing according to its natural score.”

The inability of his ecological theory to draw a distinction between the accuracy of man’s interpretation of nature and the extent to which nature is influenced by man’s actions seems to me to be a textbook example of the base/superstructure confusion that runs through all structuralist theories. Therefore, I would define the crucial distinction between Ryan’s theory of motion picture and my own as hinging on the contingency of any interpretive schema, or to put it in Peircean terms, the fact that (as far as I can tell) his naturalism relies on a distinction between the firstness of thirdness and primary firstness, whereas I (and I believe Peirce himself) would posit primary firstness as equally contingent.

FInally, something more practical I have gleaned from Ryan’s writing relates to the viability of the landscape as a genre of video art. Though it seems to have fallen out of favor in recent times, possibly due on one hand to a current view of it as a mark of the provincial in visual art in general and on the other to the sublimation of video art to performance, I have long seen the landscape as fertile ground for motion picture and it is heartening to know this was the case in video art’s early days.