Sonification of the Electric Sheep

What I'm looking for is an Open Source (ideally GPL) command-line Linux program that will take a Sheep genome, image files, (and a sample library of course) as input, and generate a corresponding sound file as output. There are two images of each frame, one at full 640x480 resolution ($frame.jpg), and the other scaled to 64x64 (i$frame.jpg). Assume they will be played back at 30fps (or should it be 29.97?).

The audio should loop and respect keyframes the same way the video does. Note there are two kinds of animations: loops and transitions, and the numbers in the mpg filename specify how they may be connected. The FAQ explains it.

Specifically in the torrent we have (the initial letters are just labels):

A 00188=03536=03536=03536.mpg
B 00188=03538=03536=02982.mpg
C 00188=03539=03539=03539.mpg
D 00188=03541=03539=03169.mpg
E 00188=03542=03542=03542.mpg
F 00188=03543=03447=03542.mpg

The genome is in XML format in the file "spex". Note that the loops only have one <flame> element in their genomes, and the transitions have two, one for the start and one for the end. The way the animation works is the spex file gets interpolated (for transitions) or rotated (for loops) to create a spex file for each frame of the animation. Flame-animate turns this secondary spex file into a jpg. I expect you'd use these interpolated genomes, named $frame.spex.

In each of those files are 3 <flame> elements, one for the previous frame, one for the current one, and one for the next. It's to support motion blur. You could either just use the one in the middle, or use all 3 and take the "blur" into account in the audio too.

It should run pretty quickly as it will run along with the video compression on the server (say one minute of CPU to generate 4 seconds of sound). Yes eventually everything will be distributed, but for now that's how it works. However when it does get distributed, if it does, then the algorithm will only have one frame as input, not the whole directory, and will generate just 33.3ms of sound.

For notes on playback of the mpg file on Windows and OS X, see here. On linux if your regular media player doesn't work, you can install electricsheep and then use "mpeg2dec_onroot -w -1 foo.mpg".