I was just watching this music video (Jack’s Mannequin – The Mixed Tape) and I was thinking about the style of animation they are using and how it reminds me of the ads that VH1 was doing a while back that were really cool looking. And I was thinking about the conversation Tiffanie and I were having at dinner today about video games and how it’s just freakin’ fun to play around with a game like Mario Sunshine, just playing with the jet pack and the controls and screwing around in the environment. And I was thinking about how we use physical objects really creatively and how I have this long-standing fantasy about virtual reality spaces where you could do things like create fireworks with hand gestures or grow flowers by stomping on the ground, or whatever, which got me thinking about cave painting at Brown and how that was pretty much the most exciting moment of my life.
Yeah, so that’s all the stuff I’ve been thinking about, and this is where it’s lead me.
A prequisite for creativity is rules. Rules that you can learn and then push on and combine and build out of. Paint sticks to a canvas according to some pretty simple but strict rules. And it mixes together based on similarly simple rules that lead to nice rich possibilities. But in computers, there just aren’t any rules. At least not of the same sort. And computers are pretty much just rule-obeying machines, so that’s definitely ironic.
But think about it: the buttons in your web browser… they are hooked up to a function that could do pretty much anything in the computer. It could flip any 1 for a 0 anywhere in the whole damn machine. It just so happens, they all do very specific things. It’s like having a paint brush that knows about two hundred different brush strokes that you can invoke in an order of your choosing. Cool, and easy, but not very flexible.
So back to that animation. I’m thinking in particular about the trees growing and stars flying around and whatnot. Maybe the ticket is to just create virtual objects that have behavior. Like curlybot. It behaves in a certain way with or without you, and you just influence the direction it goes. So imagine a tree that grows, but how it grows depends on the presence of phantom objects that you throw at it. So it starts growing, but you throw at it little balls that cause it to explode into a million branches, or you wave your hand over it and cause leaves to grow, or place walls that it routes around, throw colors at it that change its branches, or put objects in it and have its limbs start to imitate the form of those objects, all in real time as it grows.
But what are those gestures, those balls, those walls, those colors, etc? That is the question. How do we choose a handful of objects that can be really powerfully combined? I think the answer is to pick things that are really generic. So, you might have an object that causes things to copy themselves and break into a million bits. You could use this on lots of different things besides the tree. You could use it on a word or a picture or whatever. But the behavior of the things needs to not be tied to the object. It needs to be context free.
Context free, and obeying some sort of rules.
Damnit. It’s late and I’m loosing my train of thought. Sigh. Anyway, maybe you get part of what I am talking about?
