Friday, April 6, 2007

more idea stuff

So as I stated earlier, my goal with this project is to allow people to explore the connections we make between audio and visuals. I think I've come up with fairly good interface for this. I want to tell a partial story by showing a single location in five different stages. Each part of the story would have a specific emotional quality attached. By adjusting different visual qualities, introducing elements of the story, as well as adjusting the sound being played, I would hopefully portray a wide variety of emotional settings.

I have had a little bit of experience using MAX/MSP, and if I could use it again I think I could create a very effective interface. I want to take one of the tablets and use it as the control. By moving the pen around the tablet, I want it to switch between the five different scenes. The surface area would be split up into quadrants, with a fifth equal sized square right in the middle. I'm not terribly good with max/msp, but I think I should be able to take input values from the tablet to control the levels of audio playing, as well as the to what extent each video is playing. For example, if the pen was halfway between the upperleft corner and the center of the tablet, it would be showing the video of the top left and the video of the center partially overlayed with eachother, as well as the sound from each scene partially blended.

As for what exactly the scene will be, I was imagining a set seat at a dinner table. Specific things would occur around this setting, but the framing of the shot would never change.

2 comments:

John Fisher said...

that sounds like an interesting idea. On the technical side of things, the wacom tablets actually have 5 "axes" of data.. x,y,pressure,x tilt, and y tilt--if it's one of the nice ones. If you could harness all that input data you could add a little more detail and interest to the interactivity. Just a thought... i'm pretty interested in those tablets myself. That's why I have a tablet PC, though unfortunately there is no "tilt" on the screen, though it does have pretty detailed pressure input.

John Fisher said...

the other thing that I was thinking, was that it would be good to make sure there was some sort of nonlinearity in the piece, where the user would get surprised, or there was some sort of unpredictable feedback to their behavior, because I like how the interface you want to design sounds so simple and intuitive, but maybe it wouldn't be very exciting for the user? Just a thought.