This project started by collecting sounds related to our original topic, mine was grocery shopping. We made a solid collection of sounds that give an accurate sense of our activity. This is phase two of our project -- constructing an interactive framework in which all previous story elements may be placed.
Q: How can I design an interactive framework with all of my elements (sound, image, and movies) that allows participants to construct their own stories?
restrictions:
because this is our first interactive project, participants will only be able to engage in a few basic actions
- clicking an item to play a sound
- clicking an item to enlarge and view image or movie
- click image to remove it from the screen
- drag elements around on screen to re-compose or sequence images or movies
considerations:
how much control do you want the participants to have in your narrative?
how mall, large, long, short, etc, should each component be?
how can you build something that will make people want to actively participate in your narrative?
Throughout this project, I learned a lot of things about the technical aspect of working with Action Scripting 3.0 in Flash, but also a lot about sound. Music, voice overs, and sound effects reinforce the emotion and environment of the visual communication channels. I have also learned the difference in hearing these sounds simultaneously compared to sequentially. For my interactive piece, I found that when the sounds are played simultaneously, (beeping, cash register noises, receipts printing, bags crumpling, noise of standing in line, voice over of "attention shoppers..") this added to the intense feeling in a grocery store with everything going on around you and all the people. In comparison to other interactive pieces, sequential sounds worked better for them because of their chosen subject matter.
Normally in my work I like to be in control of the viewer. I took this opportunity to allow my viewer to have more control when interacting by allowing them to create their own arrangement of sounds, animations and images at the bottom. Also, if the participant interacted long enough they have the ability to discover how I intended some components to interact. For example, when the videos at the top are played simultaneously they can overlap and interesting juxtapositions and overlays are created.
At first I incorporated faces to bring in the family aspect of grocery shopping, I needed something clever to make my handles to be able to move around the images and animations in the basket. I first used children to play on the idea of when a child asks for something sweet or unnecessary and are told no, they throw a fit. So, instead of using a child crying, begging, or a typical noise that would come from this image, I wanted to add a surprise for the viewer by playing a different sound. The five children at the bottom are moveable and they also click to play sound. The first girl on the left is a voice over of "attention shoppers! clean up on aisle 7!". The second boy, plays a really cheesy grocery song and explains the sales going on in store. The third girl yelling plays a sound of a paper bag being opened on loop. The other two play background noise while standing in line and a vintage song about the newest register released.
The items in the cart play an animation of things piling up in a grocery cart and the receipt printing. The receipt roll with a boys head on it plays the sound of a receipt printing and the girl on the scanner gun plays the noise of the scanner - expected sounds.
I felt a little technically restricted because this was my first attempt at action scripting. It was definitely hard, but the struggle was worth it. The anticipation when you hit command + enter for the preview to come up to see if your code worked was the scariest part. After working in Flash and getting the hand of how things are set up and what I could do with my limitations, things got better. Overall I thought it was an awesome experience creating an interactive piece and I'm excited to dive in a little deeper and PLAY!
Process:
Final
These are just screen shots for now, I hope to be able to upload the real thing soon
intro screen - click to remove:

this screen appears, move items out of the basket and arrange at the bottom to create your own narrative. then, click on videos at top to play over the basket.

narrative arranged at the bottom - all the things that can be arranged either play a video, animation, or play a sound. click them individually or have multiple play simultaneously.

click 4 images at top to play:


Click to play videos simultaneously: