SPACIAL POEM: A New Type of Experimental Visual Interaction in 3D Virtual Environment

There is always a rhythm in our language and speech. As soon as we speech out, even just simple words and voice we make are edited as various emotions and information. Through this process we succeed or fail in our communication, and it becomes a fun communication or a monotonous delivery. Even with the same music, impression of the play can be different according to each musician' s emotion and their understanding. We 'play' our language in the same way as that. However, I think, people are used to the variety, which is, in fact, the variation of a set format covered with hollow variety. People might have been living loosing or limiting their own creative way to express themselves by that hollow variety. SPACIAL POEM started from this point. This is a new type of 'real-time visual interaction' expressing our own creative narrative as real-time visual by playing a musical instrument which is an emotional human behavior. Producing many kinds of sound by playing musical instruments is the same behavior with which we express our emotions through. There are sensors on each hole on the surface of the musical instrument. When you play it, sensors recognize that you have covered the holes. All sensors are connected to a keyboard, which means your playing behavior becomes a typing action on the keyboard. And I programmed the visual of your words to spread out in a virtual 3D space when you play the musical instrument. The behavior when you blow the instrument, to make sounds, changes into the energy that makes you walk ahead continuously in a virtual space. I used a microphone sensor for this. After all by playing musical instrument, we get back the emotion we forgot so far, and my voice is expressed with my own visual language in virtual space.