Interiority

Exteriority

Interaction

Working in progress

Due to the lockdown and the pandemic, we are restricted in our domestic space no matter who you are. We spent more time with our family, our private space, and ourselves. I started to find that I talk to myself much more frequently. Sometimes I'll split them out sometimes I just leave them hovering in my brain. 

The research process leads me to the psychology aspect of this phenomenon. Why we have these inner voices and what is the meaning of these sounds? Refer to Charles Fernyhough's research, he said we have these speeches when we are children and that's the way we communicate to the external world. After we grew up, we started to internalize the speech to a private then the inner speech. Also, the inner speech is a dialogue between the speaker and the listener who can be ourselves or an imaginative person. This is not a general phenomenon. You might not have the voice inside your brain but some fleeting patterns or images which can be another kind of inner speech. To this extent, I found I'm not only interested in the inner voice but all of the interior activities which can be the brain waves, the physical movements, or the graphical images. 

 

I started to explore the relationship of the interiority(body and mind) and the exteriority(the world) and how they affect each other mutually through my practices. I'm trying to reverse the process of internalization in terms of externalizing the interior thoughts to real space. Refer to the recordings and documentation from myself and other participants, I found the dynamic and the rhythm are catching my attention. As a bilingual speaker, my interior activities are some hybrids between languages and cultures but if I analyze them by volume, rhythm, cadence or movements will eliminate the boundaries. 

Throughout the processes, I've tried to make some sketches, animations, writings, and improvisations(as you can see below) to indicate my vision. Some of them are sound-based and some of them are movement tracing. I'm still experimenting with different working methodologies to interpret and transform the sources. Additionally, I've tried to project the animations in my accommodation but the images are too flat. That's why I turn into the holographic projection or AR(augmented reality) technique and play with different surfaces for the projection. 

 

To summarize, the project can slice into 3 chunks. Collecting materials which can be pre-recorded or provided from the participants' interior activities but also can be captured in the installation or on stage. Secondly, interpret, translate, mutate the materials, and project them into the exterior space. Lastly, invite the participant step into space in private and record the interaction between.

Sketches

I made these marks and place them above the sketch of my room.

The pixelated figures are inhabiting and moving in between.

Interior activities. 

The images can be logical or irrational. They move constantly and simultaneously. Some of them are colorful but some of them are monochrome. Try to feel the images and the videos and focus on the interaction in between.  

Sketch1.png
sketches2_edited.png
figure2.png
Room.png
figure1.png
figure1.png
sketches2.png
sketches2.png
figure2.png
figure1_edited.png

Digital Models

Overall, this is the digital drawing of the installation. I'll build a domestic space(5mx5m) and give the introduction to the participants before they step into space.

 

I'm making the possibility of playing with your own inner self and change the space into another interior space in your mind. The pattern will move in the space constantly so I'm expecting the choreographical interaction will be generated. 

These settings should be based on general experience. They can move the object by themselves and try to explore the space and feel comfortable at the same time. 

The lines are the augmented reality animation based on the program I've made and triggered by the voice from the participant. 

The participant will wear a headset for the augmented reality images and wear the headphone to hear their own voice which is a loop from speaking and listening. 

螢幕快照 2020-06-03 下午11.21.00.png

A diagram to indicate the working process. 

Future Plan

I'll keep working on the potential behind the process in my second year. The original image of the project is using the brainwave sensor to trigger the images and the pattern. I'll fo further in this format and create different choreography in a digital way and project them in a physical space with bodies. 

On the other hand, I'm thinking of combining this process with a theatre production. How can I apply this interaction to a character or a performance? As we know, there are so many classical monologues in theatre performance. If I can use these animation, videos, or movements to indicate the text, the monologue can have another way to present it on stage. 

Currently, I'm still working on a project about reading text in both Mandarin and English. Based on my SIP, I'll use the simple algorithm to create a graphic of each reading and try to observe the melody, tempo, volume, and the cadence. I'm thinking of curating a series of graphics to present the emotional content without sound and movement. But the moving images are still interesting to me so maybe it will be a group of animations. If you like this idea, please visit the text reading page which is under the Film and Media menu.

interactive and response the speech by any format

Day 1 introduction and introduce the questionnaire 
Google form for the sharing your inner speech survey

https://forms.gle/VYBGkrn3T8MRgFPP6

Day 2 reorganize the resource and translate them into sounds for the animation or do the sketches. 

Day 3 work with new elements in animation or graphics. 

Day 4 Present on the website.

Day 5 Q&A via zoom