An interactive projection that explores hallucination and solipsism under varying degrees of underwater pressure.
Thalassia
Overview
Thalassia is an interactive projection piece that explores the ideas of hallucination and solipsism under varying degrees of pressure underwater. As you immerse yourself in the deep sea, your perception of the environment begins to shift. Can you control the tide? Was that a manatee you just saw or a mermaid? Experience the distortion of reality through the ever-changing nature of the deep sea.
Team
Ashley Kim Ajunie Virk Vivian Noh Kyle Steindler (musician)
Role
Interaction Design Visual Effect
Duration
Nov 2 - Dec 3, 2021 (1 month)
Tool
After Effects Blender Intel RealSense D435 Photoshop Touchdesigner
Background
Thalassia was produced for the collaborative exhibition called Between Air and Waterlines . The exhibition presented more than six collaborative works by more than 50 animators, dancers, and musicians in the evening of December 3, 2021.
Concept Ideation
As a team of three, we began ideating for the overarching theme of our piece. Wanting to create an immersive environment that's different than what we experience in our daily lives, I proposed creating an immersive underwater environment. Other team members agreed to the concept, and we start narrowing down the narrative of the piece by researching how underwater is depicted in different media and genres.
Research
Through the research, we noticed that underwater has been used in various context with different feel for centuries. Below are examples of how underwater has been portrayed in certain fields and media:
Greek Mythology
Since Greek mythology explains the creations and stories of different Earth elements, numerous characters from Greek mythology were related to the body of water. Homer's Odyssey is a representative piece of literature that unfolds the adventure of Greek hero Odysseus. Calypso is a sea nymph who detained Odysseus for seven years, while Sirens are man-bird creatures who lure nearby sailors with their enchanting music to shipwreck on the rocky coast of their island. Poseidon is a famous god of the sea, and Kraken is a legendary sea monster of gigantic sized cephalopod-like creature that often appears in the Scandinavian folklore.
From the Greek mythological stories and characters, we gained the impression that underwater is often portrayed as a realm of curiosity, enchantment, and danger.
Underwater Organisms
Adapting to the higher pressured deep ocean habitat, underwater organisms have unique body features that helps them survive better. Survival mechanisms similar to that of the land organisms like camouflage can be found amongst the underwater organisms as well, but they also have unique underwater features that are distinct to those in the land. Blobfish, for example, are well-known for their melting look after being pulled up rapidly by the fishers. However, they look totally different in their natural habitat, which is more than 3,000 feet below the sea level. Anglerfish are famous for their method of predation in the deep sea. They have bioluminescent lures protruding from their heads to attract prey to come near them. Prey fish would mistaken the lights and approach the anglerfish without being on alert. Humans also have mistaken a number of underwater organisms in the past, and mistaking manatees for mermaids is the most well-known fun fact introduced at the aquariums.
From researching various underwater organisms, we learned that misinterpretation is the repeating theme in both underwater survivalship and human understanding of deep ocean organisms.
Mysteries
Some of the famous mysteries around the world are related to the deep ocean. Bermuda Triangle, for instance, is a mythical section of the Atlantic Ocean roughly bounded by Miami, Bermuda and Puerto Rico. It is a notorious region where dozens of ships and airplanes have disappeared in the past. Atlantis is a fictional city mentioned in Plato's literature *Timaeus and Critias* that is well-known as the sunken city.
Underwater related mysteries gave us similar impression as the Greek mythology research, where the underwater has been portrayed as a place that's full of wonders and danger.
Media
Since the exhibition would be held indoor on land, we had to find a way to recreate the underwater feel inside a building. Computer graphics and visual effects used in media often uses shots on land as the base footage, so we researched how the underwater scenes in movies depict the feel of water. Through the scenes from Harry Potter and Miss Peregrine's Home for Peculiar Children, we noticed that blue green tint, air bubbles, and water caustics are used to visually persuade the underwater scene. Billie Eilish's music video for Ilomilo is a moving image animation set in a deep ocean, which we gained the inspiration of sinking movement direction from.
Video Games
For the interactivity aspect of the project, we also looked up how underwater themed games have designed their player experience. Some of the games we viewed are Subnautica, a survival game, Reveal the Deep, a short exploration game, Soma, a survival game with mini puzzles, and Lumione, an exploration game. Many of the games that gave immersive experience was developed in a first person shooter game style, where the user gains full control of what to see and where to go.
Concept Finalization
Combining what we found through the research, we decided to create an interative underwater environment that revolves around the theme of pressure, shape-shifting, and distortion of reality.
Production
Maximizing each of the member's strength, I was in charge of project management, interaction design, and installation design.
Project Management
We first developed a overarching timeline together to set checkpoints as a smaller deadlines. Using the progress bar on the far right to indicate where in the timeline we're at, I kept track of individual works and the deadlines for other related documents that needs to be handed to others out of our team like the material purchase list.
Interaction Design
We first developed a overarching timeline together to set checkpoints as a smaller deadlines. Using the progress bar on the far right to indicate where in the timeline we're at, I kept track of individual works and the deadlines for other related documents that needs to be handed to others out of our team like the material purchase list.
Using the particle effects and depth camera input, I created an interactive particle effect that shifts in location based on the detected motion. In a static state, the particles are set to slowly move towards the top, mimicking the movements of air bubbles rising to the surface of the water.
Combining the interactive particles, depth camera input, and water caustics noise, I finalized the interaction layout. The final version focused on recreating the air bubbles that form as an object moves through the water.
Once the 2D and 3D contents have been merged and ready, I laid the interactive water caustics layer on top of the merged animation. The shape-shifting silhouettes are made in Blender 3D by Ajunie, and the wavy coral reefs and thalassias are made in After Effects and Photoshop by Vivian.
We then tested the combined interaction content with the projector. Based on how we observed the content looked in the projection, we made a final color adjustment to express the hue and saturation we worked with on screen.
Installation Design
Based on the assigned location, I quickly made four sketches of our installation visual and two idea sketch for how to secure the devices like projectors and cameras during the exhibition.
From the top left and clockwise, the sketches are a view from the entrance, a view looking into the right wing (like the photo above), a view of the floor, and a view when facing the projection in parallel.
We also came up with the inital installation plan as the diagram on paper. However, through the projector testing, we noticed that the width of the hall isn't long enough to place two short-throw projectors such that the projections cover the wall. Hence, we made the modification as the diagram on the black background. Now each projector is planned to place on top of the wooden podium across from the wall it's projecting to so that it still minimizes the audience's shadow while the projection covers the wall.
On the day of the exhibition, we set up the projectors on top of the wooden podium built by professor Johannes DeYoung and covered the depth camera tripod with the mesh fabric to add to a underwater coral-like feel. I'm the one on the ladder adjusting the projector in this photo!
Exhibition
Once the exhibition started, the music performances were held according to the schedule. All visuals are accompanied by a piece of music, and they were all on display even if the musicians of that group weren't performing. All audience is free to come and go throughout the exhibition hours and is invited to interact with any of the pieces.
This is an example of how the audience's movement is tracked real-time and rendered as a water caustics movement. Through the vague yet distinct human shaped water caustics, the audience are invited to think about the difference between what their eyes see and their brain recognizes.
Reflection
I enjoyed learning more about the depth camera and designing interactivity using noise and camera input data. Many viewers were amazed and showed great interest in their silhouette appearing as part of water caustics. Although there were various aspects that I had to compromise due to the location specific limitation, I'm proud of our work and installation. Through this project, I was able to practice my project management skills, especially on deciding which aspect of the project to prioritize given an abrupt time and space limit. Since the interactivity gained high interest during the event, my team and I are planning to have another exhibition in a smaller exhibition space where the audience can fully immerse themselves surrounded by the underwater visuals.
I'd like to express my appreciation to professor Johannes DeYoung, Rebecca Shapass, professor Golan Levin, and Bill Rodgers for their generous support in bringing this project together.