01 Migration Plan Find secrets in the magic tower and aquatic realms
Introduction:
You wake up in the tower without memories. You collected fragments of memories which reveal a connection between the souls of humans and fish, discovering a plan explaining where your vanished people have migrated to.
The game is available on PC and CAVE, a multi-wall virtual reality system. It uses Kinect to recognize player motions and compare them with predefined gestures to trigger game commands, enhancing player immersion.
Group Project
My Work:
Game Design, Scene Design, Coding, Script-writing, Character Design, Modeling, Ui Design
2022.9 - 2023.6
Inspiration
Early Concept
Zong Jiangtun (Yangtze finless porpoise)
Unearthed relic along the Yangtze River
Their soul contains in the mask, representing a fish.
Modeling
The second character and the orb.
The city is built on the iceberg ring. Human built a tower in the center of their settlement to watch how fast it melts. However, a disaster took 2/3 of the people as well as the memory of the purpose for the tower.
Baiji (Yangtze river dolphin) Baixun (Chinese paddle fish) Where the species have been spotted
DISTINCT
DISTINCT
DISTINCT
ENDANGERED
The game tells a story that: ‘You’ (whose soul is Jiangtun, the endangered species survive) wake up and find that you are the only living thing in this world. You have to find other 3 soul fragments to know their memory and why they disappear.
The soul of your people is contained in a mask with the feature of fish.
Mask of Zong
Jiangtun uses radar to detect the world under the water.
Mask of Baiji
Mask of Baixun
Mask of Baixun
The character uses similar ability to Detection can be interfered with by propellers, which detect the world. is the main course for unnatural death of Jiangtun.
Height distribution map
Vegetation distribution map
Tears join together to become an orb, which absorbs the power in the mask.
The orb - resembling the shape of the ice world, if you flip it, the world will be flipped too.
Modeling
Concept - Game
Workflow Environment
A projector connected to the computer where the Unreal 5 runs
Motion recorded
Motion in real time
Trigger the command Kinect V2
Create a mapping from player motion to 17 game commands.
Visual Studio
Kinect will recognize motion that have been recorded before.
a. Display the media of interaction in the game. b. Ask the subjects to do actions through which they think that they could trigger the interaction. c. Record the action through kinect. d. Analyze samples to determine the final poses to be adopted e. Conduct a questionnaire to assess the usability of the poses
Record the motion data with Kinect
The recognition results are transferred to Unreal 5 in real time.
Motion recorded
Human-Computer Interaction PC
VR
Specific Motion to Trigger Game Command
walk
run
jump
fly up
fly down
last
next
open
close
flip the world
light
radar scan
trigger
next page
last page
swim forward
swim up
swim down
Kinect
Storyline Scene
You fall to the Tower,
and wake up in the memory library.
Start: You see the world
The administrator
through a fish’s eyes.
tells you to find the memory fragments.
get the ability of radar scan
Interaction
swim forward
swim up
swim down
light
00:00
next page(next dialog)
fly up (rise)
next (choice)
00:40
trigger
01:30
01:56
Scene
You are taken to the next level,
Use the radar scan
Detection can be
By detection you get a
Something changed
where the plates rotate driven by
and the hidden
interfered with by
list about endangered
in the guidebook you You fall from the portal
bridge shows itself. propellers.
the power of light
animals
got
Interaction
radar scan
light
02:05
rise
open (book)
next page
trigger
02:21
jump
04:08
04:39
Scene The next level is nearly the top of the Tower. If you jump from the Tower, you will become a fish and find them. BAIXUN
You come to the top of the Tower after knowing your
Choose the right There are rooms with questions.
portal and get out.
Find the last fragment.
people have become fish in the water.
Get the ability to fly.
Interaction
radar scan
05:46
trigger
06:10
jump
fly up
fly down
06:57
08:26
Architecture
Top of the Tower You stand at the top of the Tower and make the final decision.
Top of the Tower
Ascending Hall After collecting all the fragments, unlock the ability to fly freely in the tower. Ascend here to see the ending of the game.
Ascending Hall
Quiz Maze You use the knowledge you got about endangered animals to choose the right room and find the last fragment.
Proving Ground You use the power you got to remove obstacles, move the suspended plates and find the next fragment.
Quiz Room
Memory Library You woke up here and met the administrator, a robot who helps you to find the first fragment.
Proving Ground
Dormant Cabin You slept here, where the Orb is kept, a tool for traveling to the Underworld.
Tower Section
Memory Library
Game World
Public Engagement
Bridge It connects the city and
The exhibition of Beijing International Design Week "Action Design"
serves as beam.
Early Drafts
Iceberg
City
The Tower
It floats on the water to support the
It is divided into three circles.
Paired with the mirror tower under the
city, sustained by magic power.It's
The closer to the center of the
water. People believe the upper world is
been melting recently, leaving the city
circle, the more honorable the
for the living, while the under world is
in danger of sinking
status of the inhabitants.
for the dead.
Curious teachers and students
02
Chord
Generative design workflow to chord music and space through EEG pattern Introduction: A fitness function is established using the EEG pattern associated with the music to find the spatial parameters that best match the emotions conveyed by the music. A multi-objective genetic algorithm is then used to calculate the fitness score of the corresponding space. During this process, subjects can watch the real-time change of the spatial device in the VR environment and input the EEG signal outputted by the TGAM module into the fitness function. By doing so, the algorithm can determine the spatial parameters that best match the emotions elicited by the music. Group Project
My Work:
Research, Modeling through Grasshopper, Rendering, Experiment, Adjusting the VR Environment
2023.6 - 2023.7
Workflow
Background Results of music-emotion questionnaire tense
Rock Country
upset 0
-1
0.5 0
0.5
0.75
0
valence
-2
Rock
Pop
Electric
Jazz
Blues
People tend to feel tense for rock and elated for country.
How do people feel music? We can also measure it through EEG signal.
-2
Scale
Their EEG signals are recorded
Music - Space - EEG
Material
Subjects wear EEG and VR
device and listen to music. Their EEG signals are transmitted to the grasshopper in real time.
Parametric model The space is optimised
relaxed bored
Subjects listen to music.
The installation is displayed in VR through real-time rendering
Country
serene
sluggish
Style
Light
-1
contented
depressed
0.5
0.7
1.15
The parameter of the space is an optimistic solution to couple music and space
-0.6
2
1
sad
1
0
happy -1
1.1
0.25
elated
1
-2
1.55
Music Genre
excited
stressed
Valence Arousal
2
arousal 2 alert
nervous
Music - EEG
Average Values and Standard Deviation of Evaluations of Six Music Genres by 20 Subjects
Output in experiment 2:
Music clips of different gynes
Output in
experiment 1
corresponding EEG signal changes.
calm
In order to evaluate people’s feeling about music, we created questionnaires asking them to rate their valence and arousal on a scale of 1-5
EEG Results of attention and meditation about music
We use the TGAM module to collect and process EEG data.
The EEG signals are used to optimize the parametric spatial installation through genetic algorithm
Goal of fitness function:
|Subtraction|min
of signals in 2 experiments
EEG signals of the music
EEG signals are monitored in real time and transmitted to the computer
Methodology input
output TGAM module The arrow represents where the data flows
Insight If we know the EEG pattern for a specific music, can we find a corresponding space which recalls the similar feeling?
We could use the attention and meditation to simply represent the EEG pattern. Meditation is related to a person's state of relaxation, attention is related to a person's state of concentration and alertness.
Participants wearing EEG and VR device
Results generate curves
Prospects loft opening degree of the petal
Petals HSL are selected to determine the color of the light
What the user see in VR will change in time and finally to a optimum status which fits the music
The virtual space could alter material and form according to the music.
8 optimizing results of country music
Combined with ai it can provide more customized personification options.
processed with stable diffusion 8 optimizing results of rock music
processed with stable diffusion
Game Mechanics
Deep in the forest there are pairs of seed friends.
They are
03
acorns.
dandelions &
always float↑ Both of them want to go to the heaven land always fall↓
A perfect place for sprouting.
↑
Co-op mini-games for two players Introduction:
The two players need to take on the roles of two types of seeds: dandelions and acorns, and cooperate to reach the end of the line to root and sprout. The dandelion is light and can float upwards, while the acorn is heavy and can sink downwards. During the process, players need to strategically drop some seeds to adjust the flight status of the combination, so as to avoid obstacles and enemies and achieve the goal! Group Project
My Work:
Game design, Level design
2023.5.26 - 2023.5.29
Players
1
,
Player controls the dandelions while Player controls the acorns.
Release the seeds to go upward or downward.
itting obstacles and borders or being caught by enemies will end the game.
2
H
Enemies
They are small bugs that move regularly and will eat seeds that come into attac range. hen they are feeding they have no time to launch an attac . Consider this into your strategy
,
!
k k
W
There are some SCARY enemies. Supply Stations
Come closer... the new acorns will be attached to your seeds. t will bring a sudden change in weight be careful.
I ,
There are also some dangerous obstacles.
Mushrooms
They are soft and stretchy. Best of all they don t cause harm. Use them to ad ust your flight path.
j
Mind not to hit the border Use your smart brain to help the seeds get to the destination ！
'
Your Goal
Survive all the enermies and obstacles. ly to the heaven island with as many seeds as possible.
F
Levels
Level Design Danger zone
The game has 6 levels and takes about 10 minutes to play.
Flying bugs prey on objects that enter their radius.
Crawling bugs walk back and forth on the platforms, jumping up to catch objects that come within the radius. Level 1
Supply stations It increases the number of heavy seeds, resulting in a rapid falling trend, and the player needs reflexes to avoid obstacles. It increases the number of light seeds, resulting in a rapid rising trend, and the player needs reflexes to avoid obstacles.
Level 2
Strategy Provide the player with at least two routes in a level, one of which is easy to follow but involves giving up more seeds in the process, and the other is more difficult to follow but carries more seeds to the end. ①
drop light
Level 3
② drop light
Phase 1
drop heavy
drop light
Phase 2
For example, when I design the level 1, I divide it into 2 phases and 2 routes.
Level 4
At the start of the game, the seeds have a slight tendency to rise, and Route 1 takes advantage of this tendency by avoiding the first obstacle with more difficulty, and needing to discard the seeds only once to reach the end, while route 2 requires three.
04 Cocoon Woman Spatial installation imitating the cocoon Introduction:
The installation is inspired by Jun Togawa, a famous rock singer and icon in Japan in the 1970s.
Human activity and human presence define the boundary of space. This boundary takes the form of two flexible materials: an outer layer of wire mesh and an inner layer of flexible nylon wire mesh. The form and construction of the space are inspired by the cocooning of insects, which isolates contact with the outside space and provides a sense of psychological security to the wearer. At the same time, like an insect creating its cocoon, it is constructed with unique materials: the household waste collected from the environment (flexible wire mesh, PLA plastic bags, silk stockings).
Individual Project
2021.2 - 2021.4
If humans cocoon...
Material experiment
They live in a shell.
A shell that molts regularly.
=
+
+
A shell constructed from waste.
Shape from human body.
Perception fields when static
Digital models
Construction
Dynamic movement
Simultaneous
Instantaneous
Model 1:10