design portfolio

SERVICE DESIGN

PERSONAL PROJECT 2023.04-06

Brief

The GreenBuddy is an interactive service to enhance connections between children and plants in botanical gardens. The service consists of an online platform and an offline games that encourages families to engage in preserving biodiversity. The online part mainly consists of three functions: interactive games within families which can strengthen parent-child linkage, popular routes for recent activities and DIY notebooks to record personal feelings.The offline part refers to activities and guidances supported by the staff to match the online functions.

There are about 3765 botanic gardens in the world,

179 of them are situated in China, only accounting for about 4.75%

China is attempting to improve the situation. In 2022, the first national botanical garden was established, and has added over 2000 new plants and as of now in such a short time.

tion on Biological Diversity, China proposed to start building a system of national botanical gardens.

not only promote the development of tourism, but also promote the consumption of related industries.

Problem Statement

At present, the construction of botanical gardens in China has entered a stage of steady development. However, the recovery of passenger volume seem not salient even after the ajustment of COVID-19 restrictions compared to other tourist attractions.

Tourism Attraction Footfalll

USER RESEARCH

This user research has obtained a total of 63 valid questionnaires, covering XX provinces across China.

AGE OF CHILDREN

3-6 0-2 7-10 11-14 15+

INTERACTIONS PREFERRED

PURPOSES OF VISITING

source: https://www.djyanbao.com/report/detail?id=3435977&from=

Common Interactive Activities

Summary：

Handcraft activities

Billboards and exhibitions

Group study tours

Thematic exhibitions

19 7 21 183

4.76% 28.57% 33.33% 30.16% 11.11%

Every week

Once every month

Once every 3 months

Once or twice a year

Less than once a year

Never

CONCERNS ABOUT VISITING

Relax and have fun in nature

Strengthen parent-child bond

Learn about plants

SATISFACTION DEGREE

TYPES OF SERVICES WANTED

APPEAL TO CHILDREN

PARENT-CHILD PARTICIPATION

It is the basic task for botanical gardens to exhibit, introduce, study and utilize the abundant plant resources under scientific management.

China has a tradition of loving plants and being close to nature. Returning to nature can loosen up the body and mind and learn biology vividly.

What change Action

End of COVID-19 lockdown & publcity of nature-deficit disorder.

How might we improve the experience and learning effect of family in botanic gardens?

What Activities in botanical gardens are often sporatic and expected, and children may easily forget they have learned.

For parents, children, botanic gardens and the institution staff.

Inconvenience in transportation or supporting facilities

Getting allergic or injured by partial plants and incsects

Lack of novel and attractive interactive activities

Few parent-child interaction activities

Children's no interest in plants

Interaction with family

Q&A game

AR/3D projection

Exploration game

SUMMARY

Route customization

QR code commentary

Online panorama visit

Inability to acquire knowledge for children

Type of interview: face to faceDate: 2023.06.25

Time: 10-15/person Number of Participants: 2

1.Do you often take your children to visit botanical gardens? Why?

2. How do you evaluate your trip here?

1. Is this botanical garden fun to play? Why?

2. What plant knowledge have you learned? Is it easy to understand?

“I rarely take my her to botanical gardens for the lack of fun and supporting facilities. Although the scene is quite beautiful, we seldom visit every part, and we may get lost in this large place.”

Unfamiliar with plants Mother of a 5-year-old girl

Learn with children More guidance during visit

Requirements

Entertainment

“I have read lot of botanic picture books, but I don’t often come here because books are more interesting instead of billlboards with dense texts of difficult to understand. What attracts me most are study trips and lab experiments, but the activities are not always available.”

Plant enthusiast

Enjoy visualized or gamified knowledge

9 years old, primary school student

Accessible Convenient

Affordable

Beijing

Yao Huilin 8

Student

Interest: Reading, Piano, Animation Painpoints

Pleasant hours with family in nature

Learning

Manager

Practical goals: Abundant understandings of plants and higher biology grades

Emotional goals: Relaxation and closer kinship

To understand the practice of growing activities among families, I analyzed worldwide famous botanical gardens and found that even though technologies have been widely used, interactions within a family are still in need.

multimedia entertainment

Treasure-hunting game Parent-child reading APP Offline family workshop

Immersive expeiences

Involvement of story and narration based on local culture

Various interactions

Visualized stories and interesting illustrations

Age-specific books

Communications

Immediate feedback

Visualized knowledge and game

Lack of learning

Not always available

Findings

Lack of interations between parents and children

Limited interactions

Not always available

Rely on the tutor

KEEP & IMPROVE: Online and offline activities have their own strengths, It can make use of the portability of APP +AR and other technologies + parent-child games and parent-child picture books.

MARKET VANCANCY: The existing ones do not meet the needs of parents in all aspects of visiting botanical gardens. No market demand points deep space blank

Jin Qinyu

Chen Zerui

StartYourJourney!

The UI elements adopt a childlike image, while in the illustration design, soft watercolor strokes and green main color tone are used to express closeness to nature.

GetStarted!

Evidence

APP function: interaction; poster. brochure

APP function: Route

APP function: notebook APP publicity

CUSTOMER

Learning tourist guide about botanical gardens

Enter the garden

Interact among family members via AR and quiz game, and exchange coupons

Look up the plant calendar or search keywords for spots and activities, then custermize the route

Record visit and share in the online community

Leave the garden

Edit the guidance and update on navigation apps

Welcome visitors, instruct them to scan QR code to download the APP

Arrange posters and billboards

Arrange activities and optimize visiting route

Guide the visitors and answer questions

Push visiting news and pruduct questionnaire research

corperation with navigation apps

APP Develop and maintain app User research

Corperation with branding and IT support

Maintain plants and other facilities; collaboration with science teachers

Push recent notes and manage online community

Product operations of the APP

Collect nformation

Use GPS positioning; rganize activities

Illustrate pictures; optimize algorithm

Collect and analyze data

Brief

Voice Sentry is a sound detection system that combines hardware and software designed to help adolescent vocal leaners to protect their sound health.

The hardware part includes a portable microphone and a belt for collecting sound data and warning notifications via a LED tape light and a vibrator. When reach the value of a certain sound wave amplitude and frequency, the LED light shines one by one and as the sixth light glows, the vibrator vibrates. The other hardware part is a belt which vibrates to lead the user to breath deeply and slowly. Matching the hardware device is a mobile app that provides customized vocal training coaching, vocal classes and a sharing community.

BACKGROUND

DEFINE

A voice change or voice mutation commonly refers to the deepening of the voice of people as they reach puberty.

From 2021 to 2023, the scale of adolescent musical education keeps growing.

On the basis of various methodologies and statistics, the incidence rate of children voice diseases has a broad spectrum from 6%-23%.

SECONDARY RESEARCH

Production of Sound

Sound is a vibration that propagates as an acoustic wave, through a transmission medium such as a gas, liquid or solid.

The production of sound includes a vibrator, a driving force and resonator. In our throats, there is also a sound producer:

1

Vibrator: create vibration

Larynx: Stretch and contract the vocal folds

6-23%

2 Driving force: air molecules

the vibrations cause the medium, air to vibrate rhythmically, creating sound waves in chest.

Importance of Voice Care

Physiological Changes

Common Voice Change Period

keeping the larynx flexible shortening the time of voice change and making faster improvement

bio-male bio-female

Age: 12-15

Age: 11-13

Three Stages of voice change

2.Avoiding vocal diseases: vocal cord edemapoor closure of the glottisvocal nodules and vocal poly pspathological loss of voice

16-22mm

Duration: 1-3 years

EarlyMiddle Late

3

Resonator: push air against the closed folds and vibrating the tissue to enhance timbre and/or intensity in the air-filled cavities.

Psychological Features

During puberty, as the emotion-controlling system is not yet mature, teenagers can experience the following psychological changes.

Variable emotions easily get impulsive or inferior.

Preference of gamified and explorative learning

Four types of resonation:

mouse nasal

chest head

source: https://www.youtube.com/watch?app=desktop&v=rjibeBSnpJ0

Pursuit of independence but feel contradictive and lonely Thirst for knowledge with cognition developing

Findings

During the voice change period, to meet the needs of growing hunger for knowledge, there are special exercises for teenagers:

KEY:

Homogenous tissues thicken the vocal folds: adding nuance and depth to the voice

Reducing the involvement of vocal folds:

Reducing treble

More excercise of chest cavity resonance

Larynx grows in size, elongating the vocal folds

more room for vocal folds to vibrate slower and larger vibrations, lower pitch laryngeal protrusions, voice cracks

Appropriately increasing vocal music theory learning.

early stage

middle stage

still children's voice dry throat less child's voice out of tune

late stage

change into an adult's voice instable sound

Understanding the connotation of the song and cultivating the emotion of singing.

USER RESEARCH

In order to figure out teenagers’ awareness of sound protection during voice change period, I conducted a questionnaire and received 124 valid results from teenagers experiening voice change.

Activities harm to voice?

Attitude to Protect Voice?

POEMS

According to observation, a vocal class is usually one-on-one class and constitute of three parts:

Part 1: Vocal warmups Part 2: Knowledge aqurimentPart 3: Practice song phrases

16% 84%

usevoiceover20mSpeakloudlyorshriekEatpungentfoodDrinkpungentbeverage

Application of singing apps

What are the difficulties?

42 35 78 69 27

LackoftimelyfeedbackLackoftime reminder UnawareofhowtoprotectvoiceLackofarticulation detection Howtobetter performance

Findings

1. Most students have not realized the significance of protecting voice, and lack basic protection methods.

2. Mainly using microphones, online recording platform to sing.

3. Timely feedbacks and articulation practices are deficient.

People

Objects Environments Messages Services

CASE STUDY

5min 25min 20min

Emapthy mapping

he

Voice crack is so embarrassing! My throat hurts again.

hate my family for eavesdropping me during practice.

am worried about the vocal test for my hoarse sound.

listened to music through headphones.

talked with classmates on the latest popular songs.

More boys have raucous voice.

uploaded my practice video to the music teacher.

refreshed the page for reliable messages.

stay at school 5 days week, usually pracice songs in the evening.

closed my door to avoid disturbance.

touched my throat and my belly to correct articulation.

DO？

What dose he

watched vocal teaching videos on the weekends.

read theoretical books.

learned performance techniques by watching live show.

see the music teacher messaged me homework and the course file.

dose

Is there something wrong with me?

am upset by my performance.

hate heavy animations and garish colored UI style.

Anxious about the being mocked by classmates

Insulation from disturbance of family

Learning pressure and boring exercise

Teacher Student

Piano Whiteboard

Small classroom

Textbook Notebook

Recorder

Soundproof door

Review the last class Difficulties in finding the right articulation place

Wifi to play the original song Online chat File tranfer

Touching the vibration of neck and abdomen can help articulation correctly. Practicing at home is challengable in the absence of tutorial directions.

PERSONA

I am keen in vocal music, willing to invest time and energy in vocal practice.

By comparison, it can be deferred that functionss specially designed for protecting voices for teenagers are in need.

Online Karaoke Musical Excercise Apps

Record Songs

Training types

Sing only

Middle school student 13 years old

Experiencing voice mutation Chorus member

Expectations Pains Actions

Unaware of ways to protect voice

Correcting articulation timely

Wants/needs Measures of success

Confidence and encourgement in futhur study

Friends with common habbits

Mutual help and improvement in singing

Peer pressure

To learn and develop vocal skills

Protecting voice health

Lower down voice in practice

Use the product 3-4 times a week

Vocal practice

Voice protection

Lower octave Study

Vocal Protection

Record

Online Tutorial

Community

Simple guidance

Professional classes

Mainly for making friends

Both for social and learning LackLack

APP Functions:

1. A protection reminder for high pitch, excessive voice, and practice time.

2. Abundant vocal practice content and knowledge of sound preservation.

3. A community that helps each other.

APP Visual Style:

1. Be concise and avoid childishness.

By comparison commonly seen voice dampener, it can be deferred that functionss specially designed for protecting voices for teenagers are in need.

Soundproof Screen

BreathTrainer

Soundproof Mask Singing Dampener

AFFINITY DIAGRAMMING

In light of the former obsevation and research, the affinity diagram analyzes expectations, sense of use and needs.

Functions:

MOODBOARD

Soundproofing

Vocal skill guidance

Application scenario:

personal practice afterclass at home or in public

Painpoints:

Correcting articulation timely

Adjustability

Learn how to protect voice Mutual help

The functions contains two main relationships focusing on the user’s physical and mental health:

User & tutoring: gain feedbacks and direct instructions

User & surroundings: reduce the decibel of singing

Sense of use

convenience in carrying and cleaning simple and attractive appearance high quality

SKETCH

BreathTrainer

RENDERING

Sound Insulator

Sound-absorbing cotton

Adjustable opening to fit mouth shape

Portable AI Tutor

Data analysis and timely feedback

Simple shape and small size

Voice Health Reminder

Reminder of long time/high pitch/loud voice

Tips of how to protect

voice

Modular Component

Mountable handle, handheld or headworn Breath trainer belt

Brighter Orange Tint with Stronger Sound

Supplementary Belt

INFORMATION STRUCTURE

USER FLOW

Device function

Modular-designed Muter

Soundproofing materials

Modular-designed

Adjustable opening

Software function

My Learning Record

Learning schedule

Voice evaluation

Time reminder

Data analysis

Handheld or headworn Improvement

Voice-protecting Reminder

High pitch

Long using time

Loud sound

Voice Recorder

Hear myself in real time

Wire bone conduction earphone

Hear myself after sing

Mini-microphone on the bottom

Deep-Breath Instructor

Vibration notification

Pressure sensor

Vocal music training

Vocal techniques

Breath Rhythm

Sightsing

Ear-training Articulation

LOW-FIDELITY PROTOTYPE

Paper Prototype

Findings

Sing practice

Piano autoplay Classes

Online Community

Voice Protecting Online Help

Voice recovering tips

Sing practice

Q&A

1. APP functions can meet the needs of users and the switch of pages is relatively smooth.

2. During testing, users usually try to review the practice record. Add this data to the “Me” page.

3. “Plan Generation” function and visual hiearchy are complex and confusing.

TESTING

High Notes—Sound Wave Frequency

Loudness—Sound Wave Amplitude

https://www.youtube.com/watch?v=AaRLB0jFbmY Testing Video

Loudness—Sound Wave Amplitude

The “max valume”, set from 100 to 600 (approximately from 70dB to 90dB), was then switch to 80-480.

High Notes—Sound Wave Frequency

Incorrect Windowing or FFT Parameters

With a 5000 Hz sampling rate and 64 samples, the frequency resolution is around 78 Hz (5000/64). at least 78 Hz apart. If the sound signal has closely spaced frequency components, they might not be resolved accurately.

Resolution and Sensitivity of the Hardware

Subtle variations might not be captured accurately detected by Arduino board.

CHINESE

Chinese fortune telling is the act of predicting the fate of people. Throughout the dynastic periods, this activity has utilized many varying divination techniques.

SECONDARY RESEARCH

The Dystopian Divide of 2077

Interpretation

In 2077, technology is monopolized and becomes a tool for the ruling class to solidify social mobility. The world is thus solidified into two classes: the upper class and the lower class who can live in peace in a rich and fertile world.

An economical recession breaks the balence via unemployment. Superstitions became a spiritual sustenous among young people. Since they are unable to change the status quo, they turn to believe that efforts are futile, put their future in supernatural forces, and imagine changing their lives through superstition.

Physiognomy

Physiognomy is the art of discovering the facial features to show the destiny through qualities of mind or character by their configurationor expression.

55.5 44.1 51

Under 18 19≤age<2526≤age<30

Online only

Fortune Telling Experiences

The Eight Diagrams

Generally it involves taking four components of time, the hour of birth, day, month and year. It is form of Astrology as opposed to Fortune Telling or Divination, and tells one about his or her destiny in life, current situation and area for most successful occupation.

Never

Online & offline

Eight Diagrams 53.6% 39.6% 36.4% 21.4% 14.5% 31.5% 41.7% Contellation Reading palm/face Tarot Cards draw lots other Dream Interpretation Name testing

Not scentific at all, just for fun and phsycalogical comfort Perhaps reasonable and can bring good luck Not scentific at all, equal to superstition and need sanctioned Extremely easonable, and shoud be cautious about the prophecy 62.2 39.4 9.8 8.4 33.90% 37.82% 21.19% 7.09% Education love Career Wealth Health 35.4 50 18.1 66.2 40.7 27.6 25.6 44.6 57.3 24.4 29.3 34.1

Cost of Fortune Telling never Online Offline 0<cost≤50cny

50<cost≤100cny

1. Traditional Chinese fortune-telling is still popular among youth in their 20s, and the main techniques involved are Eight Diagram and physiogmoy.

2. Even though they do not totally believe the result, their wish for good luck through fortuen-telling.

3. When confronting intractable problems, some people are willing to pay much money for solutions.

100<cost≤200cny

200<cost≤500cny

1000cny<cost

reference：https://mp.weixin.qq.com/s/iBbuqHKaLLU5492HjdhYCg

The pre-Qin period

During the Shang and Zhou dynasties, bǔ 卜 (on the tortoise shells) and shì 筮 (on the stalks of milfoil shī 蓍) were used as a measure for "solving doubts".

Tang Dynasty

The modern society

In the Tang Dynasty, divination inherited the concepts of Yin-Yang and the five elements of the Han Dynasty and blended with Western astrology at the meanwhile.

The pre-Qin period

tIn the Spring and Autumn Period, Yin-yang and five elements theory were established.

Divination has been completely reduced to the activities of the bottom people, and at this time divination is often related to doctors and medicine. Sometimes it also leads to lawsuits and extortion.

Ming and Qing Dynasty

Today, the computer offers more convevient

Meanwhile, gene technology also through a scientific way.

1.Electronic witchcraft is a metaphysical cultural phenomenon with the nature of witchcraft derived from the virtual platform. It's a placebo to vent emotions in a stressful life in the entertaining and individualized atmosphere.

2.The popularity of fortune-telling is inseparable from the Barnum effect: fortune-tellers describe themselves in vague and broad terms which are gullible to people.

Relevant Vague Words: Barnum Effect

Psychologist Bertram Forer’s "fallacy of personal validation" experiment:

vague and general descriptions

qualifiers: at times, sometimes etc.

tendency to hear flattering words

ask 39 students to answer a quiz of personal questions

give a seemingly typed personality evaluation

each student received the same vignette students rate 4.3/5.0 for the accuracy of the result

PRIMARY RESEARCH

Action Observation

Customer

1. Go to a fortune-teller’s for solutions.

2. Pay for the devined items which can bring good luck.

Environment

1.Previous successful cases and photos with famous people.

2. Mysterious atmosphere filled with incense.

Fortune-teller

1.Speculate the customer’s job and worryings to gain the customer’s trust

Psychological Support: Placabo Effects

A sham medical treatment like sugar pills, saline.

Pain Points

The sham pill exhibits results placabo

neurons pain receptors

Helpless to change the status quo

Reap without Sowing

Desire for Control and Certainty

https://editor.p5js.org/Siqiiii/full/CxGlRtpWZ

Theoratical Analysis

Why do people trust fortune-telling?

6 9

Confirmation Bias

People often believe in fortune telling because it tells them what they want to hear.

Facts & Evidence

··

Placabo

Immersive Healing Installation

Evidence We Believe

Barnum Effect

Random Future Prediction

Reason: the recipient believes that it will work

bottle gourd: symbol of catholicon

ACTIVITIES ENVIRONMENTS

Meeting a fortune-teller to solve problems

Near a temple or hospital where the stream of people is crowded.

lotus: symbol of rebirth

INTERACTIONS

Text Source

OBJECTS

USER

points difficulties of an upset passer-by uses tools to predct ask for money to change fate

Cards, lots, the BOOK of Changes

Customer

OUTCOME

After pay for the service, the participant lies on the conveyor belt and will be sent to the scanning capsule.

2

During the scanning, the participant can see the figure analyzed upwards inside the capsule.

3

The scanning capsule is lifted and connected with the glass furnace. Incarnations appear at the top of the furnace.

The participant then is sent to the furnace. While standing on the lotus, they can see a bottle gourd hanging over a lotus base surrounded with projected reports.

5

The report is in fact generated by Ai based on the Forer’s Barnum Statements and the sentences assembed randomly, and the “catholicon calabashes” are scattered on the floor.

In this society, all the hopes young people pin on are only several lines of codes, which change nothing and will turn to furhur desperation.

https://www.youtube.com/watch?v=V2_xnzfnW8A

INSTALLATION DESIGN PERSONAL PROJECT 2023.11-2024.1

Comic Panel is the smallest narrative unit in a comic. Through the arrangement of panels, the writer express the story's ups and downs as well as the emotions. Then, what if the reading journey do not have to follow the author’s lead?

The “Narrative Ensemble” is a co-creation platform composed of a creation space and a VR zone. The participants will enter the creation rooms in the shape of comic panels to draw through physical movements. After the creation, the participants can go to the VR zone, set the artworks drawn by bodies, observe from frames in the zone, or change the shape of artworks. These motions breaks the traditional narrative continuity, weaving a narrative ensemble.

INSPIRATION RESEARCH

Comic books are like the magic rabbit hole which pull me into the world of comic panels where I follow the author to fill the gaps among the panels.

Then, what if the reading journey do not have to follow the author’s lead?

Narrative remains a significant element in the definition of comics by comic scholars associating with the original forms, paintings that are narrating events. As a direct and efficient way of narration, paintings gains popularity across cultures.

The Gestalt Principle of Closure

Why do we unconscously fill the gutter between seperate comic panels and connect them as a single story?

The law of closure states that our perception fills in the visual gap of incomplete objects by connecting key endpoints of each shape or figure,

Break the Law of Closure

As the law of closure is mainly formed through key endpoints of each shape or figure, the absence of these key points can interrupt the continuity of the incomplete shape as a whole, thus breaking the law of closure.

Potential for Stereotyping

Static

complication overlapped figure popsitive & negative space

Scene-Scene

absence regroup or transformation scale discrepancy overlapping or hiding color and contrast disruptive gaps disruptive figures

Subject-Subject

Closure in Comics

In comics, there are which allows readers fill the gap through their own body unconsciously.

Narrative Tradition & Body

Storytelling is our propensity to organise and interpret the world into narrative patterns in that homo sapiens are called homo narrans ('storytelling human').

Visual

MIND MAP DRAWING SYSTEM

Closurein Comics

LawofClosure

Inner Storytelling Nature

INTERACTIVE SPACE

into to draw through physical motions.

Stroke

The creating space is inspired by comic panels, where the participants can walk movement, and the shape can be affected via wearable sensors.

As a visualization of motions, the stroke reflects the speed, angle of the

Narrative&Body

The Power of Body’s Movement

Oral Written Trigger Inspiration

Interactive Spatial Design

Tutorial & Guidance

AR Interface

Modular Design Customization, preference

Conclusion

Physicaling filling in the gaps = a responsive adaptation to its own environment and also as a form of artistic creation.

The power of body’s movement in time give new meanings to the world

‘re-turn’ to where one has been or stood

Creation Modification

Transforming System:

Motion to Drawing

Arrangement System

TransitionsofComicPanles

VR recreation

The design of the installation

Modelling

Endpoint

Interface

Higher Speed

Lower Speed

Twisted Angle

Chosing Sensors

Setting Interface

Joint Selection

Relativity between color and sensors

Drawing Interface

Perspectives

Skin Temperature Sensor

Joint & Color

Reset

Finish Share

Hula, Hawii

Hula, Hawii

the Passover Seder

Bharatanatyam, India

Shadow Puppetry, Chinese Rakugo, Jaapan

Grasshopper Prototype

Connect all the circles into a curved surface

Create a circular plane and make the plane parallel to the Z axis Control

Press the Space Bar to Start

Record Vector Length

VR INTERACTIVE ZONE INTERACTIVE PROCESS

Diagram & Modeling

After the creation, the participants can go to the VR zone, set the artworks drawn by bodies, observe from frames in the zone, or change the shape of artworks.

Inspired by Roller Coaster, implying relaxation

An Upward Trend from Various Directions In Unity

The interactive process mainly covers two parts: creation and recreation.

1

The audience enters a room and wears AR glasses and motion capture equipments.

The audience creates 3D drawings by body motions while moving. 2

3

With VR glasses, audiences are randomly sent to a panel and place the 3D painting if they have drawn.

3D artworks

3D artworks affected by sensors Panel

The whole VR installation keeps being created and recreated, and can be viewed from any perspective. 4

Square Panel through which people can observe from in the zone

GENERATIVE ART

https://www.youtube.com/watch?v=ehrVJFqMCNM

Brief

Everlasting Volatility is an interactive project using text as a medium, exploring the process of readers' struggle with text. It is inspired by the reading experience of modern English poetry: semantics carry obscure words and abstract syntax flying in the poem, and readers struggle to move forward in the entanglement between the lines.

Letters, words, and sentences are intertwined with each other, and by changing the overall form of the poem to produce semantics and feelings, it highlights the visual nature of the poem and extends new semantics. The words fluctuate with the interaction,

THAT’S MY GREATEST CONFESSION! INSPIRATION IDEATION & SKETCH

During my undergraduate studies, I was exposed to reading assignments for confession poetry. Ambiguous images, equivocal meanings, and limited English proficiency made reading slow and anxious. The more apprehensive I became, the slower I could read.

Static texts seemed to have fluidity and life. They intertwined, jumped, floated, and squiggled, thus my reading process turned to a battle with the text.

RESEARCH

I attempted to catch the floating moment which reminds me of drowning in the sea of words.

Poetry is not the record of an event: it is an event.�

Robert Lowell

Confession Poetry

Confession poetry is a literary genre that emerged in the mid-20th century and is characterized by the poet's

Sylvia Plath

... as I sat there, unable to decide, the figs began to wrinkle and go black, and, one by one, they plopped to the ground at my feet. I am a collection of dismantled almosts.�

Anne Saxton

VISUAL DEVELOPMENT PROCESS

The development of layout and background stressed the concentration on the text and surrounded by twisted lines.

Font Typography

serif traditional modern print sans serif handwriting

I tested three lengths of poem and tried several fonts, ending up with the long verse version which could represent the interselected experience.

Poster Size

Canvas

MATERIAL EXPERIMENT

I made an experiment through distorted mirror and word strings to visualize the confusing reading experiences.

Modeling

INTERACTION EXPERIMENT

I applied ml5.js for handpose detection and the physics engine matter.js to mimic elasticity and gravity effect in p5.js.

Coding Prototype 1

Fix the ends of a line of text, and change the middle part with hand.

Coding Link

https://editor.p5js.org/Siqiiii/sketches/xqajoJiVY