MArch Design for Performance and Interaction (UCL) by C.Charlie

For UCL Design for Performance and Interaction

Zixuan Jiang 06/ 2020 - 05/ 2021

I designed some hotspots into physical books to stimute reader’ s interest and improve their comprehension.

INTRODUCTION

PROJECT 02

I designed an interactive installation to express the symbiotic relationship between humans and machines.

PROJECT 04

Zixuan Jiang

This module is the other project I did during my undergraduate and graduate. It can help you have a comprehensive understanding of my professional ability.

Phone: 19862145640 E-mail: ZixuanJiang.cn@gmail.com Education Shandong University of Art & Design Major: Art design Degree: Master of Arts

09/2018-06/2021

Research Experience Innovate a patent of packaging box

04/2021

Under the tutor’ s guidance, we invented a packaging box patent in April 2021. I was mainly responsible for patent material composition and model design. The innovation is that the packaging box with environmentally friendly material has excellent support when people use it many times.

Ai Tu Education Training School (Designer & Teacher) 01/2019 - 05 2020

Honors & Awards First Class Scholarship of 2016/2017 Academic Year First Class Scholarship of 2017/2018 Academic Year The Second Class Scholarship of Postgraduate Year

PROJECT 01

I designed a kind of interactive device to bridge the generation gap between family numbers.

PROJECT 03

I designed a device to help children learn language.

OTHER WORKS

PROJECT 1 Hotspot interactive non-fiction books The nonfiction book plays an important role in the elementary education. In recent years, many scholars emphasized the importance of the utilization of nonfiction books in elementary school classrooms, especially for students in lower grades. Reading this type of books can help students to acquire the analytical skills of information. However, the nonfiction books involve a quantity of specialized vocabulary and academic writing, which makes students with less reading motivation. Thus, less students are willing to read this type of books. Now, I will add some hotspots interaction into non-fiction books to handle this issue.

11/ 2020 - 05/ 2021

The questionnaire content

Background Many countries around the world are raising children to read nonfiction. The New York City government requires a 3:7 ratio of fiction to nonfiction in the school library system.

TARGET GROUPS Develop logical and thinking skills

NO NFUCTI O N I M PO RTANCE

Future career interest cultivation

70.8% Conducive to interdisciplinary learning

Better understanding of the world

SURVEY

Lack of pictures It is difficult to understand the text Make the reader feel bored

INTEREST

The survey found that while non-fiction was less popular than fiction, children were still interested in non-fiction, especially popular science books.

DATA

Too many professional words

TYPES

Grade 12 Grade 8

70%

Grade 4

20% 22%

50%

26%

Most of the popular science books currently read by children are extracurricular readings. This provides direction for my choice of types of books .

55% FICTION Average reading difficulty

For the convenience of the survey, I targeted primary graders. Combined with field survey and network questionnaire survey, collect relevant data.

23%

77%

In-class reading

extra-curricular reading

READ TIME

The content is too long It's easy to lose your reading patience Easy to cause reading fatigue

NONFICTION

8.5

5.7

Interesting

Average reading difficulty Interesting

Number of Readers

Questionnaire survey

Ideal data

Reality data

Student nonfiction reading falls short of NAEP target The number of children actually reading is far lower than expected

information books as the representative of non-fiction books

Online questionnaire survey

Field questionnaire survey

Through the online survey, we collected 93 questionnaires from primary graders from various provinces in China, making the data more accurate.

10.7%

Through interviews and surveys of primary school students in Beijing, and asking them to fill in about 20 questionnaires, more real data were obtained.

42.8%

32.2%

14.3%

Why do most reader spend less time reading?

The proportion of children with different reading hours

The solution After investigation, it is found that less children like plant books, as shown in Figure 1. Therefore, we use it as a research topic to find ways to increase children's interest in reading.

scan QR code

Too many specialized words without explanation

Reader suggestions Plant text Chemical text

4% 10%

Mathematics text

18%

Physical text

20%

Geography text

22%

Historical text

36%

FIG. 1

Add more vivid illustrations

Incorporate some storyline

35% 20%

Join animation

18.3% 10%

Add detailed notes

Add voice

11.7%

Easy to understand language

FIG. 2

CONCLUSION: Based on the above research and analysis, this project takes plant books as the design object. Use projection technology and hotspot to incorporate interactive elements such as sound and dynamic pictures into paper books. Create a new reading experience.

Mind Map

Illustrations drawn Condition

Reasons

Solutions

Experimental Books

Technical Support

Situation Both schools and teachers are encouraging primary graders to read more non-fiction books

My project

Because 1. Develop logical and aritical thinking 2. understand the world better

I use colored pencils to draw illustrations.

Software

PS many academic vocabularies

Informational books (The most common and important type of non-fiction books in

be lack of interest

Stimulate readers' reading motivation by adding some hotspots

primary school)

Illustration Design 1

Illustration Design 3

Illustration Design 4

Illustration Design 5

Illustration Design 6

Display of books

I use Illustrator for layout

Book Exhibition 1

Book Exhibition 2

Book Exhibition 3

Book Exhibition 4

Book Exhibition 5

Book Exhibition 6

Interactive Projector (Hachi) Concept Books

AE Biography

However

fail to understand

Procedural Texts

Unity 3D

The reading of non-fiction books are far less than that of fiction books

Sketch Design

Cover Design

Interactive Content Design 1

Interactive Content Design 2

Interactive Content Design 3

The sketch shows the idea of the book layout and the idea of interactive dynamics.

The making process of interactive hotspots

Using Photoshop to mark out the interactive areas

We designed hotspots on the “pine nuts” by giving Polygon Collider 2D and gravity effects. “Pine nuts” can drop when people touch them.

I created an object below the “pine nuts” and added the Box Collider2D effect. When readers touch “pine nuts”, it can catch the falling pine nuts.

After the "pine nuts" fall, they can disappear after seconds and reappear in their original position.

By using Unity to create various hotspots Generating hotspots to turn pages by writing program

Generating hotspots to turn pages by writing program

Using Photoshop to mark out the interactive areas

Creating a button on the “persimmon” as interactive hotspots

writing program control the growth of numbers

Writing program control the growth of numbers

Importing those pictures into Unity to make animations

Using Photoshop to design some pictures about animations

Scenario Building

Hachi Projector

Infrared cameras capture information Color camera

1. Using Photoshop to mark out the interactive areas 2. Using Unity to add hotspots 3. animations can be activated by touching picture

Project color picture

Using Photoshop to design some pictures about animations

Infrared camera

1. Using Photoshop to mark out the interactive areas 2. Using Unity to add hotspots 3. animations can be activated by touching picture

Importing the pictures into Unity to make animations

Export the file in APK format

Pick up the finger area signal

Physical book

Interactive effect display Interaction01

Interactive Content

Using Photoshop to design some pictures about animations

Importing the pictures into Unity to make animations

Touch words could watch the corresponding pictures.

Interaction02

Interaction03

As shown in Pictures 02-03, the reader touches the “persimmon” (hotspots) to activate the dynamic chart about the nutritional elements of persimmon, which makes it easy for readers to read information intuitively.

As shown in Pictures 02-03, readers can see the structural analysis of the flower by touching the flower (hotspots).

Pictures 04-06 show that when readers touch the hotspots, they can see the difference between astringent and sweet persimmon, which helps students acquire information quickly and clearly.

Pictures 04-06 show that readers can watch an animation about photosynthesis by touching the leaf (hotspots), which helps the reader understand the theoretical knowledge easily.

User experience

Interaction04

VS Group A

Group B

Fill in the IMMS (Reading Motivation Scale)

C R on Sa A ele fide tis tte van nc fa nt ce e ct ion io n

C on fid A Sa Rel tten enc tis eva tio e fa n n ct ce io n

NO HOTSPOTS

WITH HOTSPOTS

Conclusion

As shown in Pictures 02-03, readers can watch animation related to pollination by touching flowers (hotspots) rather than just reading words, which can make it easy for them to understand the theory intuitively. Pictures 04-06 show that readers can learn the practical value of the baobab by touching the patterns of the tree (hotspots) to browsing animations rather than just reading some words.

To explore whether interactive nonfiction books could promote students’ reading motivation or not, we recruited 20 first-grade primary school students as experimental subjects in Zhongxin primary school and divided them into 2 groups. GroupA and group B have 10 students respectively. We chose a plant book called Remarkable Trees to embed interactive hotspots. After that, we made sure that they had never read the book. Then, group A read the interactive physical book, and group B read the ordinary one with the same reading content for 15 mins in class. Next, they would fill in the reading motivation scale called IMMS. Use the following values to indicate students response to each item. 1 (or A) = Not true; 2 (or B) = Slightly true; 3 (or C) = Moderately true; 4 (or D) = Mostly true; 5 (or E) = Very true. Finally, through comparing, we found that interactive nonfiction books can promote students’ reading motivation.

PROJECT 2 Ease the generation gap between family members Currently, due to the increasing age difference between family members, generation gaps are prone to occur in communication. This will lead to a series of family conflicts, thereby affecting family harmony. This project aims to find the main reason for this phenomenon through investigation and data analysis, and to solve this problem by designing an interactive product.

06/ 2020 - 08/ 2020

Background investigation

What will they do in a day?

Some real cases:

Children Adults

30-30YR

FAMILY MEMBERS

THE GENERATION GAP BETWEEN

10-30YR

Due to busy work, parents do not have enough time to accompany their children and lack of understanding of their children, leading to the generation gap.

20-40YR

30-30YR

30-70YR

Adults Elderly

In life, conflicts between parents can also affect their children, causing them to alienate their parents and create dissatisfaction and generation gap.

Chinlren Parents

Adolescents Adults

Adults Adults

There will be some quarrels in life between parents and children due to different education levels and different ways of thinking.

Due to the busy work, the husband and wife have less time together, and lack of communication and mutual understanding, which leads to the increasing conflicts between them.

Due to the different social environments between the elderly and young people, they lack common topics and cannot consider issues from the standpoint of each other, resulting in a generation gap in communication.

Personal information

Name

Dawson

Ms.Liu

Age

Job

Student

Job

Student

Job

White-collar worker

Job

Retiree

Status

Bei Jing

Status

Bei Jing

Status

Bei Jing

How long do you spend with your family in a day?

About 4-6 hours

About 2-3 hours

About 1-2 hours

Little time

What will you do together?

What will you do together? Have dinner together Cook with my family Go shopping

What will you do together? Chat Watching TV

What will you do together?

Have dinner together Watching TV Go outing on weekends, but a few times What do you usually do during the rest of your time alone?

What do you usually do during the rest of your time alone? Go to class Cooperate with classmates to complete some course assignments Watch movies and go shopping with my classmates

I spent most of my time at school. Even at home, there's a lot of homework to do. Only a little time to have fun, such as playing games or playing basketball with classmates.

Have dinner together Watching TV

Take a walk What do you usually do during the rest of your time alone? I spent most of my time working for the company. I go out in the morning and come back in the evening.

Chat

What do you usually do during the rest of your time alone? Listen to the radio Read the newspaper or watch TV Buy vegetables Cook a meal Chatting with a neighbor

First, the survey content of four survey subjects of different ages is shown. Then I presented their time together and alone time in a day with graphs.

SCHOOL

65-80YR

Have lunch at school

LESSON 42%

15-25YR

HOME

STAY AT HOME

58%

Have lunch with the family

COMPANY

WORK

Have dinner at school

LESSON

LEISURE TIME

36%

Conclusion

Mr. Chen

25-60YR

With the development of society, the generation gap between family members began to increase. This is a universal problem worldwide. So, what is the reason for this phenomenon? How can we solve them effectively? Next, we will randomly investigate some family members and analyze the reasons through some actual cases.

Ms. Mao

Age

42%

Have dinner with the family

21%

Have lunch at company

64%

WORK

HOMEWORK 92%

STAY TOGETHER 65%

Have dinner at company

KTV, BAR

89%

EVERYDAY CONCLUSION: It is clear from the analysis that family members of different ages are spending less and less time together.

SLEEP

The elderly

Questionnaire Analysis

Depression

Adolescent & Young people

Control study time

20%

3 Control entertainment

In many families, children's study time is controlled by their parents. Parents want to reduce their children's playtime and increase their children's study time.

To o m u c h control, causing family conflict.

Parents control their children's enter tainment. For example, in order not to affect their academic performance, they are forbidden to play video games and watch movies.

Parents' strict discipline of their children for a long time will cause mental illness. Such as depression and anxiety.

Parents & Family

GENERATION GAP

Lack of mutual understanding

22% 25% 45% Happiness

Normal

Miss

FIG.1 Emotional survey of the elderly

Increase

FIG.2 Survey of prevalence Increase

CONCLUSION: The survey of nearly 30 elderly people found that their children have fewer opportunities to stay with them due to work or study. They will feel lonely. As shown in FIG.1. After a long time, some old people will not understand them, and there will be a generation gap in communication. Some relevant data shown that chronic loneliness in older adults also increases their risk of disease. As shown in FIG.2.

Different values Different lifestyle

Lack of time for

company

Lack of family activities

40% Depression

Lack of common topic

S The presure of life

Cancer

Icon design

GENERATION GAP

Lack of mutual understanding

Lonely

Control daily life Some parents control their children's daily life and diet. For example, ban some junk food.

CONCLUSION:The survey found that more than half of parents are strict with their children. Especially in study, entertainment and so on. This is not only bad for the development of children's mental health, but also causes conflicts and generation gap between children and their families.

Lack of common topic

Company

18%

Hypertension

GENERATION GAP

Lack of mutual understanding

The presure of work

Lack of mutual understanding

R:255 G:123 B:215 R:34 G:134 B:255

GENERATION GAP

CONCLUSION:From the pressure of life and work, parents have little time to spend with their families. Over time, there will be a generation gap between families due to the lack of communication.

Design concept: Use my English name as the logo. Logo overall with the mellow outline to show, give a person a sense of visual affinity. Use red, blue color collocation to show the sense of science and technology products.

UI interface sketch

Product model design Appearance design

Home Screen

Picture

Video

Call

Data Analysis 1

Data Analysis 2

Data Analysis 3

In plan B, I got inspiration from the shape of pebbles. Holding the product in this shape with your hands can effectively relieve people's life pressure. The design of the curve on the surface of the product is inspired by the natural pattern on the cobblestone. I try to combine the natural elements with the product.

Models design 01

Holographic projection function

Model 1 Top

Model 2 Left

Model 3 Right

Model 4 Back

Models design 02

Top

Profile

Detail 01

Detail 02

The product can record image information and share it in family groups. Family members can project these images through the holographic projection function to achieve cross-space companionship.

UI interface design 1

50%

STORY

Hello,Friend!

Password

Recent User image

View recording image

Recent

Enter your personal details and start journey with us

Basketball

My school life

Image of family members

Zixuan Jiang

One month ago

Collection

Brithday

Remember the password

Winter Snow 2

The Bar

Friends 30% 662items

50%

View the image

Group chat

Switch call interface

Winter Snow 1

Landscape The Sea

Other...

Campus Scenery

Yo u c a n v i e w other information by swiping the image.

One week ago

Forgot your password?

Automatic login

50%

Home page

or use your email account

50%

Typing new message...

Sister

50%

Brithday

Sister

Yo u c a n s w i t c h contacts by sliding pictures.

How are you doing, brother? Me

Everything's all right, sis. Are you busy with your work these days? Take care of your health! Mother

Did your IELTS scores come out two days ago?

12:14

Contact

Yeah, finally passed 01：18

Holographic projection

10：00

Projected video information

UI interface design 2

50%

Edit

Image Information

Notifications

98% Data analysis

26% 23%

obtains data through facial

1 week

and body movement

2 weeks

3 weeks

Happy Depressed Resentment

1 min

Your daughter has been under a lot of pressure at work recently, which leads to occasional insomnia.

20% 80% 94%

45 mins

Your mother has been in good health recently.

4 weeks

The curve of conflict between parents and children

analysis, and sends the

Yo u r c h i l d h a s b e e n u n d e r p re s s u r e recently, so I suggest you go on vacation together next weekend.

Send a message to parents

72%

Conflicts

The product automatically records user images,

results to family groups through messages to enhance mutual understanding. If the results are

50%

Your father is doing well these days.

View the data

negative, the system will give appropriate sugges-

User image interface

tions and solve it through the mutual help of family members, so as t o inc re a s e t h e t i m e o f company with family.

Data analysis interface

50%

Receiving information interface

50%

Edit

Image Information

Physical and psychological changes of the elderly depression

Data analysis

Notifications

Send a message to other family members

company

Your father has recently shown a strong sense of loneliness. I suggest that you and your children can visit him this weekend.

6 mins

lonely Exercise：Decreased by 50% Appetite：Decreased by 60% Sleep：Decreased by 55%

Your daughter has been under a lot of pressure at work recently, which leads to occasional insomnia.

1 hour

Your son has been in good health recently.

happiness

Your father is doing well these days.

One month ago Now

View the data

miss

User image interface

Data analysis interface

Receiving information interface

Product renderings Product front and back display

Holographic projector

IR Camera

Microphone

R:226 G:218 B:239

R:239 G:239 B:239

R:255 G:237 B:161

R:179 G:214 B:244

(Sound collection)

Depth Sensor IR Projector

Depth Sensor IR Camera:

IR Projector :

Holographic projector :

Take color images within the Angle of view, analyze the infrared spectrum, and finally create depth images of human bodies and objects.

The host casts near-infrared light on rough o b j e c t s o r t h ro u g h g ro u n d g l a s s , f o r m i n g random reflection spots called speckles. It can then be read by an infrared camera.

It will record and capture the image information in the form of video projection.

Surround sound

360 degree image acquisition and projection

Loudspeaker

Loudspeaker / Microphone

Data analysis 1

Wireless charging

Infrared induction

The system carries out background data analysis according to the collected image information.

Useing-scenario

Cross-space companionship

Enhance mutual understanding

I was on a business trip recently, and you have to listen to Dad at home. You should eat less snacks. Okay, mom. look at your face a little haggard, you must pay attention to your body.

Image collection

Projected image Information sharing

When parents know that their children face enormous learning pressures on a daily basis, they will be aware of the need to give their children proper relaxation and not interfere too much with their children's entertainment.

The holographic projection function allows mother and child to chat face-to-face at any time.

Dad, we will visit you in two days. How is your physical condition recently? Okay, mom. You must pay attention to your body when you are outside.

Grandpa, I miss you! How is your health recently? Hello, grandpa!

Image collection

Projected image Information sharing

When parents learn about the work pressure their children face every day through holographic images, they will begin to understand her and tell them to take care of themselves.

Although children are not with their parents, they can still accompany them.

PROJECT 3 Symbiosis between human & machine Compared with the past few years, people are living more and more dependent on machines. Mobile phones, ipads, computers and so on have become the necessities of this era. With their help, our life becomes very convenient, which also makes our life valuable and meaningful. A symbiotic relationship between man and machine is unknowingly established.

08/ 2020 - 09/ 2020

Inspiration

Mind Map FIRST PART SECOND PART Human

The machines has brought great convenience to people's life. In some ways, machines are gradually replacing people.

Machines that solves needs

Video conference

ing

Game machine

In my opinion, machines also do things according to people's wishes, and they rely on each other.If we balance this symbiotic relationship, machines could bring us emotional sustenance. For example, you could have a robot girlfriend in the future .

Creation concept

Learning products

ipad

Office products Household appliances

vac cle uum ane Air er r an cle microwave oven

Cook a meal

Sweep the floor

entertain- listen to the music ment see a computer movie games

eo er

juicer

ole

DVD a

tor

jec

pro

MACHINE

To be used (symbiosis)

Create

HUMAN

Entertainment equipment

LED electricity

Sketch

signal

circuit element

Information network

geographic

whole world

The rope

Evolution of Sketch Design

Crystal LED

The crystal shape Information network

A human finger can trigger an LED to light up.

The hexagonal pyramid is the shape of device, and the inner coil represents the information network.

Interact with fingers

Power supply

LED

Information network

The shape of the device is changed to a symmetrical six pyramid and fixed with mud.

The wire

Information network

The human finger can trigger the LED to produce brightness changes.

Mud

tube

In the future, humans may be more dependent on machines than ever before. People left the machine, may encounter more unknown difficulties. Without human use, machines lose their value. In the end, there is an emotional connection and dependence between the two. In this installation, when humans and machines get close to each other, the symbiosis produced by their mutual influence is the focus of this work.

clothes

phon

Multimedia classroom

life Wash the

Head

ng hi ne as hi w ac m

Some people think that when robots take over human functions, it means that humans will have almost nothing to do. If this trend continues, what will humans actually do? Will human beings be replaced by machines of their own creation in the future?

crystal

man-made

printe

HUMAN

Machine girlfriend

xm pr ac Mobile hin e phone r e ut p m co

Computer Video office conference commuting

work

Symbiosis is a more accurate ter m to describe the relationship between humans and robots.

Industrial robot

future wisdom

er int fa

Online go to classes learn- school read

Robots cook meals

Device shape and components

c fan tric

Use the iPad to Learn

Robotic surgery

Human needs

Ele

Agricultural robot

THIRD PART

Finally, it was decided to hang the device with thin wires to create a sense of mystery and technology.

The symmetrical shape makes the device a bit stiff. Therefore, at one third of the total height, the device is divided into two parts.

Board

Arduino mega: write code, control circuit

Put a wooden frame on the outside of the device and hang it. A hole is cut at the top and bottom of the device, and the internal LED wire is connected to the external power supply through the hole. The circuit is controlled by Arduino and resistance.

Model

Inductive Circuit Place a sensor (TCRT5000) next to the hole. When a finger is inserted, the sensor will be triggered and the LED will produce brightness changes.

After repeated deliberation, it was found that the action of triggering the sensor by hand was too deliberate. Therefore, the redundant holes on the model are eliminated, and multiple ultrasonic sensors (HC-SR04) are used to control several LEDs in different orientations. When a person walks into the device, the sensor will control the LED to produce brightness changes.

TCRT5000 HC-SR04

Plan A

Plan B

Write the code Get the best induction distance

Render 1

Render 2

Leds on the device emit a faint light when no one is near.

Different perspectives

Test the Echo value and The data of Serial Monitor the corresponding optimal induction distance The optimal induction distance is 2

meters

Render 3 When someone approaches, the LED lights will randomly produce different levels of brightness.

Production Process

Parallel Circuit

Circuit design

Write the code

Connection

3 Induction test 1 Orange led Induction test 1 Blue led

Write the code

Circuit design

Connection

CONCLUSION: As the obstacle approaches, the LED will produce brightness changes in turn. Thus, in the device, several leds controlled by the same sensor can produce brightness with varying levels.

Finished Version Display

Application scenarios

ENERGY

The rope

HAPPINESS WISDOM FREEDOM

ENTHUSIASM

Information Network

Sensing range: 2 meters

HARMONY

SCENARIOS 2

LED

CONCLUSION:Lights in the device turn on when a person approaches, and vice versa.It expresses the interdependent relationship between man and machine.In addition, we came up with this idea.The device can measure a person's emotion, and then use lights with different color to represent different person's emotion. The picture on the right shows the concrete idea.

GROWTH

WISDOM FREEDOM

SPIRITUALITY IMAGINATION

SPIRITUALITY IMAGINATION Sensing range: 2 meters

COLOR PSYCHOLOGY

Crystal

SCENARIOS 1

EXCITEMENT

PROJECT 4 Smart toys to help children learn language The smart toy can convert three sound modules to communicate with children aged 0-2, 2-6 and 6-10 to promote their language learning. At the same time, the product incorporates some interesting designs and remote operation functions, allowing children to improve their language skills during entertainment.

09/ 2020 -11/ 2020

Mind map

Background investigation

Universal Phonetic Discrimination

Factors influencing children's language development

Vocabulary

Simple eg. Dadda\Mamma(150-200words) Morphemes:2.91understand concrete words

LANGUAGE

0-2YR

Hungry Thirst Cry Go to the toilet

Physiological needs

VOICE

Psychological needs

The elderly will have a poor pronunciation and usage of some words, which will hinder the improvement of children's language ability.

Children & Single parent families For children in single-parent families, the child's intonation will only be affected by one of the parents, which is not conducive to the normal development of intonation.

Children & Normal families

When children communicate with their parents, it is beneficial to the develo p m e n t o f c h i l d re n ' s intonation. Parents can also guide their children to mispronounce and use words.

Children & Teachers

Because of the large number of students, kindergarten teachers a re o f t e n u n a b l e t o ensure that every child has good language development.

The sentence structure

LANGUAGE

2-6YR

childish voice

Good

Normal

Companion Time of Average Per Day

310Hz

Willingness

350Hz

Acceptance

attributive clause, adverbial clause, apposition clause，etc.

2-3hours

solve and improve

eg: Whether you believe it or not, it’s true. The robot should talk to a child with adult's voice.

Children’s amplitude and frequency of the sound began to approach that of adults. have strong ability of Imitation of sound and language

Research Children's Language Development Survey Concrete vocabulary

6-8hours

Use logical words in your sentences to Improve the ability of children's

Children start to have logical thinking, but the expression is not accurate

VOICE

teach some simple sentences with abstract nouns and gradually add some compound sentences eg: That math problem is a bear. Robot's tone of voice

Frequency:310.4Hz-364.2Hz

The sentence structure

Survey

Bad

solve and improve

(10,000-15,000 words) Morphemes:8.5 understand logical words such as, because, but, although

Vocabulary

6-10YR

The robot speaks with children in a slow and high pitch to improve their language acceptance.

subject+predicate ; subject+predicate+object, etc.

the effect of frequency on mood

Survey

LANGUAGE

Bad

Flat voice

The vocal cords are immature. Children of this age speak slowly and softly. VOICE

Children's Language Development

uh、oh

eg: shoe, book, apple

Vocabulary spurt(900-1,000 words) Morphemes:5.14 understand abstract words lack of accuracy of expression

Vocabulary

My Project

Woke up to find mom not around(Insecurity)

solve and improve

Slow speech rate have more acceptable High pitch can improve children's attention

Survey

Children & Grandparents

teach some concrete vocabulary low morpheme words

Strong voice（Lack of vocabulary to express their intention）

6-7hours

Concrete vocabulary

Abstract, vocabulary

Logical expression

Concrete vocabulary

Abstract, vocabulary

Logical expression

Abstract, vocabulary

Logical expression

Conclusion Based on the above survey of the current situation, this project intends to design a toy that can interact with children and accompany children to communicate during entertainment. The toy can not only switch the sound mode , but also choose different difficulty vocabulary and sentence structures for children of different ages, thereby effectively improving children's language ability. I set the target populatio n as children aged 0-10. In the following data analysis, I divided this age group into three different stages and summarized language skills that smart toys should focus on . I have studied the effect of sound waves on children’ s language acceptance and applied them in products.

Compound sentence

Simple sentence

0-2 years Have the ability to learn concrete words

Compound sentence

Simple sentence

2-6 years Need to improve language expression and the use of abstract vocabulary

Compound sentence

Simple sentence

6-10 years Lack of logical expression of language

Conclusion By investigating the current language skills of children of different ages, we can find out the reasons for their slow language development, so as to formulate effective solutions.

How does sound affect a child's language development?

Density

The sound waves to cry:

Wavelength3

Amplitude3

Density

0-2YR

6-10YR Child sound wave: At this age, children begin to imitate

Physiological needs： hungry or thirst

the sounds and tones of adult

Time

speech. The sound waves as they

They can't express it in words.

Time

speak begin to resemble those of adults.

Frequency: 441.8Hz-502.9Hz Density

Frequency:260.4Hz-323.2Hz

Child sound wave: Babble Psychological needs： eg: He wants to see his mother.But they can't express it in words.

Wavelength1

Amplitude1

Conclusion

6-10YR

Adult

The amplitude and frequency of children’ s

Time

voice become closer to that of an adult and began to imitate adults. They begin to use

Frequency:336.9Hz-389.3Hz

logical words when they speak.So smart toys should talk to a child with an adult's voice .

50Hz

100Hz

150Hz

200Hz

250Hz

300Hz

400Hz

450Hz

Get a child's attention

Adult

Elderly

350Hz

Sound waves with frequencies between 350 hz and 400 hz are effective in attracting children's attention and helping them learn language. The wave frequency of a child's voice is in this region. However, the frequency of normal speech in adults and the elderly is much lower than this range.So, we should imitate the baby's voice and talk to them.

Density

2-6YR Child sound wave: The amplitude and frequency of child’s voice gradually increase and decrease respectively.

Fear

Anger

The Elderly 100Hz

150Hz

Courage

Amplitude2

Smart toys should communicate with children aged 0-2 with slow speed and high-frequency sounds. In terms of v o c a b u l a r y, choose concrete nouns rather than abstract vocabulary.

Wavelength2

Frequency:310.4Hz-364.2Hz

Neutrality

Willingness

Acceptance

Reason

250Hz

310Hz

350Hz

400Hz

Human Emotion Vibration Analysis Frequency Ranges

20dB

30dB

40dB 0-2YR

Time

Adult 200Hz

10dB

Conclusion:

Conclusion We should continue to imitate the voices of 2- to 6-year-olds and talk to them. Because this kind of speech sound wave frequency can make a person more willing to accept.

50dB

60dB

70dB

2-6YR

Decibels of speech at different ages

Sketching Top

Front

Design Specification The product is modified based on the shape of the flying saucer. The bulging rubber is added to the smooth outer surface, which can not only prevent collisions, but also attract children with a grotesque appearance. In addition, when the product re c e i v e s p re s s u re from different directions, it can deform to increase interaction with children.

Profile

10cm

4cm

10cm

When pressure is applied from different directions, the shape of the product will be deformed.

Rendering

Choose different learning modules

11:00

Structure analysis

Click the arrow to the right of each module to see the key points of the module.

Carrie Some kind of deformable material

Loudspeaker

Improve language skills in entertainment

11:00

Carrie

(Shape Memory Natural Rubber)

0-2YR

SELECT MODE

Prevent product breakage

Concrete Words: Abstract Words: Simple Sentence:

Language Learning

Keep the product upright at all times

Scan and record the surrounding environment

35%

20%

Concrete Words

Abstract Words

Simple Sentence

phenomenon hospitable statistic regularly banana particularly February

Interactive Control

Error-prone sentence patterns

Data Evaluation

Rubber ball

43%

The box is too heavy for him to carry. Each of the boys has a pen.

6-10YR

Let the product move freely

Home page

UI design

11:00 11:00

11:00

The product's camera can share the image information with the phone. The product displays the coordinates by scanning the floor plan of the house, and controls the movement of the product with buttons on the screen, so as to interact with children in games such as hide-and-seek.

Parents can connect with the products through mobile apps to interact with their children's games and check their language learning status.

a1ccff

9fb6ff

9e97ff

ab8dff

9999ff

Data Evaluation

Your Child Vocabulary

6,000

concrete words

5,000

abstract words

1,000

Learning Initiative

11:00

Welcome to Carrie!

c5c5ff

JUN 2020

VOICE:

Account Password

The video quality(If the operation of catton may be appropriate to reduce the quality.)

Forgot your password?

Smooth

Equilibrium

Original

Vivid

JUN 14

JUN 15

JUN 16

logical word

Basic

JUN 17

Oral Expression Ability

Image quality

Gleam

20 sentences

Food PL1 abstract words

The screen brightness

22% 30% 48%

concrete words

40% Movement speed

The lens sensitivity 62 %

1,000/2,500

Mispronounced words

2-6YR

Parent-child Interaction

Low center of gravity Camera

Vocabulary

Completion of each item Edit Photo

SMNR

6-10YR

Aaron

The shape of product can change by forces from different directions.

LED

Learning Tasks

Choose the right learning module for your child.

50%

Video screen control Control key sensitivity adjustment

Visual data feedback of language learning

Useing-scenario Conversication

Improve sleep

Remote control

OK!

The camera feeds back image information in real time.

Hi,Carolyn! Let's play a game!

The product emits light yellow light at night to improve the quality of children's sleep.

The mobile phone can connect with the product through Bluetooth, so as to control the movement of the product, chat with children and interact with various games.

Conversication

Interactive games

Hi! Hi,friend! Hi,baby!

Hi,Lucas!

Model design by using MAYA

Other Works This is the other project I did during my undergraduate and graduate. It can help you have a comprehensive understanding of my professional ability.

Create the model

Model refinement

Detail 01

Detail 02

Detail 03

Render scene setup

Render 01

Render 02

Finish

Model rendering by using MAYA

Poster Design

Packing Design Design description: The water used to brew Tai Shan Original Beer flows through the Taishan Mountains. The taste of beer is closely related to the terrain. Therefore, the package is decorated with a contour line of mount Tai. Some cultural elements from Mount Tai were added around the logo as fillings.

Oil Painting Design description: People destroy the environment for profit, resulting in negative effects such as reduced production of food.

LOGO Four Chinese characters ‘tai ’ , ‘shan’ , ‘yuan ’ , ‘jiang ’ h a v e b e e n re d e s i g n e d t o express a sense of flow.

Oil Painting

Finish

Design description:

‘Vote’ , ‘coin’ , ‘lantern’ and ‘book’ that are integrated into four Chinese characters express the ‘democracy’ , ‘prosperity’ , ‘harmony’ and ‘civilization’ respectively. Meanwhile, this is also the Chinese meaning of these four characters- ‘zhong’ , ‘guo’ , ‘jing’ , ‘shen’ .

Four characters ‘F’ , ‘A’ , ‘K’ and ‘E’ form one face to represents people who want to spread fake news to get profits.

Oil Painting04

Painting is one of my favorite ways to relieve stress. I prefer to draw some oil paintings to kill my spare time.