Service Design Research: Using Sound Interaction to Reduce Screen Dependency among Users

Youtube Link

https://youtu.be/Mw2_bmulPj8

SERVICE DESIGN RESEARCH: USING SOUND INTERACTION TO REDUCE SCREEN DEPENDENCY AMONG USERS 2020.03-2020.06 Sound Yoga combines the elements of sound interaction and yoga, aiming to achieve light physical movement through auditory guidance, reduce screen usage before bedtime, and alleviate mental and physical stress.

Through Sound Yoga, users can engage in gentle physical movement, meditation, and relaxation without relying on screens. This provides a healthier and calmer option for bedtime preparation by integrating sound interaction with mental and physical well-being, offering a positive impact for individuals.

Individual Project Supervisors

Shuxin Cheng, Congliang Li, Lian Dai

01 BACKGROUND

02 PROBLEM DISCOVERY Environment

Causes of insomnia

3

1

shift work Screen addiction

blue light screen Social media

3,100,100,100

jet lag drug side effects

social media pressure

Psychology

62%

stream media

sleeping pills

alcohol

7/15

caffeine

Physiology sleep disorder

don’t relax

2

Adult

Population

high pressure

Disease

pregnant About 62% of adults worldwide do not get enough sleep.

About 3,100,000,000 people in the world lack sleep.

Seven of the 15 leading causes of death are related to insomnia.

Pressure

Individual

Conclusion There are many reasons for insufficient sleep, from the perspective of information input, screen addiction is a significant influencing factor.

03 PERSONA

04 USER JOURNEY MAP 7:00 PM

Yudi Wang 27 years old

Designer at Tencent

8:00 PM

Stages

Arrive home

Actions

Transportation

9:00 PM

10:00 PM

11:00 PM

12:00 AM

1:00 AM

Before sleep

2:00 AM

3:00 AM

4:00 AM

Insomnia

Dinner

Work

Exercise

Sleep

Phone

Social media

Stream media

Insomnia

Moderate exercise

Attempt to sleep

Surf the internet

Check social media

Browse streaming media

Gradually fall asleep

Fall asleep as soon as possible

Reduce browsing

Reduce socializing

Reduce browsing Go to bed early

Activities Feelings Happy

Introduction Yudi Wang is a 27-year- old individual working at Tencent.

Due to the high-intensity nature of her job, she often experiences insomnia.

Motivation

Confusion

She hopes to reduce her insomnia by decreasing her screen usage.

Unhappy

Sad

Experience

Complex commuting

Convenient fast food

Computer office work

Expectation

Comfortable commuting

Delicious food

Reduce workload Increase physical activity

She can’t fall asleep and ends up looking at screens.

Expectation She hopes to reduce her screen usage by engaging other senses.

Opportunities

Weaknesses

Weaknesses

Weaknesses

Weaknesses

Commute comfort

High-intensity work and ordinary life.

Frequent screen usage, browsing various media.

Endless recommendations from streaming media can easily lead to screen addiction.

05 SOUND INTERACTION

06 INTERACTIVE SYSTEM 1

Screen addiction

hearing

Lack sleep

decompress

Step 1

Hardware

Preset action

3d sound feedback

Speaker

3d sound guidance

3d sound guidance

motion capture

motion capture Infra-red projector

2

Sound A

Step 2

Sound A

Sound B

Sound B Infrared camera

1

Sound

2 Sound

Sound interaction

Follow sound signal

Sound direction

Exercise

Moderate exercise 3

Sound interactions reduce screen usage and alleviate both physical and mental stress.

Moderate exercise can relax both the body and mind.

Yoga

Step 3

3d sound feedback

1

audiovisual

left / right

2

volume

up / down

3

reverb

far / close

Conclusion The hardware system uses speakers to provide sound feedback and an infrared projector to capture motion for sound interaction.

07 PRODUCT DESIGN

08 HARDWARE SYSTEM

Sound system

1

Motivation

Depth sensor

Rear Sound

IR Camera

2

Side Sound

Ergonomic

Hardware Using a hardware system to capture motion and provide sound feedback.

Sound Yoga is an intelligent hardware and sof t ware plat form based on three - dimensional sound- guided movements.

IR Projector Center Sound

2

The goal of Sound Yoga is to use auditory guidance for light exercise, thereby reducing pre-sleep screen usage and alleviating pre-sleep mental and physical stress.

1

Clip-on

Motion capture

3

Sound feedback

Infrared camera

Sound Input

Speaker

2

Infra-red projector

Speaker

Lower jaw A

Sub Sound

Insomnia

Front Sound 3

7.1 surround sound

Sound

1

Gentle sound

Sound A

Sound A

B Yoga motion

Sound B

Sleep

Sound interaction To alleviate insomnia, gentle sounds are used to assist in falling asleep quickly.

Users are guided through movement using stereophonic sound A, and upon reaching the correct position, it triggers the appropriate sound B.

3

Conclusion Sound B

Motion direction is guided and feedback is provided t h r o u g h s o un d i ma g i n g, volume, and reverberation.

09 EXPERIMENT

01

10 PROGRAMMING

02

1

03

C# Script

2

Unity

3

Application

The application, based on the integration of Unity and Oculus, allows the import of Unity programs into Oculus to achieve three-dimensional interaction.

Simulation Sound

Experiment in Bed

Action Record

Way_Point Left_Hand_Guide

Q: How to simulate sound?

Q: Why experiment while in bed?

Right_Hand_Guide

Q: How to record trajectories?

Left hand

A: Simulating stereo sound using two mobile phones.

A: Creating a pre-sleep yoga routine tailored for high-stress single women.

A: Using time-lapse photography to capture light trails.

Q: How to provide feedback?

Q: How is the experience?

Q: Can it alleviate stress?

A: Using harmonizing tracks for feedback.

A: Resting the eyes to prepare for sleep.

A: Imagining brings a special sensation, stabilizing emotions.

Conclusion

It can relax the body and mind, but the sound clarity is lower.

Conclusion

Guided by feedback sounds, pleasing the senses.

Conclusion

Relieving the anxiety and discomfort of not exercising throughout the day.

Sound A

Right hand

Sound B

Using the Oculus left and right hand controllers, you can record the movement trajectories of the left and right hands.

Set sound position

Conclusion

Creating a 3D spatial audio trajectory using Unity’s waypoints. Setting relevant sound trajectories based on the reach of the left and right hands.

Implementing three-dimensional sound interaction through Unity and capturing motion trajectories using Oculus for providing feedback.

11 USER INTERACTION

12 USER EXPERIENCE

Sound interaction Users can edit soundtracks to achieve three-dimensional sound interaction.

1

Sound

Choose music Users can freely choose sounds and instruments to distribute across different audio tracks.

Select music

Select motion track

2

Excersice

Choose action Users can select the specific body parts they want to exercise.

Select action

Follow the movement

The audio tracks can change the s o un d d ire c t i o n ba s e d o n t h e relevant exercise route, allowing for targeted workout of different body parts.