PENG ZIHAN 's Personal Portfolio

PENG ZIHAN

PORTFOLIO 2017~2021

PENG ZIHAN

DESIGNER

Taiwan Shih Chien University Communications Design 2017~2022

EDUCATION

Tel: Email:

(+86) 15067436879 pengzihan1998@gmail.com

2021

Curator

CONTACTS

EXPERIENCES

2021 Conation Graduation Exhibition 2019

Director & Technical Support

2019 Shanghai-Taipei Communicate Workshop 2019 Shih Chien Design College International Workshop 2018

Technical Support

2019 SCCD International Workshop

CATALOG CONTENTS SKETCHING

HEALING SOUND

AUTOMATED SHARED TABLE

Interactive Installation Art

Sound Design

Service Design

Using machine learning and image processing technology, let the painting robot accompany beginners to sketch outside together

Using human physiological data to design sound and extend it to the field of medical rehabilitation to help patients better enjoy the process of diagnosis, treatment and rehabilitation

Designing a set of concept mechanisms for the automated shared table to enable vulnerable families, catering services, and government welfare agencies to jointly overcome the predicaments brought by the epidemic

HOLO-CARE Conceptual Design

BRAIN MOTION UI Design

Boldly imagined that the future holographic projection technology would help the emptynest elderly better integrate into modern society and establish a digital museum about the elderly living in their later years.

Speculative Design

UI Design

OTHER WORKS UX Design

By speculating and criticizing the current application of brain-computer interface in the education field, I proposed and redesigned a new set of solutions to achieve the purpose of interactive distance learning and teaching

These are my creations and explorations in different design and new media art fields in the form of group cooperation from 2018 to 2019.

PROJECT 1

SKETCHING This project mainly explore the potential relationship between machines and humans in the era of advanced technology. Artificial Intelligence application and portable photography have already enabled people’s life become convenient and effective, but these technology development also has gradually dimmed the boundary between the man-kind and machine at the same time. While people are upgrading the machine, machine is also re-learning and recognizeing themselves from people. If the ideal artificial intelligence comes true, what influence it can bring to us. Therefore, I want to figure out the situation we meet and get answers through this project

Installation Art

PRIMARY RESEARCH Wiki Definition

Development Summary

The word ultimately from Greek “σχέδιος ”. which is a rapidly executed freehand drawing that is not usually intended as a finished work. It might record something qucikly that the artist sees in a real time.

Chen Jiayu

22 Beijing Art Researcher in Minzu University of China

History Of Sketching B.C. 30000

B.C. 2300

" The form of painting art has developed from recording things abstractly in the primitive period to using video or photo to express the feeling or create art today, which benefit from human beings' understanding and innovation in art creation. And now and even in the future, using machine deep learning for artistic creation will define new artistic meanings."

5th

Period: Anthropolithic Age

Period: Aicient Cℹ️vℹ️lization

Period: Dynasty Tang & Dynasty Song

Use Simple Line & Graphic Production Activities Religious Culture

Conceptual Drawing The Former Political System Light and Shadow

Strokes Changes Rich Layers Of Ink Painting Interpersonal Emotion Expression.

Record History

V-Head Reflective Imaging Camera For Painting

Interaction Between Optics & Color Strart Outdoor Sketching

Shoot The First Photo In the world

Inventor: John·zhung

Period: Industrial Revolution

Inventor: Joseph Nicéphore Nièpce

With the advancement of artificial intelligence technology, it will bring sketching to a new level, which includes AI painting or computer generative art

The Advancement Of Digital Cameras The Invention Of Smartphones Change the way of recording life

1827

18 th

1665

Express Thoughts

Describe Story

Next 10 Years

1975~2020

INTERNET RESEARCH What is ideal Artificial Intelligence ?

Expert Interview

Marketing Analysis

I interviewed 3 experts and scholars from computer science and artistic creation to share their views about the development of artificial intelligence in this modern society and summarized their key points.

AI Market In U.S.A Education Sector Fast Growth Rate

Multitasking

Artificial intelligence can be applied in various fields, such as face recognition, image processing or driverless cars, etc.

Hu Yo-Yang

Chen Wen-Chi

Huang En-Wei

Wuhan China

Taipei Taiwan

Taipei Taiwan

New Media Artist

Professor Of New Media Art Photography Artist

Professor Of Creative Art Technique Director

Cognition

Artificial intelligence can learning and observe things, which leads them make own self-judges

Interview

"Artificial intelligence enable human rethink their own positioning in the world, which would blur the boundary between living things and non-living things."

Key points

Wisdom

Creativity

AI will give us various kinds of inspiration and creative methods

Interview "At the spiritual level, designers are always data integrators and decision makers, AI only plays a supporting role, only by perfecting ourselves can we try to evolve artificial intelligence. "

Key points Artificial intelligence enhance our quality of life through data analysis

+ 48%

High Benefit

$ 72.86 BN

Interview

"There may be only three professions in the future: designers of artificial intelligence, artists and philosophers. Therefore, AI is the next technological revolution."

Key points Artificial intelligence promotes technological innovation

Students and teachers contribute to expanding the AI application in the U.S.A education field, which has showed almost 48% Compound Annual Growth Rate (CAGR) in recent years .

69%

The market value of artificial Intelligence in U.S.A education sector has totally increased $72.86 BN since 2017.

High Market Shares Nearly 69% of the market share in America has originated from the high education in 2017

Ai Market Size in Global Education in the future North America Europe Asia

$ 143.7m

Artificial intelligence has its own consciousness and values, So as to form its own personality.

AI does self-creation through the deep learning process, which includes art, formulas, or various knowledge and skills.

We may lose ourselves in the technique development

AI can not deal with some emotional issues at the spiritual level

Works created by AI hardly have emotional resonance

2021

2027

Artificial Intelligence in Global Education Market size is expected to grow at a CAGR of over 40% between 2021 and 2027.

VALUE PROPOSITION

Potential Expectation

Value Proposition After the expert interviews and market analysis, I have summarized the value proposition about artificial intelligence in the development of art education.

.

I hope this drawing machine could be more like a dictionary. Because at the beginning of sketching, I was confused about the picture composition and color harmony, maybe the knowledge can be found at any time like a dictionary.

Lin Zizhou

Pain

Have poor basic art knowledge and reference

Art Worker

Needs

Hope to have basic painting teaching materials

Picture compostion mode selection

The device can suit different topographies

I felt that the most difficult point was that the knowledge which teacher taught could not be applied into my skills in time, especially the proportion of composition and the harmony between different colors. I want someone can help me immediately.

Current color anaylization Various sketching reference

Needs

Sketch Beginner

Pain Needs

Gains

Pain Relevers

Paints

Customer Jobs Diy developer

Hard to start compositing picture and mix color acurratly

Art worker

Inconvenient to get reference from the resource

Future Trends In China Art Education

Comparison Of Resource In China Art Education

Student

Teacher

Inonvenient to carry all the drawing equipments The students participate in Art College Entrance Examination will increase 0.55% totally

Have a simple but sufficient equipment

The total number of 18-year old jouvenils will decline 2.4% per year.

Art education resources in China are extremely uneven, with a teacher-student ratio reaching 20:3

The student admission rate of the top art colleges in China will still remain at 2.3%

MACHINE SCHEMATIC DIAGRAM

APPLICATION WORK FLOW

DESIGN PRINCIPLE Design Goal

7

Aim to become a personalized art director to provide the basic assist for the art examinee and sketching beginner.

Check mode

TX & DIR PULSE

Photo

Username Password

NO

Hue

Default

Cool tone

Other choice

Warm tone

Difficulty selection

Difficulty selection

Composition ratio

A

C

B

D

Convert to path

Primary

Primary

Medium

Medium

Advance

Advance

Image Process

Image Process

C

Color marking

Send Gcode message Start to paint

Home page

D

Camera check

NO

4

6

5

Color Paintbrush ready

Applience ready

NO

Replenish

Appliance connection

Bluetooth connect

NO

Mobile application expand methods for creation

Technique Using

Composition

NO

Test

Join

B

6

Reset X,Y,Z axis

Homing

Login in

LIGHT

The camera immediately catch the optimalizing sight

A

Auxiliary type

Color analyzation

Arduino

5V & VDD

7

RX & STEP

Providing reference of picture composition and color anaylization

Lightweight and firm shape design

GND

Creative mode Loading Page

Concept Function

OpenCV for Processing

Outside sketching beginer

Want a personal teacher

Provide the suitable picture composition

The camera would capture the current sight and analyze it in time .

I think the outside sketching in the past was very inconvenient and you need to bring a lot of things, I hope sketching outside should be more convenient and free, not limited by time.

Du Haodi Fine Art Examinee

Gain Creators

Using mobile application to analyze the differenrt parts of color .

Feng Qinwen

Pain

Art examinee

Beginner eazy to skeching outside

The lightweight suitcase save much time

Product Function

Hope to be able to apply in to practice quickly

Possible for the examinee to enhance the skeching skill

Including varity of sketching references

Different level settings

Can't master all knowledge points teacher taought

Want a flexible time schedule

The machine has different diffculies levels to fit in the sketching outside

3

1

2

4

5

Receive Gcode massage

4

5

Start to paint

Adobe XD

3

1 Sg990 Servo Motor

2 Bluetooth Module

3 CNC Sheld

5 Stepper Motor

6 Arduino Uno Sheld

7 Dupont Thread

2

1

4 A4988 Drive Mode

APPLICATION PROTOTYPE Usability Testing

Upload Sube Page Loading Page

Pick the most satisfying painting and share it on your social media

Setting Page

Typography

Aa Aa Aa Helvetica Neue Bold

Helvetica Neue Regular

Camera Check Setting

Helvetica Neue Light

Axis Reset Setting

Ink & Paintbrush Setting

System Setting

Capture Image

Color Swatches

Free setting and checking of the four components to ensure that the machine can operate normally

Bottom Bar

I had given wireframe to volunteer to simulate the operation, which were landing page, main page, creation mode and inspection mode. Then I collected information of the user feedbak and made further adjustment and analysis .

I designed a series of interactive interfaces in Adobe XD, I also constantly simulated and tested the icon position and interaction mode of the different conceptual pages.

Creative Sub Page The icons of the two functions are better distinguished

The bottom bar allows users to freely switch to the page they need

INSTALLATION STRUCTURE

1

4

2 3

1

The Top View Of Box

2

Internal Box

3

Suitcase Shape

4

The Tripod Under Box

Appearance Design 1 4

2 5

3 6

1

The Top View Of Device

3

2

Image Capture Part

4

6

Regarding the design of the appearance, I chose the paint box as my design reference, Also, I used a durable wooden box with a light plastic back cover and the tripod under the bottom of the box enable the whole device suitable for different terrains, which could better capture different sightseeing. The cabinet was divided into two layers, the upper part was the main body of the device, and the lower part was the power supply and the storage of some painting materials to achieve the purpose of simplicity.

Pen Drive On Z- Axis Arduino Drive Part

5

Whole Machine Skeleton

Production Process In the process of assembling and testing these components, I thinki it was a hard job to solve the problem how to bridge the digital signal communication between Processing and Arduino through the Bluetooth module, and convert path to Gcode .

But fortunately, with the help of friends and teachers, I had overcome these difficulties and achieved success finally.

2

1 3 1

4 3

Capture Image In Processing

2

Convert To Gcode In Arduino

4

Transfer Captured Image

Program Process In the Processing program, the camera capture the image through OpenCV and calculate each pixel to delineate the image outline and draw a path In the Arduino program, the path is converted to Gcode and sent back to the device via Bluetooth for drawing

SKETCHING PROCESS

Architectural Sketching

Argener Shipyard

I took my art installation to the Argena shipyard to sketch, and let the machine and me describe the existing architectural styles.

Seascape Sketching

Dawu Lun Beach

The mechanical installation and I sketched the same seascape together, but the lines and techniques of the painting composition were disparate

Landscape Sketching

Forgotten Valley

The complex terrain and different types of pebble rocks in Forgotten Valley could better highlight the differences between freehand brushwork of human artist and realistic rationality of machinery painting.

FINAL PRESENTATION Finally, I brought the machine to the seaside for sketching. With the help of the application of the smart phone and sketching painting machine, the machine and I painted the same scene at the same time and formed two completely different styles of paint work at last.

https://vimeo.com/333494426

Machine And I Drawing

PROJECT 2

HOLO-CARE

Covid-19 Infected Area In 2020

COVID-19 in 2020 had forced people all over the world to stay at home, especially for the elderly who had been confined at home for a long time, also there was no way to communicate and entertain face to face with their relatives and friends. Today’s intelligent communicate devices and IoT are popular, but the functions of them are too complicated for the elderly to explore and master. This temporary social problem is a concentrate issue of the aging of communities in the coming decades. So I proposed a new conceptual communication system design for these elderly groups to restructure and improve this situation.

Conceptual Design

UI Design

GLOBAL NEWS ABOUT COVID-19

ONLINE RESEARCH

BACKGROUND

Aging Society In China

The frequency elderly contact with their family Every day

Once a week Few times a week Once a month

On the phone Once a half year Once a year

Most Chinese old people still relate closly with their family members nowadays, and their

2.9%

38.2%

contact frequency around nearly every day to few times a week

Analysis & Prediction

Social activity frequency prediction 2010

Normal place

Super aging place

Aging place

the elderly population proportion aged 60 in Tibet accounts for the lowest in China, only 8.52%

Nearly 38.2% of Provinces have entered super-aging society, and the most aging cities are as high as 21.2%

More than half of the provinces have entered an aging society

The Problem Cause

2020 2025

2050

Aging Population Growing Trend The proportion of Chinese elderly population has gradually increased from 4.47% to nearly 13.7% from 1950 to 2020. In the next 40 years, the elderly population would show a rapid upward trend until around 2040.

The aging society of China is mainly composed of the following three factors：

58% 42%

58.8%

27%

25.75%

9%

65+

70+

75+

2050

80+

( Super-aged society )

13.7%

In the recent 20 years, Different age groups of elderly people’s social activities has gradually decreased.

In next 50 years, the frequency of activities well be much lower than the normal in nowadays

9.7%

2020

4.47%

Reduced social fertility rate

Excellent social welfare system

Traditional family structure changes

2010

( Aging society )

1950

PRIMARY RESEARCVH Physiological And Psychological Factors KNOWLEDGE

Elderly Interview

The lack of knowledge base has hindered the elderly learning enthusiasm.

BRAIN & MEMORY The decline of neuroplasticity in the elderly cerebral cortex would affect their cognitive functions, such as learning and memory.

It is very difficult for me to learn knowledge and use the smart phones at this age. moreover, my children and grandchildren are busy with their own businesses in different places, sox I rarely have opportunities to contact them, unless on meeting in some festival days.

sliver netizens 9.04 Million

WU HU · AN HUI Live with wife

CHANG SHA · HU NAN Live alone

NING BO · ZHE JIANG Living with daughter

the number of Chinese sliver netizens had reached 9.04 million in 2020, which accounted for nearly 23% of the Chinese Internet users totally.

65s Mr. Xu

76s Ms. Lin

81s Ms. Sun

Elderly Surfer Survey

I usually read the books and watch TV at home and sometimes help my children with housework. Sometimes, I think those smart electronic devices nowadays are a bit trouble for me to master well. I am still using old mobile phone to contact with my children

Although I can not travel around as usual, I do not give up any opportunities to contact with the outside world through my smart devices, Now I could communicate with my old friends about the joys of my family life, so I do not feel very lonely.

l Te

Communication: Nothing Daily entertainment: Do housework Watch television

Communication: old Mobile phone Telephone Daily entertainment: Read Watch television

Communication: Smart phone Social media Daily entertainment: Internet surfing

e

on

h ep

ne

ho

/p

er

us

%

55

37% PSYCHOLOGY & MOTIVATION

Common Needs Smart device user

Insufficient company time with their family and lack of learning motivation make elderly fear and resist new things, even dare to try modern equipment

SENSORY CHANGES The combined effect of physiological structural changes can cause varying degrees of sensory function degradation, such as failing eyesight and hearing loss

Approximately 37% of the elderly choose smartphones for communication or various related entertainment applications

Smart application usage

Easy To Learn

Insufficient Memory

Face-To-Face Contact

the vast majority of elderly Internet users preferred different types of social applications, followed by news apps (73.2%) and photography apps (71%). It seemed that the elderly needs for social contacts were still very large.

social apps

88.7%

news apps

73.2%

photography apps entertainment apps

71% 56.4%

EVALUTION RESEARCH User Interface Development

Record Carrier Evolution

Command Line Interface

Stone Age

The computer systems control or operate commands in the text line form through the commandline interfaces.

People in ancient time used simple geometric lines or hieroglyph to record daily production or life on some unprocessed natural artifacts.

Ccommunicate

Simple Graphic

Graphic and word

UI

Bronze statues Iron articlesc

UX

Social Communication Apps

Graphic User Interface The interface adopts the graphic display mode, which allows users to interact with devices through graphical icons and audio display .

Share

The comparison of current social apps

Social communication apps prefer to chat with each other and excellent user experience

Public

Animal Bones Life utensils Mural

Paper Period

kinds of paper

The invention of paper made event recording become more convenient and richer. It also vastly expanded the recorded content and preserve as long as possible.

Metal Age

Industrial & Information Rvolution

T h e tex t a p p ea r a n c e ex p a n d e d t h e richness of the recorded content. At the same time, bamboo slips and silk books had reduced the limitation of writing compared with the past materials.

Sound Image Video Mechanical / Electronic storage devices

The various kinds of electronic and mechanical recording carriers had caused great changes in the form of recording. which includes images, sounds, text and video

Ccommunicate

UI

UX

Share

Cloud Network Era

Social Sharing Apps Social sharing apps more focus on the social diversified functions and strong UI interaction.

Public

5G Internet technology can update or download all the recorded data from the smart devices in a fast speed, it not only can achieve the data sharing and data storage at the same time, but also develop some vitual technologies and relevant devices.

Natural User Interface It only requires people to interact directly with the computer in the most natural behaviour of communication, such as language or body action.

Voice Control

Eyes Control

All kinds of recording form

Gesture Control

Cloud serivces

CONCEPT SYSTEM PORTFOLIO Design Concept

Article, Painting

Detect Camera

Design Function

Redesign and optimize a set of the communication systems for the futural elderly whose daily life could be seen by the public again

Detect & Record

Concept portfolio

Detect the matrix in the image and record it

The elderly will use holographic projection to make real-time calls and chats with their family or friends, whom can take care of lives of those old people in time

Recording & Storage Video recording

Target Group

Record the interactive video between the user and the holographic projection object and store it in the corresponding memory.

Targert digital matrix

Trapped at home with nobody talk

Difficulty in using the smart devices

WIFI transmit

Detection & Processsing By detecting the light reflection of the target in LiDAR or the digital matrix orientation in camera, the CPU and GPU of the machine can get the gamut of user's data and achieve the real-time track for the target user.

Sensory and memory degradation

Noise-cancelling microphone Learning process computer & GPU

Design Flow Chart

RAM & SSD

3D Hologram Projection Elderly

Holographic project the relevant image or video data after processing

Dial

The smart assistant

Sound to call

Receive then project

The elderly will use the smart assistant to connect their own communication devices and call the related contacts in the menu.

The 2D or 3D video-call data from the visitor is transmitted to the holographic projection device through the receiver's smartphone.

REVIEW AND DEVELOPMENT

Website

Mobile

Concept Review

Call to review the Holo-Recording

Review & project the recording

Social share

Call the smart assistant and project the previous recording of the elderly images or videos through the Holo-care equipment or other holographic devices, which can enable you to remember the great surges of nostalgia for the yore days

Review play

Record information

User health record

Gallery play

HOLO - CARE Time Museum Review playback form Choose the form of the review playback, including the traditional media player or holographic projection.

In the Time Museum, visitors can watch the records through traditional media playback equipment or holographic project device, furthermore, they can also be admitted to browsing the data of various health monitoring and living activities records of the elderly in the time, which can be used for sociological studies in the future.

tt

PROJECT 3

HEALING SOUND In recent years, a growing number of medical institutions and individuals attempt to bring the various art forms to the hospitals in different places, where it plays a positive role in guiding and relieving patients' negative emotions and pressure. However, I think these art therapies are still focused on the relief of the visual senses, which are unable to break constraints of geography and time. Through this project, I will create the patients' own natural soundscape world in using sound design method, which are generated by the patients' physiological values during their medical treatment period. It will not only build the people-to-nature connection, but also achieve a new deeper spiritual healing.

Sound Design

BACKGROUND News Report

The Game Changer in University Hospital Southampton The painting, "Game Changer", which was first appeared at Southampton General Hospital on England's south coast during the first wave of the global coronavirus crisis in May last year. At that time, one of senior nurses with the hospital's Acute Medical Unit, Steph Gurney, said the appearance of the painting had come as a "real shock and a surprise" and that it "meant so much for patients and staffs to relieve their pressure in the hospital ".

From <THE ARTNEWSPAPER>

Report Analysis Recently, according to an influential report from Creative Health, a project called art prescription had been administered by the charity Artlift in 2017, and the final result led to a 37% drop in general practitioner visits and a 39% reduction in hospital admissions, which means this art therapy had produced a net saving of £216 per patient.

37%

39%

£216

Banksy, 'Game Changer', 2020

PRIMARY RESEARCH Expert Interview

Art Therapy In Hospital The hospitals have showed various visual art presentations, which greatly relieves the pressure of patients in the process of treatment and recovery, also it can improve wellbeing and expedite healing in a long term stay environment.

WAN-CHING LI

Electronic music teacher Music can help students adjust their lives.

”We have tried to play different types of music in the school to adjust the students' learning and mental state. Therefore, as a music teacher, v

WEI-DONG PENG Doctor & Paramedic

Architecture

Installation

the New Victoria Hospital

Exhibition

the New Royal Infirmary of Edinburgh

Music therapy can relieve the treatment pressure of patients and promote their recovery

The New Stobhill Hospital

Painting

"For patients who accepted physical rehabilitation treatment may generated chemotherapy and the negative emotion, which generated greatly disturbed their mental health. In this case, we usually use music therapy and counseling for patients to share the pain caused by the disease."

BO-CHEN SHENG

St Thomas’ Hospital.

Art curator Sound can deepen the connotation between the art creator and audience.

"In recent years, the sound art curation has gradually shifted from pure auditory enjoyment to multi-sensory experience, the experiencer could feel synaesthesia.

Also, this process could deepen the neurochemical effect and feedback to the installation, which formed a two-way interaction."

Conclusion After interviewing with three experts in different fields, I deepened my understanding of the diversity of sound/music influence on biological nerves, and gradually realized the possibility of sound art therapy can alleviate and eliminate the negative mental effects during the recovery period.

HISTORY RESEARCH Sound Therapy Definition

Survey for Sound Art Therapy

Sound healing therapy uses aspects of music, sound or spoken words, which aim to improve physical and emotional health.

The therapeutic effects of sound/music therapy for physical and mental or emotional disorders had been significantly improved.

I online surveyed nearly 64 people to ask their views on sound art therapy, some 85.7% held a positive attitude towards sound/music therapy, which had shown a rapid increase of nearly 55%. At the same time, the proportion of using smart equipment to receive treatment accounted for nearly 52.4%.

Development 1945

BC 1500

Egyptian medical papyri had been found that the sound using could influence the human body

World War II · End

1950

Sound or music therapy had become recognized as a formal profession in World War I and II

+55%

85.7%

National Association for Music Therapy founded

Support sound/music art therapy

52.4%

Use smart equipment

Rapid increased in fifteen years

Medical treatment between Western and Eastern Western Medical Systems

1789

First article on sound therapy

1930 1880

Western medical systems usually study human disease with modern pathology, microbiology and pharmacology knowledge, they use modern medical instruments to collect relevant evidence from patients to prove the accuracy of their diagnosis.

1971

American Association for Music Therapy founded

First Use of Music Therapy

The controlled music therapy had been serviced in London hospitals

1903

Traditional Chinese Medicine

1926

1914

National Society of Musical Therapeutics

National Association for Music formed in hospital

1998 Music therapy continued to grow and develop internationally

World War I Start

Traditional Chinese medicine follows the theory of Yin and Yang and Five elements in human body, When doctors prescribe for different patients, they will adjust the prescription by analyzing the patient’s whole-body situation (reaction, hair, posture, etc)

DESIGN PRINCIPLE

Collected Sound Process

Design Goal

This project aims not only to relieve the mental stress caused by physical medicine through art and sound therapy, but also to rethink and rebuild the relationship between the patient and the stay environment.

Yangmingshan National Park, Taipei

12.23 2020 Sound Recording: Stream & Spring, Wind, Fallen leaves Yangming Movuntain's undulating terrain affected the stream flow's speed, which generate the different nature sounds, while I walking on a mountain road, I collected the faint noise of leaves falling and the clear sound made by the mountain stream.

Concept Function Acquiring physiological data Dasyueshan Forest Recreation Area, Taichung 3.21 2021

Use professional medical equipment to collect physiological data and send it to the doctor

Sound Recording: Birds,Inner sound of the trees

In the future

In the early spring, I mainly collected the different birds' calls in the valley and found the calls of each bird were different. At the same time, I was using a stethoscope to listen to the sounds inside the branches of the trees. It sounds subtle and dry.

In the future, we can conduct self-diagnosis and treatment at any time through IT and IoT, which will eliminate the boundary between the hospital and home.

Diagnosis and treatment The doctor diagnoses and treats the patient accordingly based on the data.

Listening and self-adjustment While listening to music, it will help you reduce stress during the treatment process and expedite healing

Chaishan Nature Park, Kaohsiung

Sound Recording: Cicada, Waves, Birds, People Due to the early summer in the southern of Taiwan, the cicadas' cries in all directions seemed more intertwined, which mixed with the sound of waves crashing on the shore and the crowd's noise on the beach could be heard.

Record natural sounds Record the nature sound with equipment

5.13 2021

Analyze and generate melody According to physiological data and treatment methods, the system algorithm will generate your own suitable melody combined with the nature sound.

SOUNDSCAPE MAKING

Sound Map Setting

Sound of inside trees

Sound of ocean waves

Sound of stream

Sound of cicada

Sound of fallen leaves

Sound of wind chimes

Sound of birds

I tried using an electronic stethoscope to listen to the subtle noise inside the branches of trees and recorded them

I gathered together the sounds of birds, insects, ocean waves, streams, wind bells, fallen leaves, and the inner voice of tree trunks in a sound map, and then enable these various sound elements create a soundscape based on the emotions which I was collecting sounds with

DESIGN PROCESS

Experience Process

Installation Structure

Moving-Coil Speaker

Magnetic Stethoscope Ear Head

Play natural soundscape generated by the heartbeat

Using a magnetic design, the stethoscope may be more firmly attached to the holder and can be easily accessible

Listen to the melody smooth the mood While you not listening to the soundscape of melody, but also smoothing your mental stress.

The listening experience will affect the next heartbeat condition and formated of two-way interaction.

Electrical Condenser Microphone Digitally transform the heartbeat sound collected by the stethoscope

Generate natural soundscape Playing the soundscape music through the speaker at the other end.

The system matches the corresponding melody in the collected natural sound materials according to the BPM value and the amplitude value

Convert into electrical signals

Collect and transmit the heartbeat sound

The microphone converts the heartbeat sound waves into electrical signals, which are simulated and analyzed the BPM value and fluctuation amplitude of the heartbeat for one minute

Sound Process Processing sound input with MAXMSP in laptop

Listen to the heartbeat Put the stethoscope on the chest to collect the heartbeat sound

SOUND CODING ANALYSIS Function I

Function II

Timer

Frequency Selection

Calculating the time since received the start message and sent bang to each part in order

Select and convert diverse midi signals through mtof object as the ambiance frequencies of different time periods

BPM & AMP Calculation Read the heartbeat sound and calculate the peak frequency and amplitude in ten seconds, then simulate the BPM value in one minute

OSC Communication

Nonlinear Frequency Change

Transfer BPM value and AMP value to Open Frameworks interface via OSC communication

Use the cycle~ object to generate the cosine values that combine with the curve object, so that the sound frequency changes nonlinearly

Heartsound Effect Add different reverb effects setting to the collected heartbeat sounds, and change them with time

Step 1

Step 2

This part of the program shows the heartbeat sounds collected every ten seconds with low-pass filtering, and then the system will calculate the BPM value of heartbeats and the maximum and minimum values of the fluctuation amplitude, thereby indirectly simulating the number of heartbeats in one minute and then send data to the next parts.

The BPM value and amplitude value received every ten seconds, which will change and affect the selection of the base frequency of ambient music

Nature Sound Effect

Step 3 The BPM and AMP values calculated by simulation affect the cursor's direction on the soundscape map, and its' position at this time is packaged and sent to Open Frameworks through OSC communication, which will change the red cursor on the interactive interface in real-time.

Sound Effect of Birds

Step 4 At the same time, the base frequency changing will also influence the playback sequence from the collected natural recording materials with the moving cursor position and the triggering method of the effector, so that it can achieve the various unique melody produced under different heartbeat states.

Sound Effect of Tree & Leaves Sound Effect of Cicada Sound Effect of Stream & Ocean Sound Effect of Wind Chimes

VISION CODING ANAYSIS

Start Interface Design Import the previously designed interface

Set the initial size of the cursor in soundscape map I used Open Frameworks to make the interface of the iPad mobile terminal, and interact with MaxMsp through OSC(Open Sound Control ) Communication.

Set the initial value of amplitude and bpm

The position of the sound cursor is also presented in the form of a sound map

Initialize Start Interface Set the numerical change of the cursor size

Set the path of the cursor movement

Start Concept Interface

If the cursor has not moved, then the value of amp and bpm will be 0

When entering the start interface, the red cursor size will change with the sine function, and it will move around the start button to guide the experiencer into the interactive process. However, the physiological values generated from this experience are not used as a health reference for the medical diagnosis of the experiencer.

iPad Interface Vision

Main Interface Adjustments

The Class Setting

Set the position of each parametver in the main interface and the cursor moves way

Function building for interactive behavior in class ofApp

Function building for cursor movements in class ofApp

VISION

The cursor movement position in soundscape map

soundRecord~ SCAPE

The cursor's moving path record

heartBeat~ ANALYSIS

Heartbeat sound waveform display

Function building for OSC send and receive in class ofApp

Record Interface Settings

Set the path record of the cursor In the main interactive interface, the moving position of the cursor is affected by the heartbeat‘s amplitude and frequency, which is transmitted from MaxMsp to Open Frameworks through OSC Communication for real-time display, the experiencer can also obtain the information of his heartbeat waveform at the moment and the cursor path record from the interface

SYSTEM PROCESS Volunteer record Feeling review How do you feel about your own melody?

This melody was quiet and magical. It connected me with nature through my sound of heartbeat, also, it brought me a petculiar auditory experience.

The operation interface shows how different types of sounds are played at different times

Ruowen Yuan

71.3

Sound cursor record

BPM

83.12 Max Amp 66.41 Min Amp

Haowei You 73.2 BPM https://vimeo.com/manage/videos/563109626

Use the data visualization to present the heartbeat BPM value and the amplitude values, moreover, it also displays the mixing effect in real-time

Is there anything to feel confused in the listening process ?

At the beginning of the experience, I was really at a loss, because I was puzzled by the logical sequence of the natural melody generated by the playback

Yi Hsuan Lin 82.1 BPM

Johnson Ren 84.7 BPM

PROJECT 4

BRAIN MOTION

Brain Computer Interface data transfer

In today's Post- Pandemic Era, many companies and educational institutions choose to work or take classes remotely as their main office and learning methods. It is a good way to maintain normal work and learning functions while avoiding infection as usual. However, this has also led to a series of contradictions and conflicts: How to improve the students' learning efficiency and boost their study motivation in the distance education environment. Maybe, the brain-computer interface is a breakthrough. Through monitoring appropriately students' brain activities and analyzing their learning state in real-time, it is possible to exceed the space limitation and achieve the original expectations. However, the potential impact behind it is still worth worrying and thinking about.

Speculative Design

UX Design

NEWS BACKGROUND Educatiional Brain Computer Interface

According to the Wall Street Journal, an elementary school in Jinhua City used the brain-computerinterface (BCI) devices for teaching and education. These BCI equipments detected the students ' brainwaves and determine whether or not to pay attention in class and homework. Also, it could return their day-feedback to the teachers and parents in the form of data visualization.

However, the new educational practices had already triggered fresh arguments among students, teachers and parents from the social.

Failure factor analysis Unfortunately, this new teaching experiment innovation had finally failed. It is not difficult to find that it contains various unreasonable and unsuitable design factors, which led people to lose their own confidence in consumption.

Check intraday activity

Collect the brain wave

PARENTS STUDENT

Report daily behavior

Defferent Perspective Comments

Send visualized data

Invator

These devices were donated for the invator's alma mater as thve teaching aids, which aimed to train the students' class concentration and help them improve their learning efficiency.

1242

21

Detect accuracy

TEACHER

Limited brainwave detection channels are difficult to accurately determine the students‘ learning status.

6

3

Teacher they confirm the effectiveness of these BCI devices, also teachers can use those feedback data from detecting equipments as an auxiliary judgment standard for students' class status. However, they could not be sure of the accuracy of the data.

23301

642

knowledge popularization

Underage students cannot fully understand and control the use and destination of their personal information.

Brainwave technology has not been popularized in the market so that teachers and parents can not fully understand and accept.

Expert advice

63

14

User security

Student Their attention had improved than before, but if they had worn it for more than an hour, they would have felt uncomfortable.

2103

3

11

5

Parents

Parents voiced support for the promotion of children's daily performance, but they seldom cared about the theory and authenticity of the brian wave data collection, moreover, they even lack knowledge about the data final use.

42345

44

Zhang Wenbin

Hu Nan Educational expert

34

8

It is not scientific to let students wear brian computer interface devices to detect attention, because of their limited attention. In addition, this technology will make students become objects without subjectivity, which violates basic ethics.

Deep-Invasive BCI

PRIMARY RESEARCH BCI Evolution history 1977s

1965s

Found electrical activity of human brain.

Invented EEG system.

Used EEG and Analog HW for stimulate accoustic percussion instruments

Ha ns Berger

2016s

Alv in Lucier

2003s

Neuralink

Ja l cqu es Vida

ECOG

EEG

1990s

Operated the first human to be implanted with a BCI. Had demonstrated the first BCI game.

Cy berkinetics

NESD

Future

Build the new brain machine interface with partial-invasive implantation, which based on smaller processing chip.

Control cursor-like graphic objecton the computer screen with brain communication.

Invented Non-invasive EEG devices

LFP

Brain computer interface method Enable two-way communication between the human brain and a computer

2020s

Non-Invasive BCI

1924s

Partial-Invasive BCI

BCI technology connects a brain and a device, enabling signals from the brain to direct activity in the device.

Ph ilip K nnedy e

BCI Market trend prediction Visualize the brain thinking through the future brain machine interface.

Develop more interacted applications.

The Brain Computer Interface devices focus on intercepting the electrical bio-signals that pass between neurons in the brain and translate them to a signal that is sensed by external devices.

Furthermore, the Non-invasive BCI has held the largest share in 2020 owing to the high applicability of this technology for products.

Develop a invasive wireless dielectric for operation in brain

The global brain computer interface (BCI) market size was valued at $1,488.00 million in 2020, and is anticipated to reach $5,463.00 million by 2030, growing at a CAGR of 13.9% over the forecast 10 years' period. One of the key drivers for BCI technology rising markets is the increasing prevalence of communication technology and neuroscience study.

$5,463.00 Million 2030 S

$1,488.00

2020 S

13.9% per year

IN-DEPTH INVESTIGATION BCI Workflow

Group Interview

Signal Processing

Pre Processing

Neural transmission

Pattern recognition

Feature extraction

Data Visualization

Device Control

Signal Acquisition

JinDan Xiang

Post-processing

Feedback

Signal

Intention Mental Event

Application orientation

Jie Ying

LuChu Yang

QuanHong Lv

High school teacher

Primary student

Parent

Biology Expert

"Smart teaching aids make it easier for our teachers to track the students’ class situation and provide personalized guidance for each student in a timely manner."

"The brain-computer interface device motivates me to study, it can better supervise my learning and enable me to make great progress!"

"I can use my smartphone to know the child’s class status and their learning progress, but I am also very worried that the privacy of these children’s data will be leaked out.

"Now immature BCI devices cannot fully detect children’s multi-threaded brain response activities, and most of the data on the market only serves as a psychological hint."

Technology Require

Neuroprosthetics Automatic Drive

Survey of smart devices in educational application 94%

Medical Diagnosis

91% 88%

Market Need IoT

76%

change learning ways

Game

Nowadays, the brain-computer interface has been applied in different fields. but some of them are too difficult to be popularized among the general public because of their high expertise degree. However, the education market needs low technical thresholds and high potential demand.

DESIGN PRINCIPLE Original Design Intention Through the smart brain computer interface devices, students can master their own self-learning situation in diversified distance education.

study more convenient back eazier behave better in class

I tried to discuss the feasibility of the system logic and the way to show the visual dynamics of different brain states through discussions with the group members. At the same time, we used role-playing to simulate the tripartite perspectives of students, parents and teachers, then shared ideas with each other.

Bio-data collecting

Interactive teaching

The BCI collects the students' brainwave data in class and transmits it to the software for analyzing

The teacher adjusts the appropriate class method and schedule according to the student's class status.

feedbacks the result to the user as a reference.

Relax

Concentration

The teacher will receive the record of students’ brainwave activities in class

Tired

Class-status report Status Detectiont Compare and analyze the collected brainwave frequency bands with the set data model, and generate three states: relaxation, concentration, and fatigue

Privacy Encrypted

Brain-wave motion Online-class support

Bio-activity check

Interactive teaching

Students or their parents define the detailed level of information transmission by themselves, so as to protect their own biological privacy rights from being abused

Using the corresponding color changes and data visualization to present the student's class status, which feedbacks the result to the user as a reference.

DESIGN PROCESS Collect & Transfer

Collect brain wave part

Transfer to brain particle part

I tried to use MAXMSP's nonpolynomial object to collect the EEG signal transmitted by the BCI devices. At the same time, the extracted signal points are used to create particle vision, which changed particle type and color display according to the model in the function library.

Usability Testing

Relax Brain motion When the student is in a relaxed state, the particles are in a semi-aggregated state and the color turns green.

Can focus on every student own learning condition

While students and teachers use the experimental system of brain motion ~, enrich and enhance the interactive class experience of distance education.

The exhausted status will be recommended to the teacher.

The teacher user terminal will support the remote teaching software as a part of its teaching aids, receive feedback from the students and timely adjust the class mode and schedule, which possibly achieve the purpose of interactive teaching.

41.3%

Group discussion

The student terminal will include three different modes, which greatly guarantees the student's own information security and class efficiency.

Teacher‘s Terminal

More free online resources from education technology companies or websites

Brain Motion Using Process

Student ’s Terminal

Brian-wave motion

Smart devices can make students...

I learned about students’ views on smar t teaching aids through online questionnaires and found that most students still have a positive attitude towards the devices.

Design Function

Bio-data encryption

44.6%

84%

learn more fun Education

Questionnaire about teachers support distance education

Concentration Brain motion When the student is detected in a concentration state, the particles are in an aggregated mode and the color gradually changes to yellow.

Tired Brain motion If students feel exhausted, the interface will change red and the particles will turn into loose and disorderly movement tracks.

CONCEPT WEB-TERMINAL Biological Data Privacy The status page mainly presents the particle vision system in three kinds of colors, which provide the subjects with a reference to their brain status during class

Students can adjust the detailed level of their brainwave activity status that report to the teacher. Of course, if users are minor, the parent mode can be used to ensure the efficiency and enthusiasm of the class.

Interactive Option

Message

You can communicate with teachers or classmates in time, which can help teachers achieve the purpose of interactive education and master the students' learning progress while they speak actively

The function of raising hands can ensure students' enthusiasm to participate in teaching activities while in class

Brian wave Brian wave channel

Hands up

Status report

Parents mode Bio-data encryption

Students can selectively send their class status to the teacher. If a student feels tired, it is convenient for the teacher to keep track of his/her teaching progress in time

CONCEPT WEB-TERMINAL Bio-Data Activity Check

Student Brain Activities In Class Detailed Page

For students who are tired with learning, the teacher can adjust the class progress appropriately by observing the brainwave activities' history data fed back by the student to ensure flexible teaching.

Distance Class Support

Interative Teaching

Class status windows

Group interactive activity window

Ccommnication room Online blackboard

Teachers can use the current remote teaching software combined with the brain motion interface that can feedback the student's class status, it not only helps the educators grasp the student's learning progress but also improves the efficiency of class.

In order to encourage the participation of students in distance classes, teachers can use online group competitions or simple online puzzle games to stimulate students' enthusiasm and positivities

SITUATION COMPARE Current Situation Interview

Notice & Speculative Thinking

Distance Teaching Background

Current Distance Teaching

Covid-19 changed the teaching method from offline to online, which greatly changed the teaching method and the discussion between the teachers and students.

With the maturity of biometrics technology and the popularization of smart wearable devices, the application of BCI devices in the education field will gradually be recognized and accepted by the public. However, this kind of teaching aids still deserve our worry and reflection. The main points are as follows:

Current status and inconvenience Mrs.Xie Lin

Xi Hu Primary School

Teaching Course: Natural Sciences Mathematics

Can not grasp the class status of all students.

Interactive activities between teacher and students on class are restricted

Imperfect resources and equipments affect teaching quality.

Imagine The Future

Student privacy security Biological privacy security will become more and more important and worth our attention in the future

With the continuing development of virtual technology and the popularization of wearable smart devices, interactive distance education methods are finally getting improved. The use of VR or AR equipment in class allows teachers not only enrich the interactive teaching experience but also breaks the geographical restrictions under the special period, students wearing smart devices enable teachers understand every student's learning situation as well, so as to maximize the expected teaching goals.

Body-sensing interactive teaching

Virtual teaching equipments

Smart wearable devices

Social perception and popularization How to enable society to understand the application of BCI in education field is also one of the future goals.

Students' physical and mental health Wearing a brain-computer interface for a long time will also affect the physical and mental health of students.

PROJECT 5

AUTOMATED SHARED TABLE

Under the impact of the COVID-19 epidemic that began in May 2021, Taipei mayor kept ban on indoor dining, which caused nearly 10.2% of restaurants had closed in a year. It led to a large number of unsalable ingredients and further immeasurable food waste. Nowadays, customers have gradually changed the way of eating from indoor dining to ordering through take-out or food delivery platforms. In contrast, the urban poor in Taipei City is unable to afford the daily food consumption they need due to reduced incomes and the closure of hash houses, which has greatly influenced their dietary structure, especially the consumption of nutritious food. This situation can be changed through the automatic table sharing mode.

Service Design

UI Design

BACKGROUND Existing Solution For Against Hunger !

World Hunger Situation Worldwide, an additional 70~161 million people are likely to have experience hunger as a result of the pandemic in 2020, which even worsen child malnutrition.

Food Pantries In Europe

--- the information from Department of Economic and Social Affairs, UN

Complete infrastructure and relief system allow people in need to go to nearby shops or food pantries to receive food and supplies

22%

6.7%

5.7%

149.2 million of children under 5 are stunded

45.4 million of children under 5 suffer from wasting

38.9 million of children under 5 are overweight

Food Bank In Taiwan

Food Bank in North America Taipei

Collecting and sorting food that is about to expire or out of season but is still useful through the official organizations into big warehouse, and then combine it with volunteers to deliver these food materials to individuals or groups in need in different areas.

Taichuang

Timing Supply Type

Food Organization

Deliver food to the recipient’s home at a specific time and place

To avoid wasting food materials, distribute fruits and vegetables

Food market

Government

Turn the food bank into a supermarket and allow recipients to choose freely

Distributed in the form of social donations and government procurement

Taidong Tainan

Daily Soup Kitchens in Africa The church or related charity organizations collect donated ingredients and vegetables from the organic garden and cook them in many needy communities through volunteers.

Regional Food Bank In South Asia

Kaohsiung

Introspection

International member countries as well as provide regional support to national food security efforts and solve regional food shortages through collective action

PRIMARY RESEARCH

"The reason why does Taiwanese like dining out ?"

Convenient Restaurant

Taiwan Restaurant Distribution

Busy Daily

Low Cost

Most Taiwanese netizens think the majority of reasons are the busy work and tight time schedule, which cause them no time to cook at home. Also, restaurants in Taiwan are more convenient and cheaper, it can help to reduce their living expenses.

Road

Breakfast Bars

Family Restaurant

Night Market

Market Research of Taiwan's Catering Service National Average

Taiwanese Restaurant

Taiwan’s existing relief methods may serve low-income residents in the suburbs or remote areas of the city, but they can hardly improve the diet of low-income families in Taiwan’s cities.

Fast Food Restaurant

+ 64.8%

Food Delivery

+ 37.3%

Take-out meal

+ 69.2%

Smart Order

Under the Delta virus impact, many disadvantaged families in Taiwan had reduced or even lost their only source of income, and the high cost of living made it difficult for them to maintain normal food expenditures.

0% -25%

Fast-food restaurants and beverage store owners increased their turnover by 64.8% and 37.3% through food delivery services and take-out meal services, while consumers’ use of smartphones to order meals also increased by 69.2%

-50% -75% -100%

May

June

July

The Epidemic Impact of Taiwan's Catering Industry Revenue (5~8,2021)

August

Taiwan’s restaurants distribute densely, which mainly gather on both sides of roads in residential areas and trading areas, bringing convenience to urban residents and meeting their daily needs for three meals.

Snack Bar

The Survey of Taiwan Disadvantaged Families

Beverage Shop

25%

Home

Different types of catering industries in Taiwan were impacted to varying degrees during the epidemic.

The total turnover in four months was only NT$232 billion, a decrease of 20.4% compared to 2020.

Among them, traditional dining restaurants were the most affected, reducing to 40.6% of the original.

Volunteers’ delivery services and caring help are the only hope for these disadvantaged families, and 76.2% of them cannot take care of the entire lives of their family members Volunteers News Event

145424

Disadvantaged Families

2.43%

Volunteer Percentage

<$25000 Low Salary

The food delivery dilemma of disadvantaged families under COVID-19

STAKEHOLDERS INTERVIEW

RESEARCH FINDING

Process and Discuss with the related organization

Pains And Needs Vulnerable Families

Mr. Chuang LInfeng

The Owner Of Ramen Shop"Katsu"

Pains

How much impact does the indoor dining ban have on your store?

The number of customers has been greatly reduced, but the purchase and storage of ingredients have led to an increase in costs. Sometimes there are situations where those ingredients have to be abandoned.

What measures have you taken to ensure business?

Reduce food waste through delivery platforms and take-out meals, which have strived for operating income

what improvements do you want to make in this situation?

Hope to use the government power to make the ingredients consumed as soon as possible and increase the consumer flow

Found the different pain points faced by various restaurants under the epidemic, and recorded the measures they took.

Summarized the paints and needs from different stakeholders, and determined the service process

Found the local catering services

Summarized the content

Discussed with the professors

Understood the charity's work

Put forward concepts and ideas, made plans of touchpoints and service walkthroughs in the street.

Understood the living conditions of vulnerable families under the epidemic and found their needs

Needs

Government Agencies

Catering Industries

Unbalanced diet

Unsalable food

Difficult data collection

Unguaranteed welfare

little customer flow

Taxation Pressure

Balanced diet

Increase food sales

Get livelihood information

Get social assistance

Increase operating income

Improve social welfare

Vulnerable Families

Ms. Huang Yiqing The Principal In Wanhua District,Taipei

How do poor families in Wanhua live now?

Most of the elderly in Wanhua still rely on government welfare assistance, and most of them maintain their food from the cheap shops.

How did the Taipei Indoor Ban affect their lives?

Many elderly people cannot guarantee a normal three meals a day and a nutritious diet.

How did you do to help them get through this situation?

We organized love dinners to help low-income families, but we still hope to get help from relevant agencies and the government.

Ms. Wang Bilan

Use the power of the government and relevant organizations to propose a community-based table sharing pattern, which improves the situation of unsalable food in the restaurant and the imbalanced meals of vulnerable families under the epidemic

Stakeholder Map

Service Blueprint Basis of Behavior

Concept Overview ts Sal ver e of ingr edie n lefto

Get

e

Smartphone

Maintain social stability

Government

Place meals

Family Information Registration

Find Restaurants Via Sharing App

Small Donation

Gain Financial aid

Get Meals

Gain Other Welfare

Interaction line

Signboard

Collect social information

Improve community livelihood issues

Business situation Registration

Data collection

Reduce living expenses

Vulnerable Families

Public Benefit

Interaction line

Vulnerable Families Behavior Food Bank

Ensure a normal diet

Sharing Table

Rrestaurant Owner Behavior

creas

Self-Service Sharing Table

n Tax i

Rrestaurant Owner

rove n Imp situatio s ines

Increase operation revenue

New Sales Platform

bus

Resolve remaining food ingredients

Resume normal operations

iet

Platform

ed d

Main Function

lanc

Core Value

a ba

Target Group

The government agencies should work with catering services and vulnerable families to build a self-service meal-sharing mechanism. It can not only solve the unsalable food problem, but also help the families get a balanced diet, and alleviate the problems of insufficient volunteers and incomplete information collection.

"Among all the vulnerable groups affected by the epidemic, only about 23.5% of the families can accept the help of community volunteers. Because of the restrictions on going out, it is difficult for us to collect the rest of the needy families' information. which led them hardly accept social welfare assistance from the local government."

The director of Long-term care In Taipei City Government

SERVICE GOAL

Government Welare

Catering Industries

Data Statistics Website

Collect Livelihood information

Collect Livelihood information

Government Behavior

Welfare service

Internal interaction line

Resource Allocation

Grant Financial Aid

Restaurants can provide relatively cheap meals for vulnerable groups, and at the same time create fiscal revenue for the government and society While vulnerable families ensure a balanced diet, it is also convenient for the government and restaurants to collect livelihood data and solves the problem of surplus ingredients storage

System Support

Livelihood Data Collection System

FINAL DELIVERY

Vulnerable Families Map

Welfare System

Final Process

Customer Concept Application Food Collect Area

Scan the QR code Scan the QR code generated from the shared-app on the phone

Vulnerable Families

Find and Book Share-Table Meals

Take out meals

Register and Receive Financial Welfare

After vulnerable groups register their family information to the Taipei City Government, they can search for nearby provide shared-table restaurants to take out balanced food and gain the social welfare

Access

vvv Automated Shared-Table

Confirm the information of the recipient identity and the order

Shared-Meals Display Rack

Pay the Shared-Meals Pay for meals through the online payment

LCD Monitor QRcode Scanner Pick-up point

Take out Take out and enjoy your balanced meal

Donate to charity Donate 5% of operating income to the charities and help disadvantaged families improve their lives

OTHER WORKS These are my creations and explorations in different design and new media art fields in the form of group cooperation from 2018 to 2019.

Speculative Design Exhibition

Interative Performance

Creative Projection

New Media Opera

Creative Projection

Speculative Design Exhibition COINCIDENCE - Thinking on traffic cones

2019. 1.

Teamwork

We intend to continue and recreate the heritage of “random combination” to imagine the performance of those 4 sets of traffic cones in an alternative future. By producing an speculative exhibition, we hoped to inspire the viewers to prepare for a more sustainable and graceful future living space.

Kacho Fugetsu used visual projection art to present the natural scenery described by the Japanese idiom Kacho Fugetsu. This work combined various art forms such as bonsai art, animation, creative projection, etc., using Touch Designer and MadMapper creative programming language to interpret the inner spirit and artistic connotation of Japanese literature.

Final Delivery I

Vision · Animation I

Final Delivery II

Vision · Particle Projection https://vimeo.com/335331217

New Media Opera Ending

Teamwork

Shadow used Kinect Somatosensory Detection and Interactive Projection methods to combine modern dance art and new media art.

Which aimed to explore the relationship between real shadows and virtual shadows under the various body language. The dancers in the whole show cooperated with electronic music and different visual effects, and improvised to create different dance moves

https://vimeo.com/578849704

Teamwork

Projection Test

Interative Performance 2018.10.

2019. 4.

Exhibition

https://vimeo.com/658098611

Shadow

Kacho Fugetsu

2019.5.

Teamwork

We referred to the Shanghai showgirls of the Republic of China as the character's prototype and tried using Touch Designer to carry out the creative projection and interactive stage props made by Arduino, which greatly enhanced the performance atmosphere so that the opera and new media art could be perfectly combined.

Live Performance

Live Performance I

Kinect Body Tracking Test

Live Performance II

Visual Effect Test

Live Performance III https://vimeo.com/659693592