PENG ZIHAN
PORTFOLIO 2017~2021
PENG ZIHAN
DESIGNER
Taiwan Shih Chien University Communications Design 2017~2022
EDUCATION
Tel: Email:
(+86) 15067436879 pengzihan1998@gmail.com
2021
Curator
CONTACTS
EXPERIENCES
2021 Conation Graduation Exhibition 2019
Director & Technical Support
2019 Shanghai-Taipei Communicate Workshop 2019 Shih Chien Design College International Workshop 2018
Technical Support
2019 SCCD International Workshop
CATALOG CONTENTS SKETCHING
HEALING SOUND
AUTOMATED SHARED TABLE
Interactive Installation Art
Sound Design
Service Design
Using machine learning and image processing technology, let the painting robot accompany beginners to sketch outside together
Using human physiological data to design sound and extend it to the field of medical rehabilitation to help patients better enjoy the process of diagnosis, treatment and rehabilitation
Designing a set of concept mechanisms for the automated shared table to enable vulnerable families, catering services, and government welfare agencies to jointly overcome the predicaments brought by the epidemic
HOLO-CARE Conceptual Design
BRAIN MOTION UI Design
Boldly imagined that the future holographic projection technology would help the emptynest elderly better integrate into modern society and establish a digital museum about the elderly living in their later years.
Speculative Design
UI Design
OTHER WORKS UX Design
By speculating and criticizing the current application of brain-computer interface in the education field, I proposed and redesigned a new set of solutions to achieve the purpose of interactive distance learning and teaching
These are my creations and explorations in different design and new media art fields in the form of group cooperation from 2018 to 2019.
PROJECT 1
SKETCHING This project mainly explore the potential relationship between machines and humans in the era of advanced technology. Artificial Intelligence application and portable photography have already enabled people’s life become convenient and effective, but these technology development also has gradually dimmed the boundary between the man-kind and machine at the same time. While people are upgrading the machine, machine is also re-learning and recognizeing themselves from people. If the ideal artificial intelligence comes true, what influence it can bring to us. Therefore, I want to figure out the situation we meet and get answers through this project
Installation Art
PRIMARY RESEARCH Wiki Definition
Development Summary
The word ultimately from Greek “σχέδιος ”. which is a rapidly executed freehand drawing that is not usually intended as a finished work. It might record something qucikly that the artist sees in a real time.
Chen Jiayu
22 Beijing Art Researcher in Minzu University of China
History Of Sketching B.C. 30000
B.C. 2300
" The form of painting art has developed from recording things abstractly in the primitive period to using video or photo to express the feeling or create art today, which benefit from human beings' understanding and innovation in art creation. And now and even in the future, using machine deep learning for artistic creation will define new artistic meanings."
5th
Period: Anthropolithic Age
Period: Aicient Cℹ️vℹ️lization
Period: Dynasty Tang & Dynasty Song
Use Simple Line & Graphic Production Activities Religious Culture
Conceptual Drawing The Former Political System Light and Shadow
Strokes Changes Rich Layers Of Ink Painting Interpersonal Emotion Expression.
Record History
V-Head Reflective Imaging Camera For Painting
Interaction Between Optics & Color Strart Outdoor Sketching
Shoot The First Photo In the world
Inventor: John·zhung
Period: Industrial Revolution
Inventor: Joseph Nicéphore Nièpce
With the advancement of artificial intelligence technology, it will bring sketching to a new level, which includes AI painting or computer generative art
The Advancement Of Digital Cameras The Invention Of Smartphones Change the way of recording life
1827
18 th
1665
Express Thoughts
Describe Story
Next 10 Years
1975~2020
INTERNET RESEARCH What is ideal Artificial Intelligence ?
Expert Interview
Marketing Analysis
I interviewed 3 experts and scholars from computer science and artistic creation to share their views about the development of artificial intelligence in this modern society and summarized their key points.
AI Market In U.S.A Education Sector Fast Growth Rate
Multitasking
Artificial intelligence can be applied in various fields, such as face recognition, image processing or driverless cars, etc.
Hu Yo-Yang
Chen Wen-Chi
Huang En-Wei
Wuhan China
Taipei Taiwan
Taipei Taiwan
New Media Artist
Professor Of New Media Art Photography Artist
Professor Of Creative Art Technique Director
Cognition
Artificial intelligence can learning and observe things, which leads them make own self-judges
Interview
"Artificial intelligence enable human rethink their own positioning in the world, which would blur the boundary between living things and non-living things."
Key points
Wisdom
Creativity
AI will give us various kinds of inspiration and creative methods
Interview "At the spiritual level, designers are always data integrators and decision makers, AI only plays a supporting role, only by perfecting ourselves can we try to evolve artificial intelligence. "
Key points Artificial intelligence enhance our quality of life through data analysis
+ 48%
High Benefit
$ 72.86 BN
Interview
"There may be only three professions in the future: designers of artificial intelligence, artists and philosophers. Therefore, AI is the next technological revolution."
Key points Artificial intelligence promotes technological innovation
Students and teachers contribute to expanding the AI application in the U.S.A education field, which has showed almost 48% Compound Annual Growth Rate (CAGR) in recent years .
69%
The market value of artificial Intelligence in U.S.A education sector has totally increased $72.86 BN since 2017.
High Market Shares Nearly 69% of the market share in America has originated from the high education in 2017
Ai Market Size in Global Education in the future North America Europe Asia
$ 143.7m
Artificial intelligence has its own consciousness and values, So as to form its own personality.
AI does self-creation through the deep learning process, which includes art, formulas, or various knowledge and skills.
We may lose ourselves in the technique development
AI can not deal with some emotional issues at the spiritual level
Works created by AI hardly have emotional resonance
2021
2027
Artificial Intelligence in Global Education Market size is expected to grow at a CAGR of over 40% between 2021 and 2027.
VALUE PROPOSITION
Potential Expectation
Value Proposition After the expert interviews and market analysis, I have summarized the value proposition about artificial intelligence in the development of art education.
.
I hope this drawing machine could be more like a dictionary. Because at the beginning of sketching, I was confused about the picture composition and color harmony, maybe the knowledge can be found at any time like a dictionary. Lin Zizhou
Pain
Have poor basic art knowledge and reference
Art Worker
Needs
Hope to have basic painting teaching materials
Picture compostion mode selection
The device can suit different topographies
I felt that the most difficult point was that the knowledge which teacher taught could not be applied into my skills in time, especially the proportion of composition and the harmony between different colors. I want someone can help me immediately.
Current color anaylization Various sketching reference
Needs
Sketch Beginner
Pain Needs
Gains
Pain Relevers
Paints
Customer Jobs Diy developer
Hard to start compositing picture and mix color acurratly
Art worker
Inconvenient to get reference from the resource
Future Trends In China Art Education
Comparison Of Resource In China Art Education
Student
Teacher
Inonvenient to carry all the drawing equipments The students participate in Art College Entrance Examination will increase 0.55% totally
Have a simple but sufficient equipment
The total number of 18-year old jouvenils will decline 2.4% per year.
Art education resources in China are extremely uneven, with a teacher-student ratio reaching 20:3
The student admission rate of the top art colleges in China will still remain at 2.3%
MACHINE SCHEMATIC DIAGRAM
APPLICATION WORK FLOW
DESIGN PRINCIPLE Design Goal
7
Aim to become a personalized art director to provide the basic assist for the art examinee and sketching beginner.
Check mode
TX & DIR PULSE
Photo
Username Password
NO
Hue
Default
Cool tone
Other choice
Warm tone
Difficulty selection
Difficulty selection
Composition ratio
A
C
B
D
Convert to path
Primary
Primary
Medium
Medium
Advance
Advance
Image Process
Image Process
C
Color marking
Send Gcode message Start to paint
Home page
D
Camera check
NO
4
6
5
Color Paintbrush ready
Applience ready
NO
Replenish
Appliance connection
Bluetooth connect
NO
Mobile application expand methods for creation
Technique Using
Composition
NO
Test
Join
B
6
Reset X,Y,Z axis
Homing
Login in
LIGHT
The camera immediately catch the optimalizing sight
A
Auxiliary type
Color analyzation
Arduino
5V & VDD
7
RX & STEP
Providing reference of picture composition and color anaylization
Lightweight and firm shape design
GND
Creative mode Loading Page
Concept Function
OpenCV for Processing
Outside sketching beginer
Want a personal teacher
Provide the suitable picture composition
The camera would capture the current sight and analyze it in time .
I think the outside sketching in the past was very inconvenient and you need to bring a lot of things, I hope sketching outside should be more convenient and free, not limited by time.
Du Haodi Fine Art Examinee
Gain Creators
Using mobile application to analyze the differenrt parts of color .
Feng Qinwen
Pain
Art examinee
Beginner eazy to skeching outside
The lightweight suitcase save much time
Product Function
Hope to be able to apply in to practice quickly
Possible for the examinee to enhance the skeching skill
Including varity of sketching references
Different level settings
Can't master all knowledge points teacher taought
Want a flexible time schedule
The machine has different diffculies levels to fit in the sketching outside
3
1
2
4
5
Receive Gcode massage
4
5
Start to paint
Adobe XD
3
1 Sg990 Servo Motor
2 Bluetooth Module
3 CNC Sheld
5 Stepper Motor
6 Arduino Uno Sheld
7 Dupont Thread
2
1
4 A4988 Drive Mode
APPLICATION PROTOTYPE Usability Testing
Upload Sube Page Loading Page
Pick the most satisfying painting and share it on your social media
Setting Page
Typography
Aa Aa Aa Helvetica Neue Bold
Helvetica Neue Regular
Camera Check Setting
Helvetica Neue Light
Axis Reset Setting
Ink & Paintbrush Setting
System Setting
Capture Image
Color Swatches
Free setting and checking of the four components to ensure that the machine can operate normally
Bottom Bar
I had given wireframe to volunteer to simulate the operation, which were landing page, main page, creation mode and inspection mode. Then I collected information of the user feedbak and made further adjustment and analysis .
I designed a series of interactive interfaces in Adobe XD, I also constantly simulated and tested the icon position and interaction mode of the different conceptual pages.
Creative Sub Page The icons of the two functions are better distinguished
The bottom bar allows users to freely switch to the page they need
INSTALLATION STRUCTURE
1
4
2 3
1
The Top View Of Box
2
Internal Box
3
Suitcase Shape
4
The Tripod Under Box
Appearance Design 1 4
2 5
3 6
1
The Top View Of Device
3
2
Image Capture Part
4
6
Regarding the design of the appearance, I chose the paint box as my design reference, Also, I used a durable wooden box with a light plastic back cover and the tripod under the bottom of the box enable the whole device suitable for different terrains, which could better capture different sightseeing. The cabinet was divided into two layers, the upper part was the main body of the device, and the lower part was the power supply and the storage of some painting materials to achieve the purpose of simplicity.
Pen Drive On Z- Axis Arduino Drive Part
5
Whole Machine Skeleton
Production Process In the process of assembling and testing these components, I thinki it was a hard job to solve the problem how to bridge the digital signal communication between Processing and Arduino through the Bluetooth module, and convert path to Gcode . But fortunately, with the help of friends and teachers, I had overcome these difficulties and achieved success finally.
2
1 3 1
4 3
Capture Image In Processing
2
Convert To Gcode In Arduino
4
Transfer Captured Image
Program Process In the Processing program, the camera capture the image through OpenCV and calculate each pixel to delineate the image outline and draw a path In the Arduino program, the path is converted to Gcode and sent back to the device via Bluetooth for drawing
SKETCHING PROCESS
Architectural Sketching
Argener Shipyard
I took my art installation to the Argena shipyard to sketch, and let the machine and me describe the existing architectural styles.
Seascape Sketching
Dawu Lun Beach
The mechanical installation and I sketched the same seascape together, but the lines and techniques of the painting composition were disparate
Landscape Sketching
Forgotten Valley
The complex terrain and different types of pebble rocks in Forgotten Valley could better highlight the differences between freehand brushwork of human artist and realistic rationality of machinery painting.
FINAL PRESENTATION Finally, I brought the machine to the seaside for sketching. With the help of the application of the smart phone and sketching painting machine, the machine and I painted the same scene at the same time and formed two completely different styles of paint work at last.
https://vimeo.com/333494426
Machine And I Drawing
PROJECT 2
HOLO-CARE
Covid-19 Infected Area In 2020
COVID-19 in 2020 had forced people all over the world to stay at home, especially for the elderly who had been confined at home for a long time, also there was no way to communicate and entertain face to face with their relatives and friends. Today’s intelligent communicate devices and IoT are popular, but the functions of them are too complicated for the elderly to explore and master. This temporary social problem is a concentrate issue of the aging of communities in the coming decades. So I proposed a new conceptual communication system design for these elderly groups to restructure and improve this situation.
Conceptual Design
UI Design
GLOBAL NEWS ABOUT COVID-19
ONLINE RESEARCH
BACKGROUND
Aging Society In China
The frequency elderly contact with their family Every day
Once a week Few times a week Once a month
On the phone Once a half year Once a year
Most Chinese old people still relate closly with their family members nowadays, and their
2.9%
38.2%
contact frequency around nearly every day to few times a week
Analysis & Prediction
Social activity frequency prediction 2010
Normal place
Super aging place
Aging place
the elderly population proportion aged 60 in Tibet accounts for the lowest in China, only 8.52%
Nearly 38.2% of Provinces have entered super-aging society, and the most aging cities are as high as 21.2%
More than half of the provinces have entered an aging society
The Problem Cause
2020 2025
2050
Aging Population Growing Trend The proportion of Chinese elderly population has gradually increased from 4.47% to nearly 13.7% from 1950 to 2020. In the next 40 years, the elderly population would show a rapid upward trend until around 2040.
The aging society of China is mainly composed of the following three factors：
58% 42%
58.8%
27%
25.75%
9%
65+
70+
75+
2050
80+
( Super-aged society )
13.7%
In the recent 20 years, Different age groups of elderly people’s social activities has gradually decreased. In next 50 years, the frequency of activities well be much lower than the normal in nowadays
9.7%
2020
4.47%
Reduced social fertility rate
Excellent social welfare system
Traditional family structure changes
2010
( Aging society )
1950
PRIMARY RESEARCVH Physiological And Psychological Factors KNOWLEDGE
Elderly Interview
The lack of knowledge base has hindered the elderly learning enthusiasm.
BRAIN & MEMORY The decline of neuroplasticity in the elderly cerebral cortex would affect their cognitive functions, such as learning and memory.
It is very difficult for me to learn knowledge and use the smart phones at this age. moreover, my children and grandchildren are busy with their own businesses in different places, sox I rarely have opportunities to contact them, unless on meeting in some festival days.
sliver netizens 9.04 Million
WU HU · AN HUI Live with wife
CHANG SHA · HU NAN Live alone
NING BO · ZHE JIANG Living with daughter
the number of Chinese sliver netizens had reached 9.04 million in 2020, which accounted for nearly 23% of the Chinese Internet users totally.
65s Mr. Xu
76s Ms. Lin
81s Ms. Sun
Elderly Surfer Survey
I usually read the books and watch TV at home and sometimes help my children with housework. Sometimes, I think those smart electronic devices nowadays are a bit trouble for me to master well. I am still using old mobile phone to contact with my children
Although I can not travel around as usual, I do not give up any opportunities to contact with the outside world through my smart devices, Now I could communicate with my old friends about the joys of my family life, so I do not feel very lonely.
l Te
Communication: Nothing Daily entertainment: Do housework Watch television
Communication: old Mobile phone Telephone Daily entertainment: Read Watch television
Communication: Smart phone Social media Daily entertainment: Internet surfing
e
on
h ep
ne
ho
/p
er
us
%
55
37% PSYCHOLOGY & MOTIVATION
Common Needs Smart device user
Insufficient company time with their family and lack of learning motivation make elderly fear and resist new things, even dare to try modern equipment
SENSORY CHANGES The combined effect of physiological structural changes can cause varying degrees of sensory function degradation, such as failing eyesight and hearing loss
Approximately 37% of the elderly choose smartphones for communication or various related entertainment applications
Smart application usage
Easy To Learn
Insufficient Memory
Face-To-Face Contact
the vast majority of elderly Internet users preferred different types of social applications, followed by news apps (73.2%) and photography apps (71%). It seemed that the elderly needs for social contacts were still very large.
social apps
88.7%
news apps
73.2%
photography apps entertainment apps
71% 56.4%
EVALUTION RESEARCH User Interface Development
Record Carrier Evolution
Command Line Interface
Stone Age
The computer systems control or operate commands in the text line form through the commandline interfaces.
People in ancient time used simple geometric lines or hieroglyph to record daily production or life on some unprocessed natural artifacts.
Ccommunicate
Simple Graphic
Graphic and word
UI
Bronze statues Iron articlesc
UX
Social Communication Apps
Graphic User Interface The interface adopts the graphic display mode, which allows users to interact with devices through graphical icons and audio display .
Share
The comparison of current social apps
Social communication apps prefer to chat with each other and excellent user experience
Public
Animal Bones Life utensils Mural
Paper Period
kinds of paper
The invention of paper made event recording become more convenient and richer. It also vastly expanded the recorded content and preserve as long as possible.
Metal Age
Industrial & Information Rvolution
T h e tex t a p p ea r a n c e ex p a n d e d t h e richness of the recorded content. At the same time, bamboo slips and silk books had reduced the limitation of writing compared with the past materials.
Sound Image Video Mechanical / Electronic storage devices
The various kinds of electronic and mechanical recording carriers had caused great changes in the form of recording. which includes images, sounds, text and video
Ccommunicate
UI
UX
Share
Cloud Network Era
Social Sharing Apps Social sharing apps more focus on the social diversified functions and strong UI interaction.
Public
5G Internet technology can update or download all the recorded data from the smart devices in a fast speed, it not only can achieve the data sharing and data storage at the same time, but also develop some vitual technologies and relevant devices.
Natural User Interface It only requires people to interact directly with the computer in the most natural behaviour of communication, such as language or body action.
Voice Control
Eyes Control
All kinds of recording form
Gesture Control
Cloud serivces
CONCEPT SYSTEM PORTFOLIO Design Concept
Article, Painting
Detect Camera
Design Function
Redesign and optimize a set of the communication systems for the futural elderly whose daily life could be seen by the public again
Detect & Record
Concept portfolio
Detect the matrix in the image and record it
The elderly will use holographic projection to make real-time calls and chats with their family or friends, whom can take care of lives of those old people in time
Recording & Storage Video recording
Target Group
Record the interactive video between the user and the holographic projection object and store it in the corresponding memory.
Targert digital matrix
Trapped at home with nobody talk
Difficulty in using the smart devices
WIFI transmit
Detection & Processsing By detecting the light reflection of the target in LiDAR or the digital matrix orientation in camera, the CPU and GPU of the machine can get the gamut of user's data and achieve the real-time track for the target user.
Sensory and memory degradation
Noise-cancelling microphone Learning process computer & GPU
Design Flow Chart
RAM & SSD
3D Hologram Projection Elderly
Holographic project the relevant image or video data after processing
Dial
The smart assistant
Sound to call
Receive then project
The elderly will use the smart assistant to connect their own communication devices and call the related contacts in the menu.
The 2D or 3D video-call data from the visitor is transmitted to the holographic projection device through the receiver's smartphone.
REVIEW AND DEVELOPMENT
Website
Mobile
Concept Review
Call to review the Holo-Recording
Review & project the recording
Social share
Call the smart assistant and project the previous recording of the elderly images or videos through the Holo-care equipment or other holographic devices, which can enable you to remember the great surges of nostalgia for the yore days
Review play
Record information
User health record
Gallery play
HOLO - CARE Time Museum Review playback form Choose the form of the review playback, including the traditional media player or holographic projection.
In the Time Museum, visitors can watch the records through traditional media playback equipment or holographic project device, furthermore, they can also be admitted to browsing the data of various health monitoring and living activities records of the elderly in the time, which can be used for sociological studies in the future.
tt
PROJECT 3
HEALING SOUND In recent years, a growing number of medical institutions and individuals attempt to bring the various art forms to the hospitals in different places, where it plays a positive role in guiding and relieving patients' negative emotions and pressure. However, I think these art therapies are still focused on the relief of the visual senses, which are unable to break constraints of geography and time. Through this project, I will create the patients' own natural soundscape world in using sound design method, which are generated by the patients' physiological values during their medical treatment period. It will not only build the people-to-nature connection, but also achieve a new deeper spiritual healing.
Sound Design
BACKGROUND News Report
The Game Changer in University Hospital Southampton The painting, "Game Changer", which was first appeared at Southampton General Hospital on England's south coast during the first wave of the global coronavirus crisis in May last year. At that time, one of senior nurses with the hospital's Acute Medical Unit, Steph Gurney, said the appearance of the painting had come as a "real shock and a surprise" and that it "meant so much for patients and staffs to relieve their pressure in the hospital ". From <THE ARTNEWSPAPER>
Report Analysis Recently, according to an influential report from Creative Health, a project called art prescription had been administered by the charity Artlift in 2017, and the final result led to a 37% drop in general practitioner visits and a 39% reduction in hospital admissions, which means this art therapy had produced a net saving of £216 per patient.
37%
39%
£216
Banksy, 'Game Changer', 2020
PRIMARY RESEARCH Expert Interview
Art Therapy In Hospital The hospitals have showed various visual art presentations, which greatly relieves the pressure of patients in the process of treatment and recovery, also it can improve wellbeing and expedite healing in a long term stay environment.
WAN-CHING LI
Electronic music teacher Music can help students adjust their lives.
”We have tried to play different types of music in the school to adjust the students' learning and mental state. Therefore, as a music teacher, v
WEI-DONG PENG Doctor & Paramedic
Architecture
Installation
the New Victoria Hospital
Exhibition
the New Royal Infirmary of Edinburgh
Music therapy can relieve the treatment pressure of patients and promote their recovery
The New Stobhill Hospital
Painting
"For patients who accepted physical rehabilitation treatment may generated chemotherapy and the negative emotion, which generated greatly disturbed their mental health. In this case, we usually use music therapy and counseling for patients to share the pain caused by the disease."
BO-CHEN SHENG
St Thomas’ Hospital.
Art curator Sound can deepen the connotation between the art creator and audience.
"In recent years, the sound art curation has gradually shifted from pure auditory enjoyment to multi-sensory experience, the experiencer could feel synaesthesia. Also, this process could deepen the neurochemical effect and feedback to the installation, which formed a two-way interaction."
Conclusion After interviewing with three experts in different fields, I deepened my understanding of the diversity of sound/music influence on biological nerves, and gradually realized the possibility of sound art therapy can alleviate and eliminate the negative mental effects during the recovery period.
HISTORY RESEARCH Sound Therapy Definition
Survey for Sound Art Therapy
Sound healing therapy uses aspects of music, sound or spoken words, which aim to improve physical and emotional health.
The therapeutic effects of sound/music therapy for physical and mental or emotional disorders had been significantly improved. I online surveyed nearly 64 people to ask their views on sound art therapy, some 85.7% held a positive attitude towards sound/music therapy, which had shown a rapid increase of nearly 55%. At the same time, the proportion of using smart equipment to receive treatment accounted for nearly 52.4%.
Development 1945
BC 1500
Egyptian medical papyri had been found that the sound using could influence the human body
World War II · End
1950
Sound or music therapy had become recognized as a formal profession in World War I and II
+55%
85.7%
National Association for Music Therapy founded
Support sound/music art therapy
52.4%
Use smart equipment
Rapid increased in fifteen years
Medical treatment between Western and Eastern Western Medical Systems
1789
First article on sound therapy
1930 1880
Western medical systems usually study human disease with modern pathology, microbiology and pharmacology knowledge, they use modern medical instruments to collect relevant evidence from patients to prove the accuracy of their diagnosis.
1971
American Association for Music Therapy founded
First Use of Music Therapy
The controlled music therapy had been serviced in London hospitals
1903
Traditional Chinese Medicine
1926
1914
National Society of Musical Therapeutics
National Association for Music formed in hospital
1998 Music therapy continued to grow and develop internationally
World War I Start
Traditional Chinese medicine follows the theory of Yin and Yang and Five elements in human body, When doctors prescribe for different patients, they will adjust the prescription by analyzing the patient’s whole-body situation (reaction, hair, posture, etc)
DESIGN PRINCIPLE
Collected Sound Process
Design Goal
This project aims not only to relieve the mental stress caused by physical medicine through art and sound therapy, but also to rethink and rebuild the relationship between the patient and the stay environment.
Yangmingshan National Park, Taipei
12.23 2020 Sound Recording: Stream & Spring, Wind, Fallen leaves Yangming Movuntain's undulating terrain affected the stream flow's speed, which generate the different nature sounds, while I walking on a mountain road, I collected the faint noise of leaves falling and the clear sound made by the mountain stream.
Concept Function Acquiring physiological data Dasyueshan Forest Recreation Area, Taichung 3.21 2021
Use professional medical equipment to collect physiological data and send it to the doctor
Sound Recording: Birds,Inner sound of the trees
In the future
In the early spring, I mainly collected the different birds' calls in the valley and found the calls of each bird were different. At the same time, I was using a stethoscope to listen to the sounds inside the branches of the trees. It sounds subtle and dry.
In the future, we can conduct self-diagnosis and treatment at any time through IT and IoT, which will eliminate the boundary between the hospital and home.
Diagnosis and treatment The doctor diagnoses and treats the patient accordingly based on the data.
Listening and self-adjustment While listening to music, it will help you reduce stress during the treatment process and expedite healing
Chaishan Nature Park, Kaohsiung
Sound Recording: Cicada, Waves, Birds, People Due to the early summer in the southern of Taiwan, the cicadas' cries in all directions seemed more intertwined, which mixed with the sound of waves crashing on the shore and the crowd's noise on the beach could be heard.
Record natural sounds Record the nature sound with equipment
5.13 2021
Analyze and generate melody According to physiological data and treatment methods, the system algorithm will generate your own suitable melody combined with the nature sound.
SOUNDSCAPE MAKING
Sound Map Setting
Sound of inside trees
Sound of ocean waves
Sound of stream
Sound of cicada
Sound of fallen leaves
Sound of wind chimes
Sound of birds
I tried using an electronic stethoscope to listen to the subtle noise inside the branches of trees and recorded them
I gathered together the sounds of birds, insects, ocean waves, streams, wind bells, fallen leaves, and the inner voice of tree trunks in a sound map, and then enable these various sound elements create a soundscape based on the emotions which I was collecting sounds with
DESIGN PROCESS
Experience Process
Installation Structure
Moving-Coil Speaker
Magnetic Stethoscope Ear Head
Play natural soundscape generated by the heartbeat
Using a magnetic design, the stethoscope may be more firmly attached to the holder and can be easily accessible
Listen to the melody smooth the mood While you not listening to the soundscape of melody, but also smoothing your mental stress.
The listening experience will affect the next heartbeat condition and formated of two-way interaction.
Electrical Condenser Microphone Digitally transform the heartbeat sound collected by the stethoscope
Generate natural soundscape Playing the soundscape music through the speaker at the other end.
The system matches the corresponding melody in the collected natural sound materials according to the BPM value and the amplitude value
Convert into electrical signals
Collect and transmit the heartbeat sound
The microphone converts the heartbeat sound waves into electrical signals, which are simulated and analyzed the BPM value and fluctuation amplitude of the heartbeat for one minute
Sound Process Processing sound input with MAXMSP in laptop
Listen to the heartbeat Put the stethoscope on the chest to collect the heartbeat sound
SOUND CODING ANALYSIS Function I
Function II
Timer
Frequency Selection
Calculating the time since received the start message and sent bang to each part in order
Select and convert diverse midi signals through mtof object as the ambiance frequencies of different time periods
BPM & AMP Calculation Read the heartbeat sound and calculate the peak frequency and amplitude in ten seconds, then simulate the BPM value in one minute
OSC Communication
Nonlinear Frequency Change
Transfer BPM value and AMP value to Open Frameworks interface via OSC communication
Use the cycle~ object to generate the cosine values that combine with the curve object, so that the sound frequency changes nonlinearly
Heartsound Effect Add different reverb effects setting to the collected heartbeat sounds, and change them with time
Step 1
Step 2
This part of the program shows the heartbeat sounds collected every ten seconds with low-pass filtering, and then the system will calculate the BPM value of heartbeats and the maximum and minimum values of the fluctuation amplitude, thereby indirectly simulating the number of heartbeats in one minute and then send data to the next parts.
The BPM value and amplitude value received every ten seconds, which will change and affect the selection of the base frequency of ambient music
Nature Sound Effect
Step 3 The BPM and AMP values calculated by simulation affect the cursor's direction on the soundscape map, and its' position at this time is packaged and sent to Open Frameworks through OSC communication, which will change the red cursor on the interactive interface in real-time.
Sound Effect of Birds
Step 4 At the same time, the base frequency changing will also influence the playback sequence from the collected natural recording materials with the moving cursor position and the triggering method of the effector, so that it can achieve the various unique melody produced under different heartbeat states.
Sound Effect of Tree & Leaves Sound Effect of Cicada Sound Effect of Stream & Ocean Sound Effect of Wind Chimes
VISION CODING ANAYSIS
Start Interface Design Import the previously designed interface
Set the initial size of the cursor in soundscape map I used Open Frameworks to make the interface of the iPad mobile terminal, and interact with MaxMsp through OSC(Open Sound Control ) Communication.
Set the initial value of amplitude and bpm
The position of the sound cursor is also presented in the form of a sound map
Initialize Start Interface Set the numerical change of the cursor size
Set the path of the cursor movement
Start Concept Interface
If the cursor has not moved, then the value of amp and bpm will be 0
When entering the start interface, the red cursor size will change with the sine function, and it will move around the start button to guide the experiencer into the interactive process. However, the physiological values generated from this experience are not used as a health reference for the medical diagnosis of the experiencer.
iPad Interface Vision
Main Interface Adjustments
The Class Setting
Set the position of each parametver in the main interface and the cursor moves way
Function building for interactive behavior in class ofApp
Function building for cursor movements in class ofApp
VISION
The cursor movement position in soundscape map
soundRecord~ SCAPE
The cursor's moving path record
heartBeat~ ANALYSIS
Heartbeat sound waveform display
Function building for OSC send and receive in class ofApp
Record Interface Settings
Set the path record of the cursor In the main interactive interface, the moving position of the cursor is affected by the heartbeat‘s amplitude and frequency, which is transmitted from MaxMsp to Open Frameworks through OSC Communication for real-time display, the experiencer can also obtain the information of his heartbeat waveform at the moment and the cursor path record from the interface
SYSTEM PROCESS Volunteer record Feeling review How do you feel about your own melody? This melody was quiet and magical. It connected me with nature through my sound of heartbeat, also, it brought me a petculiar auditory experience.
The operation interface shows how different types of sounds are played at different times
Ruowen Yuan
71.3
Sound cursor record
BPM
83.12 Max Amp 66.41 Min Amp
Haowei You 73.2 BPM https://vimeo.com/manage/videos/563109626
Use the data visualization to present the heartbeat BPM value and the amplitude values, moreover, it also displays the mixing effect in real-time
Is there anything to feel confused in the listening process ? At the beginning of the experience, I was really at a loss, because I was puzzled by the logical sequence of the natural melody generated by the playback
Yi Hsuan Lin 82.1 BPM
Johnson Ren 84.7 BPM
PROJECT 4
BRAIN MOTION
Brain Computer Interface data transfer
In today's Post- Pandemic Era, many companies and educational institutions choose to work or take classes remotely as their main office and learning methods. It is a good way to maintain normal work and learning functions while avoiding infection as usual. However, this has also led to a series of contradictions and conflicts: How to improve the students' learning efficiency and boost their study motivation in the distance education environment. Maybe, the brain-computer interface is a breakthrough. Through monitoring appropriately students' brain activities and analyzing their learning state in real-time, it is possible to exceed the space limitation and achieve the original expectations. However, the potential impact behind it is still worth worrying and thinking about.
Speculative Design
UX Design
NEWS BACKGROUND Educatiional Brain Computer Interface
According to the Wall Street Journal, an elementary school in Jinhua City used the brain-computerinterface (BCI) devices for teaching and education. These BCI equipments detected the students ' brainwaves and determine whether or not to pay attention in class and homework. Also, it could return their day-feedback to the teachers and parents in the form of data visualization. However, the new educational practices had already triggered fresh arguments among students, teachers and parents from the social.
Failure factor analysis Unfortunately, this new teaching experiment innovation had finally failed. It is not difficult to find that it contains various unreasonable and unsuitable design factors, which led people to lose their own confidence in consumption.
Check intraday activity
Collect the brain wave
PARENTS STUDENT
Report daily behavior
Defferent Perspective Comments
Send visualized data
Invator
These devices were donated for the invator's alma mater as thve teaching aids, which aimed to train the students' class concentration and help them improve their learning efficiency. 1242
21
Detect accuracy
TEACHER
Limited brainwave detection channels are difficult to accurately determine the students‘ learning status.
6
3
Teacher they confirm the effectiveness of these BCI devices, also teachers can use those feedback data from detecting equipments as an auxiliary judgment standard for students' class status. However, they could not be sure of the accuracy of the data. 23301
642
knowledge popularization
Underage students cannot fully understand and control the use and destination of their personal information.
Brainwave technology has not been popularized in the market so that teachers and parents can not fully understand and accept.
Expert advice
63
14
User security
Student Their attention had improved than before, but if they had worn it for more than an hour, they would have felt uncomfortable. 2103
3
11
5
Parents
Parents voiced support for the promotion of children's daily performance, but they seldom cared about the theory and authenticity of the brian wave data collection, moreover, they even lack knowledge about the data final use.
42345
44
Zhang Wenbin
Hu Nan Educational expert
34
8
It is not scientific to let students wear brian computer interface devices to detect attention, because of their limited attention. In addition, this technology will make students become objects without subjectivity, which violates basic ethics.
Deep-Invasive BCI
PRIMARY RESEARCH BCI Evolution history 1977s
1965s
Found electrical activity of human brain. Invented EEG system.
Used EEG and Analog HW for stimulate accoustic percussion instruments
Ha ns Berger
2016s
Alv in Lucier
2003s
Neuralink
Ja l cqu es Vida
ECOG
EEG
1990s
Operated the first human to be implanted with a BCI. Had demonstrated the first BCI game.
Cy berkinetics
NESD
Future
Build the new brain machine interface with partial-invasive implantation, which based on smaller processing chip.
Control cursor-like graphic objecton the computer screen with brain communication. Invented Non-invasive EEG devices
LFP
Brain computer interface method Enable two-way communication between the human brain and a computer
2020s
Non-Invasive BCI
1924s
Partial-Invasive BCI
BCI technology connects a brain and a device, enabling signals from the brain to direct activity in the device.
Ph ilip K nnedy e
BCI Market trend prediction Visualize the brain thinking through the future brain machine interface. Develop more interacted applications.
The Brain Computer Interface devices focus on intercepting the electrical bio-signals that pass between neurons in the brain and translate them to a signal that is sensed by external devices. Furthermore, the Non-invasive BCI has held the largest share in 2020 owing to the high applicability of this technology for products.
Develop a invasive wireless dielectric for operation in brain
The global brain computer interface (BCI) market size was valued at $1,488.00 million in 2020, and is anticipated to reach $5,463.00 million by 2030, growing at a CAGR of 13.9% over the forecast 10 years' period. One of the key drivers for BCI technology rising markets is the increasing prevalence of communication technology and neuroscience study.
$5,463.00 Million 2030 S
$1,488.00
2020 S
13.9% per year
IN-DEPTH INVESTIGATION BCI Workflow
Group Interview
Signal Processing
Pre Processing
Neural transmission
Pattern recognition
Feature extraction
Data Visualization
Device Control
Signal Acquisition
JinDan Xiang
Post-processing
Feedback
Signal
Intention Mental Event
Application orientation
Jie Ying
LuChu Yang
QuanHong Lv
High school teacher
Primary student
Parent
Biology Expert
"Smart teaching aids make it easier for our teachers to track the students’ class situation and provide personalized guidance for each student in a timely manner."
"The brain-computer interface device motivates me to study, it can better supervise my learning and enable me to make great progress!"
"I can use my smartphone to know the child’s class status and their learning progress, but I am also very worried that the privacy of these children’s data will be leaked out.
"Now immature BCI devices cannot fully detect children’s multi-threaded brain response activities, and most of the data on the market only serves as a psychological hint."
Technology Require
Neuroprosthetics Automatic Drive
Survey of smart devices in educational application 94%
Medical Diagnosis
91% 88%
Market Need IoT
76%
change learning ways
Game
Nowadays, the brain-computer interface has been applied in different fields. but some of them are too difficult to be popularized among the general public because of their high expertise degree. However, the education market needs low technical thresholds and high potential demand.
DESIGN PRINCIPLE Original Design Intention Through the smart brain computer interface devices, students can master their own self-learning situation in diversified distance education.
study more convenient back eazier behave better in class
I tried to discuss the feasibility of the system logic and the way to show the visual dynamics of different brain states through discussions with the group members. At the same time, we used role-playing to simulate the tripartite perspectives of students, parents and teachers, then shared ideas with each other.
Bio-data collecting
Interactive teaching
The BCI collects the students' brainwave data in class and transmits it to the software for analyzing
The teacher adjusts the appropriate class method and schedule according to the student's class status.
feedbacks the result to the user as a reference.
Relax
Concentration
The teacher will receive the record of students’ brainwave activities in class
Tired
Class-status report Status Detectiont Compare and analyze the collected brainwave frequency bands with the set data model, and generate three states: relaxation, concentration, and fatigue
Privacy Encrypted
Brain-wave motion Online-class support
Bio-activity check
Interactive teaching
Students or their parents define the detailed level of information transmission by themselves, so as to protect their own biological privacy rights from being abused
Using the corresponding color changes and data visualization to present the student's class status, which feedbacks the result to the user as a reference.
DESIGN PROCESS Collect & Transfer
Collect brain wave part
Transfer to brain particle part
I tried to use MAXMSP's nonpolynomial object to collect the EEG signal transmitted by the BCI devices. At the same time, the extracted signal points are used to create particle vision, which changed particle type and color display according to the model in the function library.
Usability Testing
Relax Brain motion When the student is in a relaxed state, the particles are in a semi-aggregated state and the color turns green.
Can focus on every student own learning condition
While students and teachers use the experimental system of brain motion ~, enrich and enhance the interactive class experience of distance education.
The exhausted status will be recommended to the teacher.
The teacher user terminal will support the remote teaching software as a part of its teaching aids, receive feedback from the students and timely adjust the class mode and schedule, which possibly achieve the purpose of interactive teaching.
41.3%
Group discussion
The student terminal will include three different modes, which greatly guarantees the student's own information security and class efficiency.
Teacher‘s Terminal
More free online resources from education technology companies or websites
Brain Motion Using Process
Student ’s Terminal
Brian-wave motion
Smart devices can make students... I learned about students’ views on smar t teaching aids through online questionnaires and found that most students still have a positive attitude towards the devices.
Design Function
Bio-data encryption
44.6%
84%
learn more fun Education
Questionnaire about teachers support distance education
Concentration Brain motion When the student is detected in a concentration state, the particles are in an aggregated mode and the color gradually changes to yellow.
Tired Brain motion If students feel exhausted, the interface will change red and the particles will turn into loose and disorderly movement tracks.
CONCEPT WEB-TERMINAL Biological Data Privacy The status page mainly presents the particle vision system in three kinds of colors, which provide the subjects with a reference to their brain status during class
Students can adjust the detailed level of their brainwave activity status that report to the teacher. Of course, if users are minor, the parent mode can be used to ensure the efficiency and enthusiasm of the class.
Interactive Option
Message
You can communicate with teachers or classmates in time, which can help teachers achieve the purpose of interactive education and master the students' learning progress while they speak actively
The function of raising hands can ensure students' enthusiasm to participate in teaching activities while in class
Brian wave Brian wave channel
Hands up
Status report
Parents mode Bio-data encryption
Students can selectively send their class status to the teacher. If a student feels tired, it is convenient for the teacher to keep track of his/her teaching progress in time
CONCEPT WEB-TERMINAL Bio-Data Activity Check
Student Brain Activities In Class Detailed Page
For students who are tired with learning, the teacher can adjust the class progress appropriately by observing the brainwave activities' history data fed back by the student to ensure flexible teaching.
Distance Class Support
Interative Teaching
Class status windows
Group interactive activity window
Ccommnication room Online blackboard
Teachers can use the current remote teaching software combined with the brain motion interface that can feedback the student's class status, it not only helps the educators grasp the student's learning progress but also improves the efficiency of class.
In order to encourage the participation of students in distance classes, teachers can use online group competitions or simple online puzzle games to stimulate students' enthusiasm and positivities
SITUATION COMPARE Current Situation Interview
Notice & Speculative Thinking
Distance Teaching Background
Current Distance Teaching
Covid-19 changed the teaching method from offline to online, which greatly changed the teaching method and the discussion between the teachers and students.
With the maturity of biometrics technology and the popularization of smart wearable devices, the application of BCI devices in the education field will gradually be recognized and accepted by the public. However, this kind of teaching aids still deserve our worry and reflection. The main points are as follows:
Current status and inconvenience Mrs.Xie Lin
Xi Hu Primary School
Teaching Course: Natural Sciences Mathematics
Can not grasp the class status of all students.
Interactive activities between teacher and students on class are restricted
Imperfect resources and equipments affect teaching quality.
Imagine The Future
Student privacy security Biological privacy security will become more and more important and worth our attention in the future
With the continuing development of virtual technology and the popularization of wearable smart devices, interactive distance education methods are finally getting improved. The use of VR or AR equipment in class allows teachers not only enrich the interactive teaching experience but also breaks the geographical restrictions under the special period, students wearing smart devices enable teachers understand every student's learning situation as well, so as to maximize the expected teaching goals. Body-sensing interactive teaching
Virtual teaching equipments
Smart wearable devices
Social perception and popularization How to enable society to understand the application of BCI in education field is also one of the future goals.
Students' physical and mental health Wearing a brain-computer interface for a long time will also affect the physical and mental health of students.
PROJECT 5
AUTOMATED SHARED TABLE
Under the impact of the COVID-19 epidemic that began in May 2021, Taipei mayor kept ban on indoor dining, which caused nearly 10.2% of restaurants had closed in a year. It led to a large number of unsalable ingredients and further immeasurable food waste. Nowadays, customers have gradually changed the way of eating from indoor dining to ordering through take-out or food delivery platforms. In contrast, the urban poor in Taipei City is unable to afford the daily food consumption they need due to reduced incomes and the closure of hash houses, which has greatly influenced their dietary structure, especially the consumption of nutritious food. This situation can be changed through the automatic table sharing mode.
Service Design
UI Design
BACKGROUND Existing Solution For Against Hunger !
World Hunger Situation Worldwide, an additional 70~161 million people are likely to have experience hunger as a result of the pandemic in 2020, which even worsen child malnutrition.
Food Pantries In Europe
--- the information from Department of Economic and Social Affairs, UN
Complete infrastructure and relief system allow people in need to go to nearby shops or food pantries to receive food and supplies
22%
6.7%
5.7%
149.2 million of children under 5 are stunded
45.4 million of children under 5 suffer from wasting
38.9 million of children under 5 are overweight
Food Bank In Taiwan
Food Bank in North America Taipei
Collecting and sorting food that is about to expire or out of season but is still useful through the official organizations into big warehouse, and then combine it with volunteers to deliver these food materials to individuals or groups in need in different areas.
Taichuang
Timing Supply Type
Food Organization
Deliver food to the recipient’s home at a specific time and place
To avoid wasting food materials, distribute fruits and vegetables
Food market
Government
Turn the food bank into a supermarket and allow recipients to choose freely
Distributed in the form of social donations and government procurement
Taidong Tainan
Daily Soup Kitchens in Africa The church or related charity organizations collect donated ingredients and vegetables from the organic garden and cook them in many needy communities through volunteers.
Regional Food Bank In South Asia
Kaohsiung
Introspection
International member countries as well as provide regional support to national food security efforts and solve regional food shortages through collective action
PRIMARY RESEARCH
"The reason why does Taiwanese like dining out ?"
Convenient Restaurant
Taiwan Restaurant Distribution
Busy Daily
Low Cost
Most Taiwanese netizens think the majority of reasons are the busy work and tight time schedule, which cause them no time to cook at home. Also, restaurants in Taiwan are more convenient and cheaper, it can help to reduce their living expenses.
Road
Breakfast Bars
Family Restaurant
Night Market
Market Research of Taiwan's Catering Service National Average
Taiwanese Restaurant
Taiwan’s existing relief methods may serve low-income residents in the suburbs or remote areas of the city, but they can hardly improve the diet of low-income families in Taiwan’s cities.
Fast Food Restaurant
+ 64.8%
Food Delivery
+ 37.3%
Take-out meal
+ 69.2%
Smart Order
Under the Delta virus impact, many disadvantaged families in Taiwan had reduced or even lost their only source of income, and the high cost of living made it difficult for them to maintain normal food expenditures.
0% -25%
Fast-food restaurants and beverage store owners increased their turnover by 64.8% and 37.3% through food delivery services and take-out meal services, while consumers’ use of smartphones to order meals also increased by 69.2%
-50% -75% -100%
May
June
July
The Epidemic Impact of Taiwan's Catering Industry Revenue (5~8,2021)
August
Taiwan’s restaurants distribute densely, which mainly gather on both sides of roads in residential areas and trading areas, bringing convenience to urban residents and meeting their daily needs for three meals.
Snack Bar
The Survey of Taiwan Disadvantaged Families
Beverage Shop
25%
Home
Different types of catering industries in Taiwan were impacted to varying degrees during the epidemic. The total turnover in four months was only NT$232 billion, a decrease of 20.4% compared to 2020. Among them, traditional dining restaurants were the most affected, reducing to 40.6% of the original.
Volunteers’ delivery services and caring help are the only hope for these disadvantaged families, and 76.2% of them cannot take care of the entire lives of their family members Volunteers News Event
145424
Disadvantaged Families
2.43%
Volunteer Percentage
<$25000 Low Salary
The food delivery dilemma of disadvantaged families under COVID-19
STAKEHOLDERS INTERVIEW
RESEARCH FINDING
Process and Discuss with the related organization
Pains And Needs Vulnerable Families
Mr. Chuang LInfeng
The Owner Of Ramen Shop"Katsu"
Pains
How much impact does the indoor dining ban have on your store?
The number of customers has been greatly reduced, but the purchase and storage of ingredients have led to an increase in costs. Sometimes there are situations where those ingredients have to be abandoned.
What measures have you taken to ensure business?
Reduce food waste through delivery platforms and take-out meals, which have strived for operating income
what improvements do you want to make in this situation?
Hope to use the government power to make the ingredients consumed as soon as possible and increase the consumer flow
Found the different pain points faced by various restaurants under the epidemic, and recorded the measures they took.
Summarized the paints and needs from different stakeholders, and determined the service process
Found the local catering services
Summarized the content
Discussed with the professors
Understood the charity's work
Put forward concepts and ideas, made plans of touchpoints and service walkthroughs in the street.
Understood the living conditions of vulnerable families under the epidemic and found their needs
Needs
Government Agencies
Catering Industries
Unbalanced diet
Unsalable food
Difficult data collection
Unguaranteed welfare
little customer flow
Taxation Pressure
Balanced diet
Increase food sales
Get livelihood information
Get social assistance
Increase operating income
Improve social welfare
Vulnerable Families
Ms. Huang Yiqing The Principal In Wanhua District,Taipei
How do poor families in Wanhua live now?
Most of the elderly in Wanhua still rely on government welfare assistance, and most of them maintain their food from the cheap shops.
How did the Taipei Indoor Ban affect their lives?
Many elderly people cannot guarantee a normal three meals a day and a nutritious diet.
How did you do to help them get through this situation?
We organized love dinners to help low-income families, but we still hope to get help from relevant agencies and the government.
Ms. Wang Bilan
Use the power of the government and relevant organizations to propose a community-based table sharing pattern, which improves the situation of unsalable food in the restaurant and the imbalanced meals of vulnerable families under the epidemic
Stakeholder Map
Service Blueprint Basis of Behavior
Concept Overview ts Sal ver e of ingr edie n lefto
Get
e
Smartphone
Maintain social stability
Government
Place meals
Family Information Registration
Find Restaurants Via Sharing App
Small Donation
Gain Financial aid
Get Meals
Gain Other Welfare
Interaction line
Signboard
Collect social information
Improve community livelihood issues
Business situation Registration
Data collection
Reduce living expenses
Vulnerable Families
Public Benefit
Interaction line
Vulnerable Families Behavior Food Bank
Ensure a normal diet
Sharing Table
Rrestaurant Owner Behavior
creas
Self-Service Sharing Table
n Tax i
Rrestaurant Owner
rove n Imp situatio s ines
Increase operation revenue
New Sales Platform
bus
Resolve remaining food ingredients
Resume normal operations
iet
Platform
ed d
Main Function
lanc
Core Value
a ba
Target Group
The government agencies should work with catering services and vulnerable families to build a self-service meal-sharing mechanism. It can not only solve the unsalable food problem, but also help the families get a balanced diet, and alleviate the problems of insufficient volunteers and incomplete information collection.
"Among all the vulnerable groups affected by the epidemic, only about 23.5% of the families can accept the help of community volunteers. Because of the restrictions on going out, it is difficult for us to collect the rest of the needy families' information. which led them hardly accept social welfare assistance from the local government."
The director of Long-term care In Taipei City Government
SERVICE GOAL
Government Welare
Catering Industries
Data Statistics Website
Collect Livelihood information
Collect Livelihood information
Government Behavior
Welfare service
Internal interaction line
Resource Allocation
Grant Financial Aid
Restaurants can provide relatively cheap meals for vulnerable groups, and at the same time create fiscal revenue for the government and society While vulnerable families ensure a balanced diet, it is also convenient for the government and restaurants to collect livelihood data and solves the problem of surplus ingredients storage
System Support
Livelihood Data Collection System
FINAL DELIVERY
Vulnerable Families Map
Welfare System
Final Process
Customer Concept Application Food Collect Area
Scan the QR code Scan the QR code generated from the shared-app on the phone
Vulnerable Families
Find and Book Share-Table Meals
Take out meals
Register and Receive Financial Welfare
After vulnerable groups register their family information to the Taipei City Government, they can search for nearby provide shared-table restaurants to take out balanced food and gain the social welfare
Access
vvv Automated Shared-Table
Confirm the information of the recipient identity and the order
Shared-Meals Display Rack
Pay the Shared-Meals Pay for meals through the online payment
LCD Monitor QRcode Scanner Pick-up point
Take out Take out and enjoy your balanced meal
Donate to charity Donate 5% of operating income to the charities and help disadvantaged families improve their lives
OTHER WORKS These are my creations and explorations in different design and new media art fields in the form of group cooperation from 2018 to 2019.
Speculative Design Exhibition
Interative Performance
Creative Projection
New Media Opera
Creative Projection
Speculative Design Exhibition COINCIDENCE - Thinking on traffic cones
2019. 1.
Teamwork
We intend to continue and recreate the heritage of “random combination” to imagine the performance of those 4 sets of traffic cones in an alternative future. By producing an speculative exhibition, we hoped to inspire the viewers to prepare for a more sustainable and graceful future living space.
Kacho Fugetsu used visual projection art to present the natural scenery described by the Japanese idiom Kacho Fugetsu. This work combined various art forms such as bonsai art, animation, creative projection, etc., using Touch Designer and MadMapper creative programming language to interpret the inner spirit and artistic connotation of Japanese literature.
Final Delivery I
Vision · Animation I
Final Delivery II
Vision · Particle Projection https://vimeo.com/335331217
New Media Opera Ending
Teamwork
Shadow used Kinect Somatosensory Detection and Interactive Projection methods to combine modern dance art and new media art. Which aimed to explore the relationship between real shadows and virtual shadows under the various body language. The dancers in the whole show cooperated with electronic music and different visual effects, and improvised to create different dance moves
https://vimeo.com/578849704
Teamwork
Projection Test
Interative Performance 2018.10.
2019. 4.
Exhibition
https://vimeo.com/658098611
Shadow
Kacho Fugetsu
2019.5.
Teamwork
We referred to the Shanghai showgirls of the Republic of China as the character's prototype and tried using Touch Designer to carry out the creative projection and interactive stage props made by Arduino, which greatly enhanced the performance atmosphere so that the opera and new media art could be perfectly combined.
Live Performance
Live Performance I
Kinect Body Tracking Test
Live Performance II
Visual Effect Test
Live Performance III https://vimeo.com/659693592