Issuu on Google+

Visible Melody ——the transformation between aural language and visional language

Wang Qianfei


The days when I spent in CAFA Every teacher Every mate Every minute all of which were fabulous and unforgetable Growth and progress were increased like the time Before my making decision about the motif of my graduation design I am aware that it is not enough if I only use my professional knowledge about design It is the responsibility and duty of the society that I should pay more attention to So that during the hundreds of days which I spent on my graduation design I devoted myself to find the most suitable method to explain my motif and design to audience and viewers I would like to express my deeply thankful to my professors, parents and friends with this book Visible Melody


02


The Reason of Choosing The Motif

Loving music, not only I, but also the main part of people own this kind of interest, which is an amazing and powerful way to express art. Music, like the air, is needed by everyone. It is said by Schopenhauer that music is the jewel of the artistic crown. Music is one of the symbol of sound and the expression of people's mind. It is music that owns aim and connotation, as well as including experience and thought of musician. Music could bring wonderful feeling to people and express their emotion. Music is one of the significant action, though which everybody can communicate with each other freely. However, there are more than three hundred millions people who cannot feel the beautiful melody on the earth. What can we do for them? they are deaf-mute, their world are coulorless, helpless and monotonous. The demand of splendid life is needed by deaf-mute, as well as the normal ones. It is not unnecessary for deaf-mute to live in a colorful world and with various ways of art. The most important issue is that they also need music. As for a designer-to-be, It is the social responsibility that I always remember by heart. With the help of design, I would bring the strong engery from music to deaf-mute, that's all my original intention. Nowdays, the groups and organizations aim to help and cure the deaf-mute to hear with the help of some special facilities.

Visible Melody


� ��

� �

� �

���� � �

��������� �

� �

� �

� �

��

� �

� � �

� �

� �

� �

����

��

��

����

� ���

��������������� ��

� � �

� �

� �

� ��

��

��

� �

����

� �

����

� �

���

� �

� � �

� �

� �

� � �

� �

� � �

� �

� � �

�� �

� �� ��

� � � �

� �

� � �

� �

� �

� �

� � �

� ��

��

�� � �

� �

� � �

�� �

� �

� ��

� � �

� � � �

� �

� �

��

� � ��

� � �

����� �

� �

����

� �

� � �

� �

�� ���

� � �

����

� � �

� � �

� �

� � �

� �

� �

� �

� �

� �

� � �

��

� ����

� �

��

� �

��

� � �

Image_report about deaf-mute's lives on China Education Daily

� � �

�� � �

��

����

�� �

� �

���� � ���� ����

��

���� � �

� �

���

� �

��

��

� �

� �

� �

��

����

However, before they can hear, � or during their restoration from sickness, � � How can they live? For those people who cannot hear forever, is it means that they would never feel music? �

���

� ��

� �

� �

� �

����

� �

����

� �� �

� �

� �

����

��

� �

��

��

���� � �� �

��

�� � �

� ��

� �

� � �

��

���

Design serve for everyone. Design serve for deaf-mute. �

� �

� ��

�����

��

� �

� �

��

Using all my knowledge about design and art, and all my abilities to thansfer visional language into aural language, I tried to use several sences to explain music. So that the deaf-mute can understand the main part of music as much as possible. When they could feel the power of music, it is sure that they will live much happier and more relaxed �

� �

� �

���

� �

� � �

�� ��

���

�� � � �

���

� �

� �

� �

� �

� � � �

� � �

� �

���

� �

� �

� �

� � �

� � �

� �

� �

� �

�� ��

� �

�� �

� �

� �

� �

����

� �

� �

� �

����

� �

� �

��

04


The First Experiment

Useing seven colors to represent seven scales, I tried to mix colors to find out the emotion which comes from the music. one unit the height of one unit is 12mm and the width is 8mm.

Following this rule, the music socre will turn to a fabulous color combination.

1

2

3

4

5

6

7

6

7

摇篮曲

Cradlesong

1=G 4 4

1

2

3

1=G 3 2 4 4

Visible Melody

4

5

北风吹

White-Haired Girl


1

2

3

1=D 4

4

5

6

7

Ode To Joy

4

The shortage: Although every scale owned its speical color values, the different tones had no links, what is meant by this is that this experience was failed.

RULE

1=C

1=C

1=D

1=D

1=E

1=E

1=F

1=F

1=G

1=G

1=A

1=A

1=B 1=B

Give every scale a color value under a system in defferent tones, which is more accurate and useful. The result was not perfect, therefore; I would like to change the order and place among these scales. 06


1     2     3      4     5

1     2     3      4     5      6     7 

摇篮曲 Cradlesong

1=G 4

模板一

RULE ONE

摇篮曲 Cradle

1=G 4 4

1=G 3 2

北风吹 Girl White-Haired

4 4

1=G 3 2

北 White-Ha

4 4

1     2     3      4     5      6     7 

1=D 4 4

Visible Melody

欢乐颂

Ode To Joy

1     2     3      4

1=D 4 4

欢乐颂

Ode T


5      6     7 

曲 esong

1     2     3      4     5      6     7 

RULE TWO 模板二

北风吹 aired Girl

1=G 4

To Joy

RULE模板三 THREE

1=G 3 2

北风吹 White-Haired Girl

4 4

1     2     3      4     5      6     7 

4     5      6     7 

摇篮曲 Cradlesong

1=D 4 4

欢乐颂

Ode To Joy

08


Result: After using three RULEs, the results were not perfect, as well. Few obvious difference or emotion appeared. The first experience was failed.

Analysis for the reasons of failure I tried to express the emtion of each song, but the fact proves that it was not accurate. So this time I began to analysis the reason of failure. First of all, it is necessary to make sure that who is the audience. In addition, the object which was required to design is music. Moreover, the way of transform is between visional language and aural language. As a result, I had to find out the following significant issues: 1.What is the inwardness of music? 2.What is needed by deaf-mute? 3.To find a suitable method to transfer aural language into visional language. Giving up to only use theory, I turned to work with theory and practice, and faced every issue with a variety of aspects.

Visible Melody


Find out theory as soon as parctice

What is the main part of music? interview Prof. Qu Xuexuan come from China Conservatory Time: March 9, 2010 Place: China Conservatory inteviewee: Prof. Qu Xuexuan background of interviewee: Qu Xuexuan is the professor of China Conservatory and a member of Chinese Musicians Association. He graduated from Shenyang Conservatory Middle School and China Conservatory. Professor Jin Tielin is his teacher. After graduation from China Conservatory in 1992, he began to teach sudents in China Conservatory and China Conservatory Middle School. Prof. Qu Xuexuan held several national solo competitions and concerts, including 1997 National Minority Nationality Solo Competition. He won a number of prize. Prof. Qu has been invited to Japan, Hong Kong, Thailand, Singapore, Korea and so on. Prof. Qu always is the judge of National Vocal Music Competition. A couple of his students won many prize in defferent competitions. Prof. Qu took part in China Central TeleVision (CCTV) new years party several times. http://www.ccmusic.edu.cn/sdjsw/xjpx/200706/t20070612_1859.html

The summary of interview Music is very sentimental. Music can cure sickness. It is necessary to feel music from the beginning. Every musical note has its own emotion, thus; they can move people. The measure must be simple, so that the deaf-mute could understand directly. To find out a method, by which deaf-mute would be moved at first time then they will feel as follow. Find a way which is suitable for deaf-mute. It is benefical to be concrete and sentimental before being abstract and rational. It is possible to use seven colors to express, but it is needed to think about transition. It is accepted by deaf-mute at first then design for them. Designing music, you should not be limited by old rules, neither too abstract. It must be interesting. Never stillness. Never design music from a professional person's view, just to be a layman. Feel music by heart. The soul of music is emotion. The last sentence affected me deeply, as a result, I made sure the main part of my design.

10


Visible Melody


Image_explain my design motif for Prof. Qu 12


After understanding the main part of music, I focused on the deaf-mute.

What 's the demand of deaf- mute? Interview Director Yang Guanyuan in Beijing Second School of the Deaf

Image_interview Dirctor Yang Guangyuan Visible Melody


Interview record

Time: March 11, 2010 Place: No.32 Huayuan Beilu, Beijing Second School of the Deaf

Q: Is there any contacts between deaf-mute students and music? A: No, very few. Our school doesn't have this subject. However, we have dancing lessons. Students followed teachers' direction instead of listening music. Q: What are the subjects that deaf-mute students always have? And how? A: The lessons which our students have are the same as the normal ones. Only the method is different. Our teachers are teaching their students by sign language. Q: What is the interest of deaf-mute students? A: Their interests are familiar with normal students, such as web and computers. While their visions are very acute. They are interested in motional issues. Q: What is the most favorite subject for your students? Which subject your students dislike? A: They like Art very much. It is hard for them to understand subject like political lesson. Q: What are differents for your students to understand abstract and concrete? A: It is too difficult for our students to understand abstract things. Concrete ones are fine. However, they have few communication in daily life, so their minds are simple. Q: Please talk about the subject of art. A: Deaf-mute students like copy and they own the special understandings about colors, which are totally different from us. They have their individual minds to face art and color. Q: Do they feel happy everyday? A: It is benefical for a person who can hear, it will decrease amount of worry. But deaf-mute students have their own trouble, that is the reason why there are students in the psycho consulting room.

14


Investigation

The first questionnaire about understanding of music Time: March 15, 2010 Place: No.32 Huayuan Beilu, Beijing Second School of the Deaf Interviewee: All students and teacher in Class One Grade One Interview contents: the understanding about color, the basic knowledge about music, the feeling about musical instruments, the understanding about music, how long and how oftendo they connect with music?

The result: No matter the students are inborn deaf or postnatal deaf, few students have the connection with music or musical instruments. But it is worth to say that all of students love music, as well as art. The only thing which they feel worried is that there is no way for them to study or learn music and art. They all hope to have a chance to feel music someday.

Image_students finish the questionnaire Visible Melody


姚佳洁 开朗

刘烨

宁琪

具有生命力

青春 新奇

叶子 鲜艳 美丽

可爱 活泼

——

王卓群

祁仲辉

舒适 大海 天空

纯净

自然 清新 文静

洁白

平常

高洁

—— 高洁

文静 天真

简单 可爱 纯净

高大 有志向

活泼 可爱

简单 怒火 简单 无聊 失落 热情

高贵

蔡泽鹏

清新

温暖

可爱

遥远

舒 服

明亮

华丽

成熟

——

活泼

成熟

——

活力

鲜明 干净

——

害羞 单纯

任晓婷

默默

冷漠

——

舒畅 享受

简单 温暖 舒服

——

——

——

王皓

开朗 豪迈

可爱 漂亮

可爱

热情 —— —— 生气 可怕 —— 温暖

热情 热情

冷漠

——

——

——

暖和

美好

——

深沉

热情 盲人

浪漫

洁白 飞翔

热情

——

纯净

沉闷

火热 失落 高贵 冷漠

冷 静

冷酷

柏志强

没感觉

乌云

简单

深 邃 正大光明

气盛

浪漫

——

纯净

柔和 可爱

温顺

——

纯净

——

素雅

冷静 鲜艳

牙疼

洁白

温暖 希望

徐圣齐

——

—— ——

热心 夜晚 激动 冷酷

——

——

高洁

——

——

——

——

何欣蕊

——

默默

——

——

——

黄土

悲伤

——

青 年 人 橙色衣服

平淡 平凡 和

——

天空 谐

善良 文静 快乐

——

冷淡

孙立佰

开朗 凉爽

——

迟钝

——

——

纯洁

李孟力 生命力 精神

王娇燕

保护环境

叶飞

Image_poster design the color cannot be said 16


Questionnaire summary Because deaf-mute are good at understand concrete issues, and are sensitive with active things, so I made a decision to use active video to expain music. With the help of active videos, the deaf-mute could understand the emotion of music rapidly. Due to the limitation of my first questionnaire, it is not unnecessary to make a second questionnaire with a large number of people who are in different ages, own various jobs and experiences, so that the result will be correct.

The second questionnaire about active videos Time: March 30, 2010 Place: No.318 Guanganmennei, Xuanwu District, Beijing Association for the Handicapped Number: 150 Interview contents: Which kind of TV programs and movies do they usually watch? The demand for them to active videos.

Image_Beijing Association for the Handicapped Visible Melody


Active videos From the results of two questionnaires, It is obvious that the deaf-mute need for music, and they are very sensitive about the form of active videos. Thus, with the emotion which is the soul of music, I designed four active videos with four emotions. They are happiness, sadness, anger and fear.

Active videos script

happiness

sadness 18


anger

fear Visible Melody


Active videos screenshots happiness

sadness

anger

fear

20


Active videos feedback

Image_Miss Gao explain the titles of questionnaire

Image_operations area Visible Melody


Image_deaf students are watching active video

Image_deaf students are thinking

Image_deaf students are finishing the questionnaire

During the questionnaire, more than 78% of deaf-mute could understand all the information in the active videos, only 22% could understand half of the main points. Active videos get success. 22


The use of other senses From the feedback which got from the deaf-mute, active videos make sence. So in the following parts, I decided to use more sense to express music, as a result, deaf-mute could understand more effectively.

Method ONE: through the painters' minds and actions I invited two painters to draw as soon as listen the music. There is no limit of paper size, composition of a picture and material of drawing. During a period of time, painters had to express their feelings about music.

Image_two painters are drawing Visible Melody


Image_feeling 01

Image_feeling 15 24


Image_feeling 18

Image_feeling 17 Visible Melody


Image_feeling 04

Image_feeling 24 26


Method TWO: with the help of medical equipment, I recorded normal people's heartbeat when they hear different emotion of music Record ten of normal people's heartbeat when they listen music. With these images, deaf-mute can feel the tempo of music.

Visible Melody


Image_electrocardiogram 28


Method THREE: with the help of touch, I made emotional sculptures Basing on the analysis done of the music score, I got special points. Use different materials to express happiness, sadness, anger and fear. With the help of touch, deaf-mute could feel directly and effectively,

happiness

sadness

anger Visible Melody


anger

fear 30


New way of expressing symphony and music score

By using more senses to express music, deaf-mute could feel and understand music, it is a progress of both form and effect. Moreover, I began to explore a new way to express symphony, as well as music score.

Fresh form about music score of symphony of butterfly lovers Fresh form of music score used the results and feedback, both of which came from the investgation before. It was the continue of active videos and emotional sculptures. Nowdays, staff and numbered musical notation are required people to own the knowledge of music when they use and read them. For deaf-mute, it is hard to communicate with others, thus; they need a method to comprehend music score directly and simply. In my design of music score, it is easier for deaf-mute and normal people to read and see, indeed, I added more information into music score, such as, emotion and musical instrument, both of which are never appear in the music score before.

Introduction of music score There were 23 types of musical instruments that plaied in music score of symphony of butterfly lovers, I used 23 kinds of figures to represent with different colors.

长笛 Flauti

A调单簧管 Clarinetti(A)

F调圆号 1 Corni(F) 1

Bb调圆号

长号 2

鼓板

竖琴 2

Trombe(B )

Tromboni 2

Gu Ban

Tam-tam

Arpa 2

b

双簧管

大管

F调圆号 2

长号 1

定音鼓

竖琴 1

钢琴 1

Oboi

Fagotti

Corni(F) 2

Tromboni 1

Timpani

Piatti

Arpa 1

Piano 1

Visible Melody


钢琴 2

第一小提琴

中提琴

低音提琴

独奏小提琴

第二小提琴

大提琴

Piano 2

Violini 1

Viole

Contrabassi

Violino solo

Violini 2

Violoncelli

Music score was divided into three movements: fall in love, refuse to marry and change into butterfly According to development of story, there are different musical instruments with various tempo, pitch and frequency. All of these difference can be found in this music score, which can help deaf-mute to feel and understand music and symphony easily.

Fore movement: grace & cheer

32


Middle movement: anxiety & indignation

看得见的旋律 展开部

梁祝交响乐总谱 ——

Last movement: sorrow & miserableness

看得见的旋律 再现部

梁祝交响乐总谱 ——

Visible Melody


Interactive Design Finshing the new style of music score, I turned to design an active way, by which deaf-mute could take part in and create their music by themselves with this Interactive Design. There were several given buttons to represent different musical instruments, audience could choose the musical instrument which they prefer to use them to perform a concert. According to a variety of musical instruments which own their speical characteristics, the image and movement are totally different. So that not onlt the deaf-mute, but also the normal people could feel the energy in music and know more about musical instruments.

screenshot of active music score 34


The final exhibition

After hundreds of days and nights, on May 23, 2010, my graduation design visiable melody was showed on the 7th floor in No.7 building of CAFA. In the exhibition, emotional sculptures, active videos, music score of symphony butterfly lovers and interactive design were exhibited, some questionnaires were also put as a part of my design.

Image_books in the exhibition Visible Melody


Image_screen and keyboard of Interactive Design 36


Image_musical symbol in the exhibition Visible Melody


The direction of research in the future

Although the transformation obtained a couple of achievements at this time, for deaf-mute and their soundless world, there is a new way for them to relax and feel life. It was just a beginning, a starting point of a poject. Music is a measure which owns many aspects, if I want to express the whole part of music, more things have to be done. With the result I have got this time, in the future, I can add more issues, such as musical instrument, by which I can classify them into different parts. Olfactory is also a great way to express my design. More angle, more phase and more orientation I will use. I hope that with the help of my design, the deaf-mute could possess a life which is full of happiness and delight. 38


Visible Melody


Visible Melody