M.Des Graduation project thesis Visual Communication Rohan Vyas

GRADUATION PROJECT VISUAL COMMUNICATION (MASTER OF DESIGN)

Vol. 1 of 1

Project Title:

Mobile application design for learning sign language Name:

Rohan Vyas ( UA1719043 ) Project Mentor:

Rahul Bhattacharya

2019

The Graduation Project Evaluation Jury recommends ROHAN VYAS from Visual Communication for the Master’s Graduation Degree of Unitedworld Institute of Design, Karnavati University, Gandhinagar, India herewith, for the project titled Sign Language. The project is c omplete in every aspect in accordance to the guidelines set by the institution.

Chairperson

Members

Signature

Name

Organization

Signature

Name

Organization

Signature

Name

Organization

Signature

Name

Organization

*Subsequent remarks regarding fulfilling the requirements

Rohan Vyas | Graduation Project 2019

COPYRIGHT Š 2019

Student document publication, meant for private circulation only.

All rights reserved.

No part of this document will be reproduced or transmitted in any form or by any means including photocopying, xerography, photography and videography recording without written permission from the publisher, Rohan Vyas and Unitedworld Institute of Design. All Illustrations and photographs in this document are Copyright Š 2018 by respective people and organizations.

Written and designed by Rohan Vyas, under the guidance of Rahul Bhattacharya.

Printed digitally in Chaap, Ahmedabad December, 2019.

4

Mobile application for sign language

ORIGINALITY STATEMENT

COPYRIGHT STATEMENT

I hereby declare that this submission is my own work and it contains no full or substantial copy of previously published material, or it does not even contain substantial proportions of material which have been accepted for the award of any other degree or diploma of any other educational institution, except where due acknowledgment is made in this degree project. Moreover I also declare that none of the concepts are borrowed or copied without due acknowledgment. I further declare that the intellectual content of this degree project is the product of my own work, except to the extent that assistance from others in the project’s design and conception or in style, presentation and linguistic expression is acknowledged.

This degree project (or part of it) was not and will not be submitted as assessed work in any other academic course.

I hereby grant the Unitedworld Institute of Design the right to archive and to make available my degree project/thesis/dissertation in whole or in part in the Institutes’s Knowledge Management Centre in all forms of media, now or hereafter known, subject to the provisions of the Copyright Act. I have neither used any substantial portions of copyright material in any document nor have I obtained permission to use copyright material.

Student Name in Full: Date:

Student Name in Full: Signature: Date:

5

Rohan Vyas | Graduation Project 2019

6

Mobile application for sign language

Mobile application design for learning

Sign Language

7

Rohan Vyas | Graduation Project 2019

INDEX

01.

02.

INTRODUCTION

RESEARCH

About UID About Mentor About Me Timeline Proposal

8

14 18 19 20 21

Pre research Primary research Secondry research

24 34 48

Mobile application for sign language

03.

04.

ANALYSIS & SYNTHESIS Problem analysis Gamification Problem synthesis Concepts

05.

REDEFINED BRIEF 58 61 78 82

Defining the user UX design Visual design

DESIGN 94 113 126

User flows Mockup Epilogue

152 158 168

9

Rohan Vyas | Graduation Project 2019

Acknowledgement This project marks the end of my journey in Master’s in Designing. And I want to take a moment to express my gratitude towards everyone who have made it possible for me to come this far.

Being an engineering student it was difficult for me to change my stream and start again. It was only possible because of the support from my parents. It was the belief of my mother and father that gave me strength in difficult times and strengthened my belief in myself.

A special thanks to Snigdha ma’am, Sudhanya ma’am and Sambit sir for always being there.

For teaching me about art, writing and life. And helped me become a gentler and a truer person.

I extend my gratitude towards my mentor, Mr Rahul Bhattacharya for his valuable inputs and time-to-time feedbacks. I thank Ms Lolita Dutta , Head of Department, Visual Communication, Unitedworld Institute of Design and my other

10

faculty members for providing valuable feedback during the project. Their contribution has been effective in all respects of the projects.

I want to that the Deaf mute school in Ahmedabad and the Deaf enabled foundation to let me research with them and providing me with the necessary help for the project development.

And finally, the great friends who have been there throught this journey, who have seen the highs and lows together. Satyam, Nandita, Snehal, Padmaja, B11 people, to name a few. This journey would not have been memorable without you.

Mobile application for sign language

Why this project Purpose of design education is to develop sensitivity amonst students. And the design curriculam in UID is made in such a way so we learn to see the issues faced by people around us and also to provide solutions to the problems.

One such issue I saw my friend facing is inablity to connect with other people. My friend, Arpit Gupta, is dignosed with deficiency in hearing and speaking in an early age. He uses hearing aid and was trained by vocal trainers so that he can communicate effectively. But even after all the measures, I see him facing the issue of social connectivity. And that inspired me for taking this project and designing my graduation project.

An Ideal society should be one which accepts everyone and is ready to change/ learn in order to mae the people comfortable. So with this project I aim to research and learn about deaf people and their culture. And look for a way to reduce the gap between the society and the people

11

Rohan Vyas | Graduation Project 2019

“Design is a not for philosophy it’s for life ” ~Issey Miyake

12

Mobile application for sign language

01

INTRODUCTION About UID About Mentor About Me Timeline Proposal

14 18 19 20 21

Unitedworld Institute of Design

13

Rohan Vyas | Graduation Project 2019

About UID Unitedworld Institute of Design is one of the premier design institutes of India. It was found in 2012 as a constituent college of Karnavati University. It has been built on a strong foundation of teaching, learning, innovation and research excellence in design education.

UID aims to create globally sought - after professionals who can exibit their creativity and trigger novel trends. It offers a diverse range of UG & PG courses through various departments; Visual Communication (Graphic design), Animation and Motion Graphics, Fashion Design, Lifestyle and Accessory Design, Textile Design, Interior Design, Industrial Design and Automobile and Transportation Design.

14

Mobile application for sign language

15

Rohan Vyas | Graduation Project 2019

16

Mobile application for sign language

About the batch Post graduate batch of Visual communication 2017-2019 is more than a classroom. The experiences, initiatives and the conflicts have seen both highs and lows amongst this group of people. Coming from such diverse work and education background brought a unique taste to this mixture. We were more than just sixteen people studying together, we were sixteen different minds and hearts working in harmony to create a memorable journey.

This space is not enough to describe the amount of talent the class holds. Although coming from such different walks of life we all bonded so well that all the hardships and challenges felt like fun activity. The best modules were the ones which we faced as groups. Everyone with their saperate skillsets and interests completed everything.

I feel extremely grateful to have an opportunity to learn from everyone. Product designers, fine artist, contemporary artists, engineers, to meantion a few. Developing skills from sketching then foundation for design, every part of process would not have been possible without the ever ready support from the dear classmates.

Making magzines, directing plays, creating packaging, researching food and may other group activities, with these people will always be the best part of my experience in the design journey.

17

Rohan Vyas | Graduation Project 2019

About mentor Rahul Bhattacharya is an educationist, art historian and a curator; currently Associate Professor at the Department of Visual Communication. He has been pursuing independent writing, curating exhibitions, art education spaces and large scale public art projects. Over the last 15 years, he has been associated in teaching in various capacities in institutions such as GNLU, NIIFT, MS University of Baroda, Pearl Academy, WUD amongst others.

He has also been designing communications for events, exhibitions, and artworks as well as consulting private collections. He was the Managing Editor of Art&Deal Magazine and the founding Conveyor MATI. Co founder of ‘Regional Arts .Performance and Events’ Since 2014 he is a part of the NINE Schools of Art collective working towards developing workshop based teaching methods for art.

He has written extensively various journals and publication. He maintains his blog http:// theblackyellowarrow.blogspot.in/.

18

Previous position held: · Asssociate Professor - School of Visual Arts , World University of Design Curator | Director Public Outreach – Designed the outreach program, implemented media tie partnerships, built partnerships with local artist. · Conveyor MATI (Management of Art Treasures of India) , January 2013- June2013.

Was responsible for setting up the NGO, drawing its Charter and curating the nature of programming. Also looked after MATI fund raising show and was focused on building in financial sustainability within the programming structure. · Managing Editor - Art&Deal magazine.

Since October 2009-November 2011.Was responsible for repositioning the magazine as a quarterly and then in order to rebrand the magazine for the advertisers, was responsible for their conceptualising, redesigning and launch of India’s first monthly art magazine.

January2006 - May 2006: ‘Critic in Residence’ at KHOJ International Artist’s organization

Mobile application for sign language

About me I feel fortunate for getting the opportunity to learn from so many people around me. I studied IT engineering for my bachelor’s and worked two years as a software developer before realising my true potential lies in problem solving.

Design education made me a gentler person. I learned about art and poetry. I did plays and learned about acting as a craft. I started writing for expressing myself and learned how less means more both in design and in life If I have to give a metaphor to explain who I believe myself to be, I’d say a dandilion. I want to share my talents and gifts to world and want to see the world becoming a even better place.

And as a professional, I believe in strong work ethics. And with all the experience and knowledge I have, I aim to provide valuable service and to touch people’s lives with my work.

I like to read and write soemtimes. Hindi is a language that makes me want to write. And someday I want to publish a book of my own.

Unitedworld Institute of Design

19

Rohan Vyas | Graduation Project 2019

Timeline

17th

Aug

Research Conceptulisation Visualisation Prototyping Testing/Feedback Documentation

20

10th

Sept

13th

Oct

12th

Nov

10th

Dec

Mobile application for sign language

Proposal Project Background

Project Brief

Phase 3: Design

In India the population of deaf and dumb people is more than 10 carore and we have very less sign language interpretors.

The aim of the project was to make usage of Sign Language a part of regular communication within everyone.

Turning the concept into a tangible design. With a consistent visual identity.

The deaf-dumb people faces diffuclty on every phase of life, may it be education or job or simple conversations. The situations is worse in some places where other people refuses to use sign language even for communicating basic information.

Phase 1: Research

Project Context

Phase 2: Concept

The target area is to create awareness for sign language and provide a medium through which interested people or any laymen can learn Sign Language

Try to understand the mindset of the deaf-dumb person and the people who are associated to them. And research about existing institutions for them.

Based on my reaserch I want to create a design/ plan that can help people to know about sign language and learn it if they want to. And provinding a overview of lives of deaf-dumb

Phase 4: Prototype I would then create a working prototype that explains how the whole system would look when function

Phase 5: Testing/Feedback I will approach the targeted users and understand their iews on the system.

Phase 6: Documentation

The whole process from the research to the final design will them be compiled to a single document to show the process.

Unitedworld Institute of Design

21

Rohan Vyas | Graduation Project 2019

“Knowledge is love and light and vision.” ~Helen Keller

22

Mobile application for sign language

02

RESEARCH Pre Research Primary Research Secondary Research

24 34 48

Unitedworld Institute of Design

23

Rohan Vyas | Graduation Project 2019

Pre-research Deaf Hearing loss, also known as hearing impairment, is a partial or total inability to hear. A deaf person has little to no hearing. Hearing loss may occur in one or both ears. In children, hearing problems can affect the ability to learn spoken language and in adults it can create difficulties with social interaction and at work. In some people, particularly older people, hearing loss can result in loneliness. Hearing loss can be temporary or permanent.

Hearing loss may be caused by a number of factors, including: genetics, ageing, exposure to noise, some infections, birth complications, trauma to the ear, and certain medications or toxins. A common condition that results in hearing loss is chronic ear infections. Certain

24

infections during pregnancy, such as cytomegalovirus, syphilis and rubella, may also cause hearing loss in the child.

Hearing loss is diagnosed when hearing testing finds that a person is unable to hear 25 decibels in at least one ear.

Testing for poor hearing is recommended for all newborns. Hearing loss can be categorized as mild (25 to 40 dB), moderate (41 to 55 dB), moderate-severe (56 to 70 dB), severe (71 to 90 dB), or profound (greater than 90 dB).

Source : https://en.wikipedia.org/ wiki/Hearing_loss

Mobile application for sign language

Source : https://en.wikipedia.org/wiki/Hearing_loss

25

Rohan Vyas | Graduation Project 2019

Key Facts

6.7 million could benefit from hearing aids but only about 2 million people use them.

26

Around 466 million people worldwide have disabling hearing loss, and 34 million of these are children.

It is estimated that by 2050 over 900 million people will have disabling hearing loss.

Mobile application for sign language

Hearing loss may result from genetic causes, complications at birth, certain infectious diseases, chronic ear infections, the use of particular drugs, exposure to excessive noise, and ageing.

60% of childhood hearing loss is due to preventable causes.

1.1 billion young people (aged between 12–35 years) are at risk of hearing loss due to exposure to noise in recreational settings.

27

Rohan Vyas | Graduation Project 2019

Solution and Tech inovations

28

Source : https://en.wikipedia.org/wiki/Sign_language

Source : https://en.wikipedia.org/wiki/Hearing_loss

Sign languages

Sign language gloves

(also known as signed languages are languages that use the visual manual modality to convey meaning. Sign languages are expressed through manual articulations in combination with nonmanual elements. Sign languages are full-fledged natural languages with their own lexicon

Roy Allela, a 25-year old engineer and inventor from Kenya, has found the ultimate solution to bridging the communication barrier between deaf and hearing people. He has invented the Sign-IO gloves that can translate signed hand movements to audible speech so deaf people can “talk” even to those who don’t understand sign.

Mobile application for sign language

Google’s Sign language AI

Samsungs’ Good vibes

The ability to perceive the shape and motion of hands can be a vital component in improving the user experience across a variety of technological platforms.

The Good Vibes app uses Morse code to convert vibrations into text or voice and vice-versa.

Image source : https://www.bbc.com/news/ technology-49410945

Image source : https://www.samsung.com/in/microsite/goodvibes/

29

Rohan Vyas | Graduation Project 2019

Situation in India In India, there is no officially recognised sign language system. As a result, 99 percent of hearing-impaired people are either uneducated or drop out after Class VI or VII, because they are not able to cope. There are hardly any people with hearing impairment who have cleared Class X. One reason is the tremendous shortage of sign language interpreters and trained teachers.

India has no captions on television, instructions or signage in public spaces, TTY (accessible telephone), instruction through sign language in schools and no specialised college or university.

Even on railway stations there is no signage in sign language to help deaf people. All the announcements are audio based.

According to government’s law, no institution can deny admission to a student on basis of hearing disability. But teachers are not trained to teach Image source : https://www.bbc.com/news/technology-49410945

30

Mobile application for sign language

Indian Organisations to support deaf people National Association of the Deaf (New Delhi) Ali Yavar Jung National Institute for the Hearing Handicapped (Mumbai) All India Federation of the Deaf (New Delhi) Bihar Association of the Deaf (Patna) Deaf Can Association (Bhopal) Delhi Association of the Deaf (New Delhi) Delhi Foundation for Deaf Women (New Delhi) West Bengal Society for the Deaf (Kolkata) Madras Association of the Deaf (Chennai) Tamil Nadu State Federation of the Deaf (Chennai) All India Sports Council of the Deaf (New Delhi)

31

Rohan Vyas | Graduation Project 2019

Society for the Education of the Deaf and Blind (Andras Pradesh) Welfare Centre for Hearing and Speech Handicapped (Haryana) Central Society for the Education of the Deaf (Maharashtra) Education Audiology and Research Society (Maharashtra) Aural Education for the Hearing Impaired (Maharashtra) Shri Swami Samarth Special Teacher Training Institute (Maharashtra) Badhit Bal Vikas Kendra (Rajasthan) Deaf Relief Association of Calicut (Kerala) Helen Keller Institute for Deaf and Deafblind (Maharashtra) Multipurpose Training Center for the Deaf Delhi) Deaf and Dumb Industrial Institute of Latur (Maharashtra)

32

Mobile application for sign language

33

Rohan Vyas | Graduation Project 2019

Primary research

Deaf Mute school, Ahmedabad Established in the year 1908 by Late Shri Pranshankar Lallubhai Desai, this institute took the initiative of training and educating students with Hearing and Visual Impairment.

With the aim of empowering Persons with Disabilities, the School for the Deaf-Mutes Society caters to the educational needs of Students with Disabilities, followed by vocational needs as well, Thus, education along with generation of employment opportunities is focused upon.

34

Mobile application for sign language

Image source : http://www.deafmuteschool.com/history/

35

Rohan Vyas | Graduation Project 2019

Education and boarding facilities are made available, free of cost and emphasis is laid on early identification of disability and training

They have various initiatives: School for the Deaf School for the Blind Kalpana Balmandir ITI Training Centres Training College for the Teachers of the Deaf Training College for the Teachers of the Blind Physiotherapy College for Persons with Visual Impairment

36

Mobile application for sign language

History The school initially catered to the educational needs of Students with Hearing Impairment only.

The School for the Blind was started in the year 1945, and was inaugurated by the then Chief Minister, Morarjibhai Desai in 1952. Eventually, Teacher Training Colleges were started for educating and training teachers as Special Educators along with setting up of vocational training centres for Persons with Disabilities as well. In the past 43 years, 1974 to 2017, a total number of 28,095 students have received education from our institute.

The institute has a strength of more than 600 students, hailing from different parts of the state, and education, boarding and lodging facilities are provided free of cost.

37

Rohan Vyas | Graduation Project 2019

Image source : http://def.org.in/

38

Mobile application for sign language

Deaf Enabled Foundation (DEF) Hyderabad Deaf Enabled Foundation is one of the indian organisations that provides the course for sign language interpretor.

In India there are 18 million hearing impaired population and only 400 interpretors.

DEF has centres in Chennai, Hyderabad, Indore and Pondicherry. They provide basic sign language courses which anyone can learn.

Courses are of 1 month and 3 month duration.

The interpretor course is 1 year to 1.5 year long and then the person can opt for the interpretor They focus on teaching Indian Sign Language and one of three intitutes that provides a diplom.

Since sign language is not common throught the country. Its only 75% that is common and other part gets influenced by region and religion.

39

Rohan Vyas | Graduation Project 2019

Case studies (Qualitative research) 1. Arpit Gupta Arpit was born with hearing impairment but was raised ike a normal kid.

Arpit was born and brought up in Delhi. He was not responding to any sounds when he was born and at the age of two his parents got him checked and realised that he can’t hear.

His parents worked hard to educate him and make him self sustainable. He went through rigorous vocal training and hardships in order to be a part of speaking society.

He completed his school education while living in a bording school. He did his bachelor’s in designing from Symbiosis institute of design, Pune. And currently pursuing his master’s in designing from UID Ahmedabad.

At an early age he realised that he needs to work hard in order to develop. He does not feel

40

himself to be infirior to anyone and is always ready to help other people in whatever way he can. Arpit is my classmate and has been my friend since the first day of college. Because of his friendly and helpful nature he is liked by everyone. He has a good knowlege of graphic designing and is proficient in every industry used designing software. We have worked together on many projects and we also did a play which we performed in front of whole college. Arpit’s confidence over his skills and awareness about his weaknesses made him a good designer and also a good friend.

Mobile application for sign language

2. Rakesh Chandra Gupta Mr Rakesh is a father of a hearing impaired child.

He shares his experience of educating him He is the father of Arpit. His son was 2 years old when he realised that his son has hearing deficiencies. he shared his experiences of raising his son and making him self sufficient. He, as a father, wanted the best for hi son but the nature has not given him the gift of hearing. But Mr Devendra Gupta didnt take this as a weekness, he realised their familie’s life will be diffcult but not any less than the best.

big task as most school did not take him because of his deficiencies. So he took help from different government officials to make it possible. As according to supreme court’s orders no institute in india can deny admission to any kid on basis of their deficiencies. Arpit was very comfortable in his home and was not developing much, so he sent him to a bording school so that he can learn to live with other kids. It was a difficult phase of his life as he is not able to commnicate with his son. But because of his efforts Arpit has become a responsible and confident man and is serious about his career.

He made the decision that Arpit will be raised like a normal kid and refused to teach him sign language and lip reading. He provided Arpit with best hearing machines available in the market and there were two vocal trainers to prepare his speech. Arpit’s admission in schools was also a

41

Rohan Vyas | Graduation Project 2019

3. Pooja Sharma Pooja’s parents can’t hear or speak. She learned sign language to communicate with them.

She was born in a family of deaf parents. She shared her experience of her upbringing with me.

She was aware about usage of sign language from her childhood and can recognise signs. Her education was mostly done by her teachers. Her education went well, she is an architect now. She has also started her organisation to teach sign language to people and spread awareness about.

42

Mobile application for sign language

4. Swati Sohoni Swati was born with hearing impairment. And was educated in a deaf institute. She’s currently a board member of deaf enabled foundation.

Her family supported her at every step to grow as a person. Her sister told that when she was a kid she was very attached to her family and made her brother and sister learn sign language to communicate with her. She has studied till 10th std and then she joined with DEF foundation and currently she is one of the board members of DEF, she takes care of the executive board. Her sister told that she was in a bad state when her husband passed away but her friends from the deaf community supported her. She is ssociated with the foundation and the social work they do their and that keeps her occupied.

Question: Do you know sign language? Where did you learn it Answer: Yes I know sign language, I am deaf and I have known it since childhood Question: How long was the course?

Answer: For normal people it takes around 3 months to 1 year Question: Do you think other people can learn basic sign language quickly Answer: Anyone can learn sign language from Deaf Enabled Foundation Question: Would it be helpful for you if everyone knows a little bit of sign language?

Answer: It will be helpful for me as I will be able to communicate to more people. It is the mother tongue of deaf community

43

Rohan Vyas | Graduation Project 2019

5. Radhika Chandratrey Radhika is a normal child. She learned basic sign language to commnicate with kid’s of deaf institute.

She is a student of designing, pursuing masters in UID. She has had an experience of working with NGOs and doing social works.

She has an experience with sign language as she needed to learn sign language to help hearing impaired kids on an NGO. She shares her experience with sign language saying that it is easy to learn and comminicate with signs. Basic sign language can be taught and learned over few weeks and everyone can learn it.

44

Mobile application for sign language

Survey (Quantitative research)

45

Rohan Vyas | Graduation Project 2019

46

Mobile application for sign language

“They should be given more support from anyone around them” “Sometimes it’s good talking to them in there sign language...”

“Sympathetic but couldn’t empathize clearly” “I think they are more talented than people with hearing and speaking disability as far as I observe” “They should be treated equally and their sign language must be mandatorily known by all” “No views...I think they have a different way of doing things but are perfectly normal” “I feel I won’t be able to talk to them due to language barrier “ “They are special ppl but in india we dont utilise their speciality U need patience to be with them”

47

Rohan Vyas | Graduation Project 2019

Secondry research Indian Sign Language William Tomkins Plains Indians from different tribes speaking different languages were nevertheless able to communicate facts and feelings of considerable complexity when they met. They used a language composed of gestures made almost entirely with the hands and fingers, probably the most highly developed gesture language to be found in any part of the world.

Convey the meaning of over 870 common words — hungry, camp, evening, angry, fire, laugh, owl, cat, many times, brave, cold, heart, rain, spotted, together, river, etc. The words are then used in sample sentences.

48

This is a book for anyone who wants to learn or teach Indian sign language — scouts, school teachers, camp counselors, scout leaders, parents, linguists, and students of Indian culture.

Mobile application for sign language

49

Rohan Vyas | Graduation Project 2019

Mother Father Deaf Paul Preston Almost 90% of the children born to life-long profoundly deaf parents are hearing. Within this extraordinary family setting, hearing children of deaf parents are exposed to and interact with two differing cultural, social and linguistic systems: that of their deaf parents and the Deaf community, and that of hearing peers and adults.

This book focuses on cultural identity and affiliation of hearing children of deaf parents--a population whose lives incorporate the paradox of being culturally ‘Deaf’ and yet functionally hearing. Data reported here are primarily based on interviews and life histories with 150 adult hearing children of deaf parents throughout the United States. The informants in this study provide an opportunity to explore the parameters and norms of Deaf culture as it contrasts and conflicts with those of Hearing culture.

Image source : https://www.goodreads.com/

50

Mobile application for sign language

What is Sign Language Poetry?

Sutton-Spence, Rachel

“It is almost impossible to define poetry without assuming that the reader already has an idea what it is. Given this, the question then arises that ow we know that something is a poem, and the most useful answer is that the text itself signals that it is. In this book we will be looking at details at what those signals are, where sign language poetry shares them with spoken language poetry and where sign language invents its own signals.�

Image source : https://www.goodreads.com/

51

Rohan Vyas | Graduation Project 2019

Sign Language poetry example Five Senses

Composed and performed by Paul Scott Excuse me, but who are you?

Who am I? Come with me and see.

Feel your arms tingle at my embrace.

Reach out - oh, that’s cold!

Reach out - oh, that’s hot!

So, now you know me.

Excuse me, but who are you?

Who am I? Come with me and see.

A lick of ice-cream - mmm A scoop of that - yuck!

A scoop of this - yum!

So, now you know me.

Excuse me, but who are you?

Who am I? Come with me and see.

Pick a flower and sniff - lovely!

Take some cheese from the fridge - whiffy!

Pop this tasty morsel in your mouth, Yes, and it smells good too.

52

Mobile application for sign language

Sign Language is my superpower Austin Vaday is a 21-year-old software engineer, innovator, and entrepreneur. After becoming deaf at the age of 3 , Austin has proved to the world that disabilities are super-powers, not disadvantages. https://www.youtube.com/ watch?v=OFlZdH2xEe8

Image source : https://www.youtube.com/watch?v=OFlZdH2xEe8&t=97s

53

Rohan Vyas | Graduation Project 2019

Situation in India Healthissuesindia.com

Yourstory.com

Youthkiawaaz.com

“There are just 388 schools for the deaf in India and the absence of sign language interpreters in many classrooms highlights how much of a struggle schooling can be for deaf children.

Consequently…99 percent of hearing-impaired people are either uneducated or drop out”

In India, there is no officially recognised sign language system. As a result, 99 percent of hearing-impaired people are either uneducated or drop out after Class VI or VII, because they are not able to cope. There are hardly any people with hearing impairment who have cleared Class X. One reason is the tremendous shortage of sign language interpreters and trained teachers.

Our society conditions us to be uncomfortable around disabilities, anything that is beyond the pale of ‘normal’. I, myself, grapple with the prejudiced misconceptions I’ve picked up from others over the years.

Yourstory.com There is a misconception that children born to the deaf also suffer hearing impairment. On the contrary, 90 percent of those born to such disabled parents have perfect hearing while the remaining are amenable to treatment.

54

Mobile application for sign language

Image source : https://yourstory.com/tag/deaf-culture

55

Rohan Vyas | Graduation Project 2019

“Design is a plan designing is planning a designer is a planner� ~Unknown

56

Mobile application for sign language

03

ANALYSIS & SYNTHESIS Problem analysis Gamification Problem synthesis Concepts

58 61 78 82

57

Rohan Vyas | Graduation Project 2019

Problem analysis Main problems identified in the research: • There is a belief that deaf people are not accepted in the society.

• Education system does not do much to develop sensititvity amonsts students for deaf people • Education is difficult for deaf-dumb people as there are not much teachers trained to teach them • There is no-updated online platform to teach people sign language

58

Mobile application for sign language

59

Rohan Vyas | Graduation Project 2019

Solutions

1. Visual campaign

Spread awareness in society for showing sensitivity towards deaf people

Pros: • Easily communicated to the people • People can be educated how to treat hearing impared people • Awareness can be spread

Provide a free learning platform for people who are interested in Sign language An entertainment platform that awares people about deaf people.

Design Ideas

Cons: • Sign language can’t be taught through still images • Mere awarenes can’t solve the issue • Any education medium is needed

1. Visual campaign to spread awareness 2. Entertainmement game that makes people learn Sign language 3. Mobile application that gives lesson on sign language

60

2. Entertainment game Pros: • People can be hooked through a game • Teaching can be made uncouncious • Awareness can be spread via ads

Cons: • Primary aspect is fun not education • Game needs to be very well designed to balance fun and education

Mobile application for sign language

Gamification

Image source : https://www.interaction-design.org/courses/gamification-creating-addictive-user-experience

61

Rohan Vyas | Graduation Project 2019

Simply put, gamification is the application of game-like thought and game-mechanics to contexts that have not traditionally been gamedriven. That’s not to say that we as designers should set out to trivialise the more serious aspects of life, however. The idea rings truer of making those serious aspects more inviting so that users may be more likely to engage with what otherwise would involve their resigning themselves to mind-numbing but important tasks.

Image source : https://www.interaction-design.org/courses/gamification-creating-addictive-user-experience

62

Mobile application for sign language

What do You Need from Gamification?

Gamification, the process of incorporating aspects of games into more mundane tasks, is an exciting field. In fact, it’s so exciting that people’s expectations of

the gamification process can become unreasonable or unrealistic.

Image source : https://www.interaction-design.org/courses/gamification-creating-addictive-user-experience

63

Rohan Vyas | Graduation Project 2019

Popular Myths

1. Yes, but Games Aren’t Work Are They?

That’s the last thing a business wants – lazy people slacking off on their time. Yet, the truth is that gamers are often the most highly motivated people Image source : https://www.interaction-design.org/

64

Mobile application for sign language

2. Gaming is for Kids, not Business People

3. But Games are For Men Only, Right?

4. Work is Work and Play is Play

Its survey in 2012 showed that the average computer gamer is nearly 30 years old and has been playing computer games for the last 12 years. Nearly 70% of gamers are older than 18.

Teenagers and children are—in fact—the minority of gamers – not the majority.

The same ESA survey shows that just under half of all gamers are women. The fastest growing segment in gaming is women over the age of 18.

Social games such as Farmville and Candy Crush are very popular with women—and they make up the majority of users in many social games.

Gamification’s purpose in the enterprise environment is to make work more fun and engaging, not to distract from work.

65

Rohan Vyas | Graduation Project 2019

Player centred design Player-centred design acknowledges that a game is to be played and looks at the key ingredients of making a game work for the player User-centred design uses the yardsticks of efficiency, effectiveness and satisfaction to evaluate designs. Player-centred design adds engagement to this list. While user-centred design asks the question, “Can the user use the product efficiently, effectively and satisfactorily?”, playercentred design asks, “Do they want to use it in the first place?”.

Image source : https://www.interaction-design.org/courses/

66

Mobile application for sign language

Player types for Gamification There are four player types according to Bartle: Socializers, Explorers, Achievers and Killers. A gamification environment may consist of all or any combination of these types.

Careful player research helps to understand which player types dominate the environment and thus help define how to cater to their needs.

Image source : https://www.interaction-design.org/courses/

67

Rohan Vyas | Graduation Project 2019

SMART missions A Specific, Measurable, Actionable, Realistic and Time-bound (SMART) mission offers us the ability to show that we have achieved (or not achieved) what we set out to do. If we haven’t achieved our mission, it enables us to see how close we came to achieving it. If we have overachieved, it lets us see by how much.

“Because it is there.”

— George Mallory, English mountaineer (on being asked why he wanted to climb Mount Everest)

68

Image source : https://www.interaction-design.org/courses/

Mobile application for sign language

The Four Basic Principles of Fun in a Game 1.

2.

3.

4.

Goals Rules Feedback Voluntary Participation

Goals give a game a sense of purpose and

enable us to feel pleased when we succeed – an essential component of fun. Achieving them empowers us with a feeling of accomplishment, while giving closure to the story of the challenge we accepted while playing the game

Feedback. We also need to know how well

we’re doing within the context of the rules and the goals. In Tic-Tac-Toe, feedback comes quickly – a game lasts barely a few seconds.

Rules restrict the means to achieving our goals.

Rules help us become creative in the way that we play a game, and creativity makes a game fun.

Voluntary participation. It’s no fun if

you’re made to do something. That’s work. Games are fun because we choose to play together, we choose to agree to the goals and rules and because we enjoy the feedback from our choices.

69

Rohan Vyas | Graduation Project 2019

Four types of Fun need to keep in mind that gamification must be fun. If the output of our designs isn’t fun, then we will have failed in our objectives. Games are fun.

Game-like elements must be fun in order to be “game like”.

“Never, ever underestimate the importance of having fun.”

—Randy Pausch, Professor of Computer Science and Human-Computer Interaction

70

Type 1 : Hard fun This type of fun requires some work. The feeling of accomplishment marathon runners experience when they finally run their first marathon is going to be hard to beat.

Mobile application for sign language

Type 2 – Easy Fun

Type 3 – Serious Fun

Type 4 – People Fun

it’s the kind of fun that each of us values in dayto-day life. could be more or less passive activities we can look forward to on a small scale such as catching your favourite TV show at a certain time.

This is the kind of fun that pushes us to create something substantial for ourselves and others. It inspires us to think, behave or feel differently and try to make a meaningful difference in the world.

People fun involves the joy of interacting with others. It’s what drives us to hang out with friends, family, coworkers, etc. People fun can be lasting and enduring, or momentary and fleeting.

It is some really good times to memory

71

Rohan Vyas | Graduation Project 2019

Game mechanics Gamification offers you as the designer a huge array of game mechanics that one can employ in order to make your gamified features fun and exciting for your players. However, it’s important to choose a mix of features so as to support the mission of the business, and in a careful way— paying attention the exact needs and nature of what is involved—whilst ensuring that players aren’t overwhelmed because of too many features.

72

• • • • • • • • • • • •

Leaderboards Journey Relationship Quests Loss Aversion Progression Badges Rewards Narrative Levels Urgent Optimism Challenge

• • • • • • • • • • • •

Epic Meaning Blissful Productivity Reward Schedules Countdowns Discovery Virality Game Mechanics Free Lunch Community Collaboration Points Achievements Emotions

Mobile application for sign language

Real time Gamification solution Speeding cars present a great risk to pedestrians in built-up areas. Modern cars are well designed to withstand impacts, but people are not. Here’s what Volkswagen found when they looked at the problem: The Current Scenario: Drivers often drive above the posted speed limits.

The Objective: To get drivers to adhere to the posted speed limits.

Mission: To get as many drivers to drive at or below the speed limit as possible and to make it fun and rewarding to do so.

The Solution: Set up a speed camera with a display that tells drivers their speeds and gives them positive reinforcement for obeying the limit.

We suspect that this works particularly well for drivers with young children‌ Image source : https://www.interaction-design.org/courses/

73

Rohan Vyas | Graduation Project 2019

Semiotics

Based on “semiosis,” the relationship between a sign, an object, and a meaning. The sign represents the object, or referent, in the mind of an interpreter.

“Interpretant” refers to a sign that serves as the representation of an object.

Signs can be verbal (words) or nonverbal. (from C.S. Pierce, Selected Writings, 1958).

Image source : https://www.wikipedia.com

74

Mobile application for sign language

Semiotics - Signs and Meanings Human action involves signs and meanings in three ways: • The perception stage - the person becomes aware of a sign.

• The manipulation stage - the person interprets the sign and decides how to respond to it.

• The consummation stage - the person responds.

Signs have three factors that guide interpretation: The DESIGNATIVE aspect directs to interpreter to a particular object. The APPRAISIVE aspect highlights object qualities, enabling evaluation. The PRESCRIPTIVE aspect directs one to respond in specific ways.

75

Rohan Vyas | Graduation Project 2019

Problem Synthesis

Ideas for solution AIM: To design a game that enables people to learn sign language and make players familiar with the deaf culture

76

Mobile application for sign language

Stakeholders Mapping

77

Rohan Vyas | Graduation Project 2019

Existing mobile learning games Image 1 : This game wants players to make the correct sentence from words Image 2 : A language learning app that is a form of game and has levels to complete Image 3 : Its a story based game in which player has to break from the jail and for that he has to complete sentences Image 4 : Its a simple game where player has to identify the words in letters Image 5 : An app that uses gamification for langugae teaching

78

Mobile application for sign language

79

Rohan Vyas | Graduation Project 2019

Apps using Gamification Habitica This app uses pixel graphics and reward point system and its purpose ti to make habits Headspace This app is used for medetation and used graphics and validation to make better user experience Luminosity It is an awarawd winning app on playstore. It uses puzzles and diiferent mind games to engage players and make them think Cake Its an english language learning app. It uses puzzles and pop culture resources to teach Fabulous This app hels in making better lifestyle by using point based system

80

Mobile application for sign language

81

Rohan Vyas | Graduation Project 2019

Game concepts Concept 1: Dots “ A line is a dot out for a walk” ~ Paul Klee Inspired from the above quote, the concept ‘dots’ is made. In this world we all humans are like dots wanting to connect to each other so we made languages, media and art in order to do that. Sign language is also one such innovation by mankind to achieve connection.

Design idea is a mobile application/game in which the main characteris a dot and it goes on a journey to make a line.

• Target audience: students, office going people • Expected usage: people in metro or while waiting in lines

82

Mobile application for sign language

START

Structure LOGIN

MAP

POINTS

SETTINGS STANDINGS

PROFILE PLAY

83

Rohan Vyas | Graduation Project 2019

In all the application will have 3 parts 1. onboarding, signin, signup 2. Map 3. Challenge - Map will provide overall journey and goals for the players -Players have to clear the chelanges in order to unlock th map and discover more from the game

different themes for every level. and for every theme the UI will have sign languge terms for every elements

-Challenge is a simple line game where players have to connect different color dots to make lines Intention: in the map the player sees

rough map structure

84

Mobile application for sign language

User Flows

85

Rohan Vyas | Graduation Project 2019

Sign Language Research According to game concept, every level of the game have a different theme and there are SIGN LANGUAGE clues in every level according to the theme.

So, for the 1st theme; ‘school’, the following keywords are generated for SIGN LANGUAGE clue.

For the above keywords their following Signs are collected

Game Character Since the concept for the game is based on dots, the characters are also inspired from dot or circle

86

Mobile application for sign language

Why this concept does not work 1. The concept became too informative for the players, and not much of player centric design.

2. The game is not fun to play 3. More like a less learning and it feels sign language is imposed on it

87

Rohan Vyas | Graduation Project 2019

Concept 2: Monsters A mobile game. Concept is developed to make the gaming experience fun for the players. And on the same time players learn few important signs from the Sign Language • Target audience: students, office going people • Expected usage: people in metro or while waiting in lines

Narrative: Monsters have taken over everthing and the main character has to kill monsters in order to go to next level.

In order to kill monsters player has to collect elements. which can be done via two things, 1 quest, 2 deal.

88

Mobile application for sign language

Problems with concept 1. Quest: player has to connect sign of same words in given time. to collect elements 2. deal exchange elements to collect other elements

1. Idea is becoming too complex.

2. players will immediately leave it if they were not able to understand it 3. Application of Sign Language feels imposed on the experience

89

Rohan Vyas | Graduation Project 2019

Concept 3 :Learning app A mobile application that gives people all the necessary required resources for learning and information and links to organisations associated.

Enculcating the gamification in the experience via different mediums • Target audience: people who are interested in learning the Sign Language • Expected usage: quite places, where people can learn

90

Functionalities to include: 1. translation of words and senteces 2. sign language quiz to practice 3. daily quotes and text in sign language 4. dictionary, resources, important links

Mobile application for sign language

91

Rohan Vyas | Graduation Project 2019

“A problem well stated is a problem half solved.� ~Charles Kettering

92

Mobile application for sign language

04

REDEFINED BRIEF Defining the user UX design Visual design

94 113 126

93

Rohan Vyas | Graduation Project 2019

Defining the user The application maily focuses on providing service to the people who are interested and are willing to learn about Sign Language.

Functionalities

The targeted users are maily three types of people:

2. Links and information about different organisations

1. Differentlly abled people, wanting to learn the language.

2. People related to people with different abilities.

Like the parents of a deaf person who wants to learn the language to ommunicate with their child 3. Sign language teachers, who want resources to teach their students about the deaf culture.

4. Regular people who are interested to know about the deaf culture.

94

1. Sign language teaching

3. Translation

Mobile application for sign language

User Personas

95

Rohan Vyas | Graduation Project 2019

1. Neelam Sharma Motivation Age 22

Incentive

Occupation IT Engineer

Growth

Location Pune Impatient

Power

Focussed

Extrovert

Sensing

Intutive

Thinking

Feeling

Judging

Social

Goals She wants to be a successful person A community that support everyone To see herself financially stable

Frustrations Negligence amongst people Competative culture

96

Introvert

Achievement

Status Single

Ambitious

Fear

Personality

Technology IT and internet Software Mobile Apps Social Networks

Perciving

Mobile application for sign language

Empathy map

Neelam Sharma

Helping other people

Software developer

Age 22

Want to able to commnicate with the deaf people

Wants to be successful

Career related problems

Learning new skills

Think and feel Its difficult to communicate with differently abled people

A social gap between people with different abilities

Hear

See

Learning a language is difficlut

Sign language is mostly intutive and easy to learn

Deaf people are unapprochable

Say and do Says she wants to learn sign language

Deaf people are very nice and helpful

Says that she wants to do social work

Mostly stays busy with the office work and dindnt get time to learn sign language

97

Rohan Vyas | Graduation Project 2019

User journey map

Aware

Research

1st communication

User Goals

To be able to commnunicate with everyone

To learn Sign language

To learn Sign language

Needs

Social connectivity

A medium that can teach sign language

Organised and engaging resources

Shes realises that there are differently abled people and wants to support them

She looks on the internet to find the solution

She couldnt find resources where she can learn quickly.

Content is confusing and unorganised

Opportunity

Networks can be developed

Networks can be developed

To provide people with useful resources

Pain point

Inabilty to connect

Inabilty to connect

Bad user experience

Images

Process

Experience

98

Mobile application for sign language

Use

Feedback

Closure

User Goals

To learn sign language

To learn Sign language

To feel good

Needs

Trustable resource

Good user experience

Any medium to teach betterv

She installs few apps and signs up for onlline courses

She is not able to learn anything as there are too many options but not organised.

After failing to learn she gives up. She blames herself and believes its her inability to learn

Opportunity

Interactive interface can be developed

To develop a user friendly intutive platform

Make user feel good

Pain point

Confusing user interface

Inabilty to learn

Bad user experience

Images

Process

Experience

99

Rohan Vyas | Graduation Project 2019

2. Arpan Walia Age 18 Occupation Student Status Single Location Baroda

Motivation Incentive Fear

Introvert

Growth

Sensing

Intutive

Thinking

Feeling

Judging

Social

Goals Wants to fill his family’s needs To be healthy

Technology IT and internet Software Mobile Apps

Frustrations Unhelpful people

100

Extrovert

Achievement

Power

Deaf-Dumb

Personality

Social Networks

Perciving

Mobile application for sign language

Empathy map

Arpan Walia

Wants to learn how society works

Student/ Deaf and dumb Age 18

Often feels a need for companionship

Wants to be useful

Thinks his family gets trouble brcause of him

Thankful for his teachers

Think and feel His parents and teachers often tells him that he can do anything and his different ability can be used differently

He sees people talking and playing

Hear

See Peopple making frinds and celebrating

Say and do Works hard and never complains

Other people wants to talk to him but not able to

Always ready to help anyone

obeys his parents and techers

101

Rohan Vyas | Graduation Project 2019

User journey map

Aware

Research

1st communication

User Goals

To complete his education

To complete his education

To omplete his education

Needs

Learning resources

Friends

Doubt clearence

Arpan uses hearing machine and reads lip to understand. He goes to school and wants to be a photographer

He has friends who understands him and support him

He sometimes gets confused while learning and needs help regarding studies

Images

Process

Experience

Opportunity Pain point

102

To provide people with useful resources

Mobile application for sign language

Use

Feedback

Closure

User Goals

To learn

To understand

To ommunicate

Needs

Doubt clearence

A common medium of communication

A common languge which everyone understands

His friends and family tries to explain him and clear his doubts

But due to his inabily to hear they are unable to communicate to him and dont know sign language

Friends use google to find hand signs to explain him but couldnt find them quickly

Interactive medium

An interactive medium where people can learn basic sign language quickly

A medium that quickly provides user with hand signs for communication

Un awareness about sign language

Bad user experience of other mediums

Images

Process

Experience

Opportunity Pain point

103

Rohan Vyas | Graduation Project 2019

Devendra Gupta Motivation

Age 62

Incentive

Occupation Farmer

Fear

Status Married

Introvert

Growth Power

Loving

Sensing

Intutive

Thinking

Feeling

Judging

Social

Goals Wants to fill his family’s needs To be healthy

Technology IT and internet Software Mobile Apps

Frustrations Unhelpful people

104

Extrovert

Achievement

Location Jaipur Father of a deaf girl

Personality

Social Networks

Perciving

Mobile application for sign language

Empathy map

Devendra Gupta

Saving money for the daughter’s future

Father of deaf girl Age 62

Daughter’s marrige

Daughter’s education

Doens’t want her daughter to feel weak

Feels scared

What other people think about his daughter

Village’s openion about his daughter

Think and feel He hears from people that deaf kids dont have future and no body marries a deaf girl

He sees people judging his daughter

Hear

See Some people are willing to help him educate his daughter

He hears that govenrmnent is providing good education for deaf kids and can be self stable

Say and do He always motivates his daughter to work hard

Organisations are there to support and teach his daughter

He sends her to an institute to learn sign language

He listens to his daughter’s teachers about how to talk to her

105

Rohan Vyas | Graduation Project 2019

User journey map

Aware

Research

1st communication

User Goals

Daughter to be happy and educated

Daughter to be happy and educated

To learn sign language

Needs

To be able to communicate with his daughter

To be able to communicate with his daughter

Resources for better understanding

He learns sign language on his on on his free time

He takes help from local people who hels him

He often gets confused while learning sign language by himself

Images

Process

Experience

Opportunity Pain point

106

To provide people with useful resources

Mobile application for sign language

Use

Feedback

Closure

User Goals

To learn sign language

To earn sign language

To help her daughter

Needs

Better resources

Ability to understand mobile apps

To learn basic sign language and about deaf culture

Other people tells him he can find resources on internet to learn basics

But he does not know how to use internet or smartphone

He is not able to learn well and feels sad for not being able to help her daughter

An easy to user intutive UI that anyone can undestand

An interactive medium where people can learn basic sign language quickly

A medium that quickly provides user with hand signs for communication

Complicated user interface of different apps

Bad user experience of other mediums

Images

Process

Experience

Opportunity Pain point

107

Rohan Vyas | Graduation Project 2019

Existing apps Android and IOS playstore is filled with plenty of applications which can help anyone to learn the Indian Sign Languages.

American Sign Language, British Sign Language apps are there mostly. Some Indian Sign Language learning apps are also there

108

Mobile application for sign language

DEF-ISL Deaf enabled foundation has released its mobile application for Indian sign language. The application provides a dictionary and serch option so anyone can find any sign easily.

The sign is shown in form of a small video where the users can see and learn the sign language

109

Rohan Vyas | Graduation Project 2019

Spread the sign Its an application that provides translation Sign language from any word. It includes not only ISL but also all other existing sign language in translation

110

Mobile application for sign language

Indian signs It is an application that provides the ISL dictionary and contains all important signs along with conversation and basic communication.

111

Rohan Vyas | Graduation Project 2019

Problems with the existing apps

Solutions

1. Apps provide the sign language translation but not a systematic learning

. Application that has systematic and organised course for learning sign language

2. The videos translate the word in signs but not teach how language is constructed

2. Application also have other content regarding deaf culture

3. Its difficualt to learn from videos

3. Learning process can be gamified.

4. UI does not encourage people to learn more

4. simple to understand UI and user flows

112

Mobile application for sign language

UX design of the app UX inspiration: Let me hear again Let me hear agian is an award winning application that uses voice recognition to enable deaf people to do basic daily tasks The app was awarded ‘App of the Month’ from MIT-App Inventor, USA and Dr Sharon Baisil is the second Indian to receive this award!

Dr Sharon Baisil has developed the app solely on Google App Inventor, maintained by Massachusetts Institute of Technology. The app was a result of Dr Baisil’s passion for technology and his empathy towards the hearing impaired who cannot afford costly mediums as a remedy for their disabilities.

The app enables the impaired to Hear 71 Languages by live voice recognition and translation. Dr Baisil says that most people with hearing disabilities are well versed in sign language and have issues communicating only with people who can hear normally. The common usage of Whatsapp among such people is what sparked the idea for a mobile app for them.

The prototype had only one feature of face to face chat for the hearing impaired to communicate with normal people. Later on more features such as Virtual Notes, which is a Virtual Interpreter & Note Taker; Call Companion, which converts phone calls to text in real time; Quake Awake Alarm for Deaf; and Guardian Angel, which alerts the user during emergencies were added to the application and the environment.

113

Rohan Vyas | Graduation Project 2019

Information architecture Card sorting: Card sorting is a method of developing the information architecture of a system.

It is simply based on arranging all the functionalities and content depending on how the user expects to see it

Functionalities and content: 1.Login/signup 2.User personal details 3.User learning details 4.Details about organisations 5.Details about deaf culture 6.Language learning details 7.Language course structure 8.Categories of sign language 9. Sign language lesson

114

10. Test 11. Points 12. Reward 13. Sign language chat 14. Sign search 15. Sign translate 16. Conversation course 17. Saving signs for use 18. grouping saved signs 19. daily practice signs 20. news update regarding deaf 21. important articles 22. deaf movies 23. recommended videos 24. notification for new resource 25. Profile changes 25. settings 26. personal information

27. voice search 28. dictionary 29. word of the day 30. motivation quote 31. review the course

Mobile application for sign language

App architecture development

115

Rohan Vyas | Graduation Project 2019

Architecture

116

Mobile application for sign language

117

Rohan Vyas | Graduation Project 2019

Wireframing

118

Mobile application for sign language

119

Rohan Vyas | Graduation Project 2019

Low fidelity wireframes

120

Mobile application for sign language

Wireframing

1. Home page 2. Category page

121

Rohan Vyas | Graduation Project 2019

1. Categories page 2. Sign page

122

Mobile application for sign language

Navigation menu iterations

123

Rohan Vyas | Graduation Project 2019

High fidelity wireframes

1. Home page 2. Categories page 3. Sub categories page 4. Sign page 5. Library page

124

Mobile application for sign language

125

Rohan Vyas | Graduation Project 2019

Visual design of the app Visual inspirations 1. Duolingo.

Duolingo is a good implementation of language learning gamification. Rewards, leaderboards and colorful UI are the elements which makes it a successful learning application.

2. Cake Cake is an english learning app. The home page design for cake is a good inspiration of all round language learning

126

Mobile application for sign language

4. Bolo from Google This app is a perfect example of a learning app. Provides just the required fuctionalities and makes learning fun by use of sound and animation. It makes the whole process fun.

3. Two dots Two dots is a mobile game where player has to connect similar color dots. The map in the game is desgined to attract visual attention

127

Rohan Vyas | Graduation Project 2019

UI layout 250 px A grid is like invisible glue that holds a design together. Even when elements are physically separated from each other, something invisible connects them together.

16 px

8 px

48 px

128

Mobile application for sign language

Layout 360 px (iPhone 6/7/8) 4 column grid 1 Gutter width 10pt

1 2

3

2 Column width 68 pt 3. Left/Right margin 36pt

129

Rohan Vyas | Graduation Project 2019

UI iterations for the design language 1. Images

UI created using stock images as references for the user guiding Problems: This UI design language does not work as too many colors are seen and it creates a cognitive overload for the users

1. Image as background

UI created using stock images as background

Problems: This too does not work as the image distracts the users from their task

130

Mobile application for sign language

1. Abstract shapes

Abstract shapes used to create interest and to navigate the users Problems: Does not work as the possible users are also the rural people who do not understand the abstract concepts and can frustrate them

1. Using gradient

Light gradient is used to make the apllication trendy and visually appealing. Roundness in shape is used to make it feel less visually loading

131

Rohan Vyas | Graduation Project 2019

Home page design using blue gradient

132

Mobile application for sign language

Problems: Blue color gives a professional feeling to the process. Also too much gradient makes it look like a commercial app rather than a learning app.

133

Rohan Vyas | Graduation Project 2019

Visual design final Color selection Color accessibility The most common types of color blindness are due to the loss or limited function of red or green cone photopigments. This type of color blindness is commonly referred to as red-green color blindness

Measures taken to make it accessible by color blind people: 1.Color is not used to convey a message 2. Color palette is limited to 2 colors.

3. Texture and patterns are used to show contrast.

4. Contrasting colors and shades

134

Mobile application for sign language

Selected colors: 1. Orange Orange combines the energy of red and the happiness of yellow. It is associated with joy, sunshine, and the tropics. Orange represents enthusiasm, fascination, happiness, creativity, determination, attraction, success, encouragement, and stimulation.

F5AB35 R:245 G:171 B:53 C:2 M:36 Y:91 K:0 FFFFFF R:255 G:255 B:255 C:0 M:0 Y:0 K:0 6D6D6D R:109 G:109 B:109 C:58 M:49 Y:49 K:16

135

Rohan Vyas | Graduation Project 2019

Iconograpgy

iconography is a visual language used to represent features, functionality, or content. icons are meant to be simple, visual elements that are recognized and understood immediately.

Inage source: TheNounProject

136

Mobile application for sign language

Typography

Lato 14 Bold Lato 14 Medium

Lato 18 Bold Calibri 12 Light

Calibri 16 Regular Open Sans 9 Light

Open Sans 16 Light

137

Rohan Vyas | Graduation Project 2019

UI elements

138

Mobile application for sign language

139

Rohan Vyas | Graduation Project 2019

User interface design 1. Home page UI design 2. Learn page UI design

140

Mobile application for sign language

Navigation with five pages is creating the fat finger problem. Icons looks small and text is not redable and it creates frustration.

So the navigation is changes to three pages and the other pages are merged with the home page

141

Rohan Vyas | Graduation Project 2019

Daily learning page (Home page) UI Home page contains reosurces to under stand deaf culture, resources like deaf movies, videos and articles. It also contains sign lanaguage elements to create interest.

142

Mobile application for sign language

143

Rohan Vyas | Graduation Project 2019

Tools page (Home page) UI This page contains the saved signs from the dictionary. User can group signs and make a folder. Further addtion to tools are planned in the next phases of the app design.

144

Mobile application for sign language

Resource page (Home page) UI Resources page is made to provide users with credible and helpful content on or related to deaf issues. This is for the people who want to learn about the culture. It gets regularly updated so the users gets new content on a regular basis.

145

Rohan Vyas | Graduation Project 2019

Learn page

Learn page is designed for people who wants to systematically learn the sign language. It provides a colorful and animated UI to make the experince playful. The learning process is gamified so the user gets points for right answers and loses heard for wrong. And with points users can buy sign lagauge merchendise.

146

Mobile application for sign language

Dictionary UI

Dictionary provides access to all the existing signs and it is organised in categories so that users can find them easily. The sign page can be saved for further references. And is found in the ‘tools’ page.

147

Rohan Vyas | Graduation Project 2019

148

Mobile application for sign language

149

Rohan Vyas | Graduation Project 2019

“Accessible design is good design.” ~ Steve Ballmer

150

Mobile application for sign language

05

FINAL DESIGN User flows Mockups Epilogue

152 158 168

151

Rohan Vyas | Graduation Project 2019

User flow

152

Mobile application for sign language

Searching a sign

153

Rohan Vyas | Graduation Project 2019

Learn

154

Mobile application for sign language

Others

Home page contains: daily learning tools games resources notification Profile Hamburger menu

155

Rohan Vyas | Graduation Project 2019

User testing

156

Mobile application for sign language

Techniques for user testing

Testing process and outcomes

Observable data

1. Thinking aloud.

• Testing the interface not the user • Asking user to say their thoughts and feelings • Verifying research mental model • Taking notes • Capturing videos

User testing will be done in a natural user setting. and different user types will be 1. Student 2. Village person 3. Teacher

1. Quantitative data.

• time on task • success/ failure rates • efforts

Techniques and inadequecies • • • •

Focus groups: What they say Phone survey: What they want to hear Web surveys: Closed ended questions Self reporting: Users don’t know if its “broken”

Testing will be low fidelity and users will be encouraged to speak out loud what they are feeling.

1. Qualitative data.

• stress responses • subjective satisfaction • percieved efforts or difficulty

The user test cases are following: 1. user wants to change settings 2. user wants to complete a course 3. user wants to search a word

157

Rohan Vyas | Graduation Project 2019

1st user test (Satyam kumar) student

2nd user test (Hetal ben) villager

3rd user test (Jagdeesh Dixit) professional

Outcomes Pros • attractive design • fun to see the sign language Cons • difficulty in understanding the flow Suggestion • less user of words and more use of colors and signs for direction. or maybe regional language Outcomes Pros • intutive interface • simple to understand Cons • difficulty in learning Suggestion • some feature can be added just for deaf people

158

Outcomes Pros • intutive and simple UI Cons • need more learning content Suggestion • more focussed learning and all flows should direct towards learning sign language

Mobile application for sign language

A final look

159

Rohan Vyas | Graduation Project 2019

160

Mobile application for sign language

161

Rohan Vyas | Graduation Project 2019

162

Mobile application for sign language

163

Rohan Vyas | Graduation Project 2019

164

Mobile application for sign language

165

Rohan Vyas | Graduation Project 2019

166

Mobile application for sign language

Future developments The further plan for the application is to add functionalities that helps deaf users to communicate. Such functionalities will go under the ‘tools’ tabs and the functionalities will be as follows: 1. Hear 2. Notes 3. Video call

1. Make notes

1. Hear

1. Video call

This feature enables people to record sounds and the google’s voice recognition AI will translate sounds in to texts which the deaf user can read easily or copy paste them somewhere else.

This feature translates the voice in the video call and provides them as the subtitles for the call.

This feature enables people to translate the pre recorded voices. This feature can be used in class rooms to record long speeches and translates them all in a paragraph. Google AI can tanslate Indian regional languages as well.

167

Rohan Vyas | Graduation Project 2019

Epilogue Closure

Reflection

The project was an introspection followed by efforts in creatively visualising an idea that would throw light on all intended aspects of the project.

The project brings up intresting provocations and starting points for conversation in and around society.

The technology advancements provides a massive ability to develop and that the shared fututre will beb more impartial for people in the society.

The internet and subcultures have massively evolved shaping how we humans have been communicating. So as social media helping people connect on shared interest.

I belong to a middle class family living in the city Jaipur. I was a science student in school and later became an IT engineer. Design thinking didn’t come naturally to me. However, it reflected in whatever I learned. Problems comes with solutions, was the gist of my engineering teaching and later when I decided to become a designer this approch helped me understand problem solving. As I developed design sensitivity I started seeing problems which we choose to ignore on daily basis and that lead to the birth of this project. It was an approch to solve problems of hearing impaired people and people who are associated to them.

Altough this project ends in speculation it could be implemented, if not in entirety but surely in its essence.

My project was in a way, my means of emulating a certain design process, yet it was personalised and exciting.

168

Mobile application for sign language

Citation

Colophone

All content in the publication belongs to the author. Images depicted are either clicked or sources via the internet. The respective authors have been credited in the refrences.

The document has been designed and written by Rohan Vyas. It has been printed at XYZ. The document has been set in Lato is a humanist sans-serif typeface designed by Ĺ ukasz Dziedzic. It was released in 2015 Palatino is the name of an old-style serif typeface designed by Hermann Zapf, initially released in 1949 Open Sans, Open Sans is a humanist sansserif typeface designed by Steve Matteson and commissioned by Google

169

Rohan Vyas | Graduation Project 2019

Refrences

Interactiondesign.org https://www.interaction-design.org/courses/ gamification-creating-addictive-userexperience?r=rohan-vyas Interactiondesign.org https://www.interaction-design.org/courses/ conducting-usability-testing/lessons/2.1 Yourstory.com https://yourstory.com/tag/deaf-culture Yourstory.com https://yourstory.com/2014/11/app-fridays-madeindia-app-recognised-mit-helps-deaf-hear-speak

170

Youtube.com https://www.youtube.com/ watch?v=OFlZdH2xEe8&t=97s

ISLRTC syllabus http://www.rehabcouncil.nic.in/writereaddata/ DISLI-SyllabusJ18.pdf

Deaf Mute School http://www.deafmuteschool.com/history

Usabilla: How to Design for Color Blindness https://usabilla.com/blog/how-to-design-for-colorblindness/

Indian Sign Language Research and Training Centre http://www.islrtc.nic.in/ National Association of Deaf http://nadindia.org/ BBC:Google sign language AI turns hand gestures into speech https://www.bbc.com/news/technology49410945technology-49410945

Hearing loss causes and prevention https://verywellhealth.com/deaf-causes Apps to decode sign language https://ahmedabadmirror.indiatimes.com/ ahmedabad/cover-story Sense India https://senseiniindia.org

Mobile application for sign language

Deaf culture http://en.wikipedia.org/wiki/Deaf_culture

Bal bandhit vikas kendra http://www.bbvk.org

Sign language basics http://www.enabledacademy.org.

Sign language colleges information https://indiatoday.in/education-today

Rehabilitation council of India https://rehabcouncil.nic.in

Information reagarding deaf employment https://def.org.in

SEDBVZM https://sedbvzm.org

Deaf film festival https://iidff.org

CSED Mumbai https://csedmumbai.org

International deaf summit https://enabled.in/wp

Education audiology https://leodesigns.com/ear

Sign language alphabets https://thepontychaddhafoundation.org

Haryana welfare society https://hwspshi.org

Sign language usage https://sesignlanguage.com

171

Rohan Vyas | Graduation Project 2019

Contact info

Rohan Vyas B-62, Yash path, Tilak nagar, Jaipur. 302004 vyasrohan1993@gmail.com

172

Mobile application for sign language

Mobile application design for learning

Sign Language

173