A NEW WAY OF HUMAN CONNECTION

HUMAN CONNECTIONS Communication through Facial Expression

Media Environment Studio, 2020-1, Final Output of yvonne.S Supervised by david.H

INPUT EMOTION

01 Step1 - Facial Expression Input by FaceOSC Step2 - Connect FaceOSC and Processing

Facaial Expression Recognition Facial expressions may have evolved as efficient ways to telegraph feelings and intentions.

And it is possible that forcing your face to express happiness, sadness or anger may help you feel those emotions.

Tools: FaceOSC, Processing 3, Unity

02

Pet Phrase/Voice Recognition Pet phrase is an informal term for an expression frequently used by an individual in speech and/or writing. Pet Phrase can reflect our personality and reveal our mental status.

Tools: LilyEmotion 1.0

03

Digital Animations a. mobius b. X - different shapes & colors equal different emotion Frame Position Controlling Tools: Maya, Processing, FaceOSC

04 Repeated and Rythem

Way of Deployment Mondrian (Primary Colour)

Physical Displays a. petals b. iris c. domino d. stained glass (church window) e. normal coloured glasses - different patterns based on theory - physical experiments For now, they’re still the simulations in Autodesk maya.

OUTCOMES

FaceOSC Emotion Input

FaceOSC will track a face and send its pose and gesture data over OSC, as well as the raw tracked points (when

Processing 3 Data Input

Processing will get the data from FaceOSC, and also can input video to make the face gesture control frames.

Connect with FaceOSC, Get the data of facial expression Input Animation Recognize the width of mouth Create Trigger Event - Reverse the speed of animation

Digital Animation Mobius

Blue & Smooth equals Calm; Red & Sharp equals Angry.

Petals Breathe

Abstract Petal Field - Transformation

I’d like to use facial expression to control the transformation of these ‘petals’.

I was guessing, in this case, the petals and human can infulence each other. Because Repetition helps to create a rhythm and a sense of movement and tension and order. It can also transform simple things into complexity and holistic.

我想使用面部表情来控制这些“花瓣”的变换。 我猜想，在这种情况下，花瓣和人类之间会相互影响。 因为重复有助于创造节奏，运动感，紧张感 和秩序感。 它还可以将简单的事情转变为复杂性和整体性。

Stained Glass Way of Deployment v1

There’s a ring outside the installation with some spot lights. Then your facial expression would be connected to this r glasses would be changed too.

A RING OUTSIDE WHICH CAN ROTATE WITH SPOT LIGH

装置外面有一圈圆环，上面有一些聚光灯。 然后，面部表情将连接到圆环。 当更改面部表情时，它将随聚光

ring. When you change your facial expression, it will rotate with the spot lights, which means the shadow of stained

HTS

光灯一起旋转，这意味着彩色玻璃的阴影也会被更改。

SPOT LIGHT

Stained Glass Way of Deployment v2

In this case, the light will move on the track beside by using a motor.

SPOT LIGHT moving on a track

Stained Glass Way of Deployment v3

Using the projector to mapping the fake shadow on it. So there’s no need to think about where to deploy the light.

How to do it?

In this case, we can use the projector instead of the light equipments.

Hanging the projector from the ceiling, then project the fake glass shadow on the wall.

Why projection mapping?

We can use projection mapping to imbue life into static objects via optical illusions, or by adding supplementary dimensions.

Weakness?

It can be interesting, BUT It’s not real. Thus maybe it cannot present like the real effect of stained glass.

PROJECTOR HANGING FROM THE CEILING

EFFECT SIMULATION Process -Match size in Photoshop -Create 3D Model -Do the Simulation -Rendering shadow-only Animation -Project on the wall/glasses 处理 -在Photoshop中匹配大小 -创建3D模型 -模拟 -渲染仅阴影动画 -在墙上/玻璃上投影

我们可以使用投影仪代替照明设备。 将投影机悬挂在天花板上，然后将数字阴影投射在墙 上。 为什么投影映射 我们可以使用投影映射通过错觉或添加补充尺寸将生 命注入静态对象。 弱点 可能很有趣，但那不是真实的。 因此，它的呈现效果 可能不如彩色玻璃那样出彩。

Stained Glass Mondrian v1

Primary Colours Primary Colours are the first colors we learned about. When we were a baby, we can only see the bright primary colors. Maybe that’s why primary colours are so appealing to us.

Complementary Colours Colors that are opposite each other on the color wheel are considered to be complementary colors Complementary colors are especially pleasing to the eye because different types of photoreceptor cells, which contribute to color vision, perceive different types of light in the color spectrum, Apartment Therapy explains.

Golden Ratio If you take our Golden Ratio diagram above and draw an arch in each square, from one corner to the opposite corner, you will draw the first curve of the Golden Spiral (or Fibonacci Sequence).

You’ll find this beautiful creature throughout nature’s forms—ferns, flowers, seashells, even hurricanes—which perhaps why we find it so visually appealing. Because it is, indeed, nature at its finest.

The Piramids of Giza and DaVinci’s MonaLisa are designed using the golden ratio. It’s a mathematical ratio which is commonly found in nature. When we use it in design, it foster organic and natural looking compositions that are aethetically pleasing to the eye.

Basic Shapes The simple shapes are the square, rectangle, circle, ellipse, and triangle. These are the basic forms that are used as the foundation for all other shapes.

Squares and rectangles are familiar safe and comfortable, Squares are considered to be one of the most honest shapes.

Simple shapes work beautifully, they are memorable, easy on the eye, and instantly recognisable.

Stained Glass Mondrian v2

At present the reaction is ONLY to one expression Thin mouth ( frown ) = light position A Low shadow Wide mouth ( smile ) = light position B Long shadow

Stained Glass Mondrian v3

Stained Glass Mondrian v4

Physical Experiments Shadow of Coloured Acetate Sheets

I use coloured acetate sheets to cast shadows. It is a cheaper way to simulate the coloured shadow without stained glass.

Physical Experiments Shadow of Coloured Acetate Sheets

Stained Glass

Light Streaming through Window We cannot see the light directly. We can only see light with medium, such as in a dusty atmosphere. The natural light streaming through stained glass was compared to divine light. And visual richness of stained glass made a powerful appeal to eyes and emotions. 我们不能直接看到光。 我们只能通过介质看到光线，例如在多尘的气氛中。 彩色玻璃的视觉 丰富性对眼睛和情感具有强大的吸引力。

Stained Glass

Light Streaming through Window