Y1S2 Design Computing - Physical Computing ('That Kitchen Plant' Mindfulness Project)

“That Kitchen Plant” Abstract

“That Kitchen Plant” is an electronic device that aims to encourage users to practise mindfulness while doing the dishes within their own home.

This is particularly significant during this COVID season, as “mindfully washing dishes is positively associated with state mindfulness, prompt[ing] elements of positive effect (e.g. inspiration) and decreas[ing] elements of negative effects (e.g. nervousness). (Hanry et al, 2015)¹”.

Besides initiating the idea of mindfulness, it was noted that Ludic Design2(Gaver, 2004) was also important to push the project even further. As defined by the drift table in Gaver’s paper, technologies for the home could “support ludic activities”, that is, “activities motivated by curiosity, exploration and reflection rather than externally-defined tasks”.

Research Timeline

Ideation

Iteration 1

Iteration 2

Final Production

Study of Existing Physical Computing Designs The idea of “Physical Computing”, along with Tom Igoe, was explained by Panagis Papadimatos3, “A new research field in which our world of everyday objects and places becomes infused and augmented with information processing and exchange. The advocates of this notion demonstrate that physical objects have a sensory richness of meaning that screen-based elements do not. When we see, hear and feel real-world objects we are enabled to train both cognitive and perceptual skills in combination.”

This is in line with Patterson, who explained that physical computing now includes research into “tangible interactions, human-material interactions, shape-changing interfaces, organic user interfaces, interactive materiality and material ecology”10.

The beginning of physical computing started with embedding microcontroller chips into electronic devices (computers), and the development of the graphic user interface (GUI) to promote interaction between the user and the new technological phenomena.

In 1968, Douglas Engelbart invented the mouse and its interaction with the screen. This was pioneering a friendlier mode of using the computer, such that people could see the effects of code4. The purpose of GUI, invented in the 1970s and 1980s, was to make it easy for people - who were not computer experts - to use computers. GUI was popularised by Apple and is now widely copied, becoming the standard interface of almost all personal computers.

Douglas Engelbart’s computer mouse

XEROX PARC: first commercial GUI

Alongside the development of GUI, computers expanded their roles from business automation into personal communication and visual arts. The Internet became pervasive, and the idea of “virtual spaces” were created. This further emphasised the importance of interaction between a user and the computer, because it was changing the “traditional dimension of civic legibility” (Papadimatos, 2005).

First Virtual Reality Head-Mounted Device (HMD) (1968)

In today’s context, there is greater development in physical computing: from virtual reality to mixed reality and finally to physical computing.

Virtual reality often consists of a head-mounted display - like goggles that you wear over your eyes. It is immersive and interactive because it brings the user into a digital space.

It later advanced into mixed reality, because it combined real with virtual environments, creating “spatial environments where the participant can interact with physical and digital information in an integrated way” (Papadimatos, 2005).

Latest HMD - Oculus Quest 2 (2020)

Physical computing, thereafter, is about “the distribution of computation across tangible physical artefacts that are spread throughout the physical environment. For one to experience a physical computing application, there is only a need for his/ her senses.” (Papadimatos, 2005). This is further explained by citing the example of “Furby”6, a child’s toy that has sensors built into it. Simple Artificial Intelligence (AI) software enables the furby to learn up to 1000 English words and sentences. It is also capable of mediating a sort of feelings in response to a hug or a tickle.

Another example is “Radical Atoms”7 developed by Hiroshi Ishii [1997] from the Tangible Media Group of the MIT Media Lab. Radical Atoms is a vision for human interactions with dynamic physical materials that are computationally transformable and reconfigurable.

Ishii also headed the invention of “TRANSFORM”8 at MIT, a piece of furniture that - as its name suggests - transforms into various shapes based on a stream of user data and energy.

The work consists of three dynamic shape displays that move more than one thousand pins up and down in realtime to transform the tabletop into a dynamic tangible display.

Furby

TRANSFORM (2014)

Ideation of “That Kitchen Plant” With the knowledge of what defined the “black mirror” (screen and GUI), virtual reality, mixed reality and finally physical computing, the pathway to create “That Kitchen Plant” was clearer.

Description of Concept Design

“There are two ways to wash the dishes. The first is to wash the dishes in order to have clean dishes and the second is to wash the dishes to wash the dishes.

If while washing dishes, we think only of the cup of tea that awaits us, thus hurrying to get the dishes out of the way as if they were a nuisance, then we are not “washing the dishes to wash the dishes.” What’s more, we are not alive during the time we are washing the dishes. In fact we are completely incapable of realizing the miracle of life while standing at the sink. If we can’t wash the dishes, the chances are we won’t be able to drink our tea either. While drinking the cup of tea, we will only be thinking of other things, barely aware of the cup in our hands. Thus we are sucked away into the future - and we are incapable of actually living one minute of life.”

Thich Nhat Hanh, The Miracle of Mindfulness9

Drawing from the theoretical lessons learnt in Papadimatos’ paper and the application of physical computing and interactivity in Ishii’s projects, the idea of an interactive home appliance to make mundane tasks more fun - without focus on “utilitarian” intent (Papadimatos, 2005). and instead on Ludic Design became the primary source of inspiration. Hence, the notion of encouraging washing the dishes as a way to practise mindfulness was the motivation behind this project.

Mechanism of “That Kitchen Plant” Part I (Theory) In summary, it is controlled by an accelerometer and a LED light and/or movement actuator, which corresponds to the sponge the user uses to wash the dishes, and an interactive device in the form of a potted plant.

To better ideate, the inputs and outputs of the entire device can be brainstormed using their form and function.

Actuator (Potted Plant)

Sensor (Accelerometer)

General Mechanism (Storyboard)

When the hand is moving too fast or is stationery, the LED lights will not light up and the flower remains closed.

When the optimal acceleration - which also encourages mindful practice - is reached and measured, the LED lights light up and the flower opens.

It was understood that the “dwelling” action of the hand was most intuitive11. Hence, the gesturing function can be best utilised for this project.

Iteration 1: Mechanism of “That Kitchen Plant” Part II (Practical) Before building the device, it is important that the internal software and system of the device are understood. An interaction model is created.

https://miro.com/app/board/o9J_kiHi3Rk=/

Stage A: Determining the acceleration of slow movement 1. Making use of accelerometer.get_x, accelerometer.get_y and accelerometer.get_z.

2. Setting lower and upper limits 3. Understanding Boolean operation (True or False) File: “Assessment2Experiment.py”

Stage C: Understanding radio library 1. Understanding the code for radio 2. Understanding frame rate 3. Pairing radio library with gesture events (instead of library’s default button events) File: “Assesment2RadioWaves.py”

Stage B: Experimenting with LED strip (neopixels) 1. Understanding neopixels 2. Experimenting with timing of the neopixels lighting up File: “Assessment2LEDstrip.py”

Stage D: Integrating radio, gesture and neopixel codes 1. Using of lower and upper limits of acceleration 2. Using Boolean operation 3. Using radio library between two microbits 4. Using neopixel library for LED strip at pin0 File: “Assessment2Latest.py” (previous editions)

Iteration 2 Part I: Mechanism of “That Kitchen Plant” Part II (Practical) After thorough understanding of the mechanism of the possibilities of the gesture, radio and neopixel libraries, the implementation of muscle wires and how the entire system will be wired had to be planned out.

2. Experimenting with Muscle Wires

Iteration 2 Part II: Mechanism of “That Kitchen Plant” Part II (Practical)

Circuit Connection (Video)

General Steps to Building the Circuit: 1. Soldering the Regulator to Generate Higher Current (amps) 2. Experimenting with Muscle Wires 3. Connecting the Relay 4. Generate Code for Final Circuit 5. Building the House 6. Refining of Other Details

1. Soldering the Regulator

Intermediate Step: Laying Out Elements to Visualise Connections

Exploring Petal Form with Muscle Wires (Video)

3. Connecting the Relay

Learning Points from Muscle Wires 1. The power and current provided by the battery and microbit are NOT enough to power a 15cm muscle wire for prolonged periods of time.

Therefore, if multiple muscle wires are to be used, they ought to be connected in a PARALLEL circuit.

Petals of the flower will have to connected INDEPENDENTLY to SMALL lengths of wire, instead of a continuous long wire.

2. There is short time delay from the time the battery is switched on and off and when the muscle wires start to bend.

Therefore, when coding, take into account the sleep() time to get the desired time that you would want before the wires to bend.

Circuit Connection Showing Wiring and Microbit Shield to Include Relay later

Testing of Relay with red LED bulb and Coding File: “fortherelay.py”

4. Generate Code for Final Circuit Final Circuit (Video): 1. One microbit to Measure Acceleration 2. Other microbit connected to Muscle Wires (with Regulator and Battery), Relay, and LED Strip (with microbit in Shield)

Refinement after Final Experiments 1. There is short time delay from when the hand moves (therefore measuring of acceleration) and when the signal sends and the actuator activates (therefore bending the muscle wires and lights to light up).

Therefore, when coding, take into account sleep() between all inteferring factors.

2. It is noted with the any gesture-based technology, “accuracy varies greatly”11, and it may be difficult to “discern fine motor movement”.

Therefore, sufficient tolerance for x and y acceleration should be set in the lower and upper limits.

Final Code File: “Assessment2Latest.py” (current edition)

3. Because there is a change in how the circuit will be connected (e.g. wires to be in parallel instead of a series circuit), there will be a need for rethinking of the housing of the system.

Therefore, the battery pack, breadboard (with the regulator on top of it), relay, crocodile wires and the starting end of the LED strip will be hidden in a bottom compartment. The top will only show the MULTIPLE SHORT muscle wires as petals and the mid-to-end of the LED strip.

Final Production

Final Product (not activated) (Video)

5. Building the House

1. The best material to house the bottom components will be cardboard. It is easily malleable into a boxform, and parts of it can be cut out for the wires to connect the top muscle wire petals and the LED strip to the circuit below.

2. A good material for the petals will be baking paper.

It can withstand high heat and does not catch fire easily - in case the wires start to heat up too much.

It is also light-weight, which can bend easily with the muscle wires.

3. The colour of the LED strip neopixels can be coded based on the colour of the real flowers that will be displayed alongside them. In this case, purple flowers were used, so green colour was not used in the RBG values of the code.

Final Product (activated) (Video)

Screenshots of Final Product (Video)

Post-Presentation (Feedback and Self-Assessment) 1. The LED strip can be wrapped with tissue for a diffused effect.

2. The technical aspects of the muscle wires can be explained in the video.

3. The housing of the entire system can be better refined - consider 3D printing, and higher quality materials that are also waterproof.

4. User testing can be incorporated in the process to better understand the best acceleration of the hand to practise mindfulness yet encourage playfulness and discovery.

Future Expansion of Project 1. Incorporating meditation sounds (e.g. singing bowls) 2. Incoporating greater variations in the light animations

I would like to extend my gratitude to my tutor Karen Cochrane, unit coordinator Phil Gough, other tutors, my friends, family members, coursemates and other individuals who have guided me on the journey thus far.

References 1. Hanly, A., Warner, A., Dehili, V., Canto, A., Garland, E. (October 2015). Washing Dishes to Wash the Dishes: Brief Instruction in an Informal Mindfulness Practice.

Retrieved from https://www.researchgate.net/publication/281608722_Washing_Dishes_to_Wash_the_Dishes_Brief_Instruction_in_an_Informal_Mindfulness_Practice.

2. (eReserve) Gaver, William, Bowers, John, Boucher, Andy, Gellerson, Hans, Pennington, Sarah, Schmidt, Albrecht, Steed, Anthony, Villar, Nicholas and Walker, Brendan.

(2004). ‘The drift table: designing for ludic engagement’. Retrieved from http://research.gold.ac.uk/id/eprint/4721/.

3. Papadimatos, P. (2005). Physical Computing: Using everyday objects as communication tools. Retrieved from https://discovery.ucl.ac.uk/id/eprint/2036/1/physical_ computing_Thesis_MediumRes1.pdf 4. Netflix (2019). Explained: Coding, Explained.

5. Tietz, T. (2018). Douglas Engelbart and the Computer Mouse. Retrieved from http://scihi.org/douglas-engelbart-computer-mouse/ 6. Heaton, K. (NA). ANATOMY OF THE FURBY(tm). Retrieved from http://alumni.media.mit.edu/~kelly/Furby/anatomy/THE_FURBY_LQ.htm.

7. Ishii, H., Lakatos, D., Bonanni, L., Labrune, J.B. (2012). Radical Atoms: Beyond Tangible Bits, Toward Transformable Materials. Retrieved from http://web.media.mit. edu/~ishii/RadicalAtoms_ACM_Interactios.pdf 8. TRANSFORM - Amazing Technology Invented By MIT (2015). https://www.youtube.com/watch?v=lCARHatJQJA&t=1s 9. Nhất, H., Ho, M., & Vo-Dinh, M. (1987). The miracle of mindfulness: An introduction to the practice of meditation.

10. (eReserve) Patterson, H. (2017). Physical Computing’s Connected and Shape-Changing Future. IEEE Pervasive Computing, 16(4), 7–11. https://doi.org/10.1109/ MPRV.2017.3971132.

11. (eReserve) Hespanhol, Luke., Tomitsch, Martin., Grace, Kazjon., Collin, Anthony., & Kay, J. (2012). Investigating intuitiveness and effectiveness of gestures for free spatial interaction with large displays. Proceedings of the 2012 International Symposium on Pervasive Displays, June 2012, 1–6. https://doi.org/10.1145/2307798.2307804 ISBN: 1450314147

Github Repository https://github.sydney.edu.au/jleo2231/deco1013-microbit

Videos https://drive.google.com/drive/folders/1wZVQPC1KunD3IfMunZmgRj96l8fa7bjS?usp=sharing