Page 1

1007266 Matthew Finnie

EGNM6002 Final Major Project


an augmented reality memory database

I REMEMB

AR

creating new memories through overlay


EGNM6002 Final Major Project

1007266 Matthew Finnie

Image run through processing to read ar tag and play memory. More

I remembAR is an interactive installation that uses overlays to combine and confuse memories, creating new ones in the process. A play on words it is a combination of AR and “I remember...” I remembAR consists of a processing sketch which scans the space, via a webcam, for any sign of an AR (Augmented Reality) tag. The AR tags can be worn to become a physical representation of a memory, a trigger for the sketch which

people wished to share. It’s interesting how varied the types of memories were that people wished to share. Some decided to share recent memories of loves ones visiting, others of childhood memories that

Where I remembARs true potential lies, is by the sketch. This causes overlay between the memories, with multiple voices speaking over each other it become increasingly harder to determine whose memory is whose. You only hear certain fragments of memories or combine separate memories to create completely

time they got drunk. which pin points the locations of each corner of the tag and uses this data to read the pattern, like in the image above. The tags which have been laser cut and spray painted are 9x9cm so that they are big enough to be read by the processing sketch while also small enough to be worn without becoming too much of an annoyance.

Download the processing sketch, with libraries at: https://www. dropbox.com/s/unrsyhteri4yo8m/I_remembAR_Processing. zip?v=1mcis


EGNM6002 Final Major Project

Agrippa (a book of the dead)

1007266 Matthew Finnie

Valentina Vuksic’s Harddisko

Troika’s Hardcoded Memory

More initial research and development at: http://

Initial research was focused on the relationship between human and computer memory. into the relationship between human and computer memory and tangible examples of this relationship. What stood out to me was the idea of computer and human memory both being corruptible. Both

human and computer memory can be to be lost, fragmented or unreadable. Agrippa is a tangible example of this corruption in process. Consisting of a

interesting subject matter about memory and therefore decided to follow down this route, into experimentation and further research.

it starts to encode itself, making the contents unreadable and thus changing the meaning of the poem. It was this idea of corruption that I found to be the most

Experimentation with memory corruption led to new research material and likewise new experimentation, so on and so forth. Looking into corrupting memory led me to experiment with ways in which I could corrupt data that had a memorial value. Data such as photographs and home video hold a tremendous amount of emotional value and also have triggers for memory. So if this event?

Although interesting this form of memory corruption wasn’t quite what I was looking for as I wanted some form of interaction to take place. Moving from stills to moving image led me to create a processing seconds. Although there was no memory corruption here, this was more interesting than former and created a form of interaction. In the sketch you are chasing after your own after image, in essence interacting with your past self. It was interesting to see the way in which people interacted with this sketch. Some would make visual gestures and wait for the after image but the majority of people would create a sound. Sound is a better indication of delay and it was what most people were expecting to be delayed rather than the video feed. Sound allows for a build up of delays as well as overlays and loops, which is what lead me to my next section of research and experiments.


EGNM6002 Final Major Project

Bruce Nauman’s Going Around the Corner Piece

1007266 Matthew Finnie

Steve Reich’s Music for 18 Musicians

Lucky Dragons’ A Wave that Interferes

After images and looping were the key factors that interested me from the previous experimentation. This led to new research and the start of what would become I remembAR. From the webcam delay experiment I went on to create a similar sketch, this time with delayed and looping sound rather than video and this is where I remembAR began. Although the sound delay/loop sketch wasn’t a total success, after a while the sounds would become unbearably high pitched, the looping factor was interesting. As the sounds overlaid it became increasingly harder and muddled up the pattern of the sounds. It was this confusion and overlay which I found most interesting and wanted the project to be situated in.

Experimenting with physical loops and overlayed proved Sound delay/loop: http://vimeo.com/64491282

Now that I knew I wanted to create sound overlays and loops, I tried experimenting with physical versions of both as to get a better understanding for the mechanics behind them. This in the failure of one test but a small victory in the other. Experimenting with a home made vinyl player I wanted to see if I could get two tracks to overlay and also how it would sound. This actually worked, although not greatly, with the two tracks being simultaneously played at the same time. This combination

More info on circuit loop at: http://

Vinyl overlay: http://vimeo.

experiement which led to I remembAR.

The next stage was having sound overlays which could be controlled. With the success of the vinyl overlay experiment I wanted to recreate that overlay in processing so that there was a form of control over how the sounds would be played. In this experiment This produced a sound similar to chanting which was actually quite soothing and a lot easier on the ear, rather than the initial sound delay/loop experiment. overlays with a control. However controlling this by a key press is neither innovative nor interactive, which is one of the key practices that I wanted to tackle with this project. I therefore went about tackling the issue of making this sketch interactive.

Sound overlay, key press experiment: http://www.youtube.com/


EGNM6002 Final Major Project

1007266 Matthew Finnie

The aim was to track a person and have Finding a way to control the sound overlays led to me motion tracking. I had the idea that I could track a person and have a to track someone based on the colour that they were wearing, using colour tracking. This however proved to be incredibly unreliable as what you are tracking is lighting, colour pigmentation etc. It was then back to the drawing board and that’s when I came across AR tags. AR tags are designed to be tracked and are a lot more reliable than colour tracking as you’re

Color tracking experiment. More info at: http://

paper and require to be straight and facing the camera to be detected. To tackle this problem I decided to have the AR tags laser cut so that they were strong enough to

AR tracking experiment. Complete AR tracking

hold their shape and strong enough to be worn on clothing.

The next stage was creating the processing sketch that would track the AR tags and output sound. Tracking multiple AR tags sleepless nights to get working. I was having trouble tracking discovered that I was overlooking a simple mistake of having a bit of sloppy coding. With the code complete and tracking the next issue to tackle was what should the sounds be? After some brainstorming I decided on using people memories as the sound clips. Memories are something that have an emotional value but like computer memory can be corrupted and changed. That is what I wanted to do with the sketch, overlay the memories so that they were no longer distinguishable and caused the memories to longer be what they were. Instead of one persons memory they become a joint collective memory, a mash up of memories.

Tracking test, using two AR tags: http://www.youtube.com/

Having some fun with the overlay: http://www.youtube.com/

for hand in I wanted to create a video documenting how I remembAR works and also of the sound overlay in practice. I also wanted to generate some posters of people wearing the tags to once again drive home the idea of these tags being a wearable memory.

MbEMM


EGNM6002 Final Major Project

1007266 Matthew Finnie

View the video at: http://www.youtube.com/watch?v=kQaaQuVhoX4

The video documents how the sketch works while also showing it in situ and the reactions that it can cause A series of posters as well as a video documenting the processing sketch display what I remembAR is all about. The posters show the tags being worn, which is how I hope the installation will operate. The video clearly shows the stages that the processing sketch goes through and shows how the overlaying memories take form. interaction as through learning of peoples memories you gain a new understanding of them and make a connection. I have a vision that for the show I remembAR will consist of several things: the processing sketch, the video and the posters. I aim sound overlays. The more people, the more overlay.

an augmented reality memory database

an augmented reality memory database

an augmented reality memory database

I REMEMB

I REMEMB

I REMEMB

creating new memories through overlay

creating new memories through overlay

creating new memories through overlay

AR

AR

AR

MATTHEW FINNIE EGNM6002  

folio sheets for fmp

Read more
Read more
Similar to
Popular now
Just for you