Orlagh’s class Notes responsive spaces The School of Machines, Making and Make-believe Berlin July 2014
input Keyboard Mouse
output
Graphics Tablet - Position,pressure Tablet - Multitouch Midi Webcam Microphone Health Sensors (Brain Waves, O2, Heart Rate) Arduino: / Voice / Voltage / Light / Pressure Mats / Tension Serial - Usb Kinect (Depth + Colors) Network (Wifi / Ethernet / Osc) Leap Motion Accelerometer Files (Images, Video, Sound, Binary, Text) Randomness (Noice, Random, Math) Oculus Rift Input (Motion Tracking) 2d Scanners 3d Scanners (Nest Thermostat?)
screen – 2d, 3d VR goggles speaker arduino - lights, motors, sounds, voltage, memory rubber thing? network USB midi files - images, video, sound, binary, text brainwaves electrodes bio processes printing 3D printing (nest thermostat?)
(java) processing.org
funprogramming.org makes interactive / generative visuals and animations mixes visuals / sound and information talks to + connects hardware + programmes
processing on steroids (C++) openframeworks.cc
some ingredients of digital art + installations
interactivity
miidi
hardware
code
gaming
protocols
sound VJ-ing
sensors
ideas
projection mapping
visuals
computer vision online
3D
what do all these languages/applications do?
creative coding galaxy
cindr c++
core
text-based
visual
sound supercollider
processing
computer vision
jitter
kinect
max/msp
java
c++
openframeworks
shaders open GL
3D web cam
Cinema 4d
open CV libary
commercial
maya
kinect
visual programming
max 3d
blendr rhino
free opensource
for building stuff: product + industrial design
protocols sensors / mechanics arduino
kinect
syphon (mac) spout(PC)
vvvv library
osc
supercollider > processing
touch osc
touch designer
phone to computer
lightwriter
installations
software
Raspberry Pi
visual programming
wiiMote
vuo
online
visual programming
leap motion projection mapping
python gaming
blendr
unreal unity 3dc++
game engine
Madmapper (Mac osx) model8 / Resolume touch designer (windows)
keystone library for use with processing
hardware
frame based vpt7 free mac os
lpmt
with openframeworks
javascript
Openshot
after effects pencil
‘protocols’
allow computers and devices to speak to each other
synthesise information between devices, sensors and computers
connect everything up
creatively output the results as installations
projection mapping
Krisjanis Rijnieks and Irina Spicaka
www.codebark.com www.cc4av.info/2014/01/
http://vimeo.com/100820299
Laimonas Zakas Slideshow URL: http://ej.uz/machines
https://medium.com/@irina_spicaka/spatial-projections-8e82ed34278e
computer vision
chris sugrue base 8
web cam
pulling webcam image into processing then defining the range of what is ‘seen’
open CV libary
using a library facial recognition
recognising features (and swopping them around!) kinect seeing depth (and colour)
use code to transform and play with the images
interactivity
sensors flex sensors
ADXL335 accelerometer
proximity sensor Infra red
need to map 35 at start to zero (acceleration) (not position)
not how close, it detects the heat, not on the beam. human presence one hand clapping!
mapping data now isn’t enough
tilt sensor (switch) move?
colour sensors ultrasonic range sensors
rgb / led mimic analogue colour continous also IR input need to be close
temperature + humidity you have to decide on threshold (not just on/off)
sholds we are deciding what the thre are: brings questions with it.... meaningful values: “features� positiv e/neg emotional state
heart beat sensor clip on to ear
bringing information together in a meaningful way...how do you giv e more meaning to what you are doing? creating meaningful bonds - critical eye
3D infra red
visuals wiimote
webcams
sensors
kinect
computer vision projection mapping
arduino
code data protocols audio ?
interactivity
miidi + instruments
sound
conversation at the school of machines – july 2014
ASTRID bin
what i learnt at the school of machines using an inaccurate venn diagram
3D
infra red
image
the digital art landscape
visuals
human inputs
wiimote
ir LED ARDUINO
analogue information
webcam peppers ghost
sensors ./ information
kinect gesture
eye
computer vision hardware
mouse + inputs hand
mic
projection mapping
arduino digital data
code
?
ideas midi
sound
space human body
interface robots
noise
instrument hand
ear
music
randomly generated information
books
Thank You Rachel!
Thank you mama Uwa for everything :) I have learnt the most invaluable lessons of my life from you. (the after class lessons) You have changed me in many ways and I love that. You are an amazing person. Super hard working and always on time. Thanks for all those lovely walks to home and for the space at home :) It was a great place to be at. My experience in Berlin wouldn’t have been this great without you. You are the most invaluable person of my life. I have saved my coins and will use them when I come to Berlin again to meet you :) I still have all the train tickets that you gave me and I ate all the gummy bears.Thanks for all the pictures that you took of me and you know :P You’ve been so sincere in that, more than Milos :D You have been so supportive all this while. Thanks for the girl power! Thanks for everything.
Art isn’t about what you make but what you make happen.--Jeremy Deller
Like I’ve said before: it’s mind-boggling to think that all the activities, speakers, and events we peeps experienced over the past month were arranged by *one* amazing person. You’ve done a great thing, Rachel Uwa. Life-changing, even. A million thanks wouldn’t be enough. But it’s a start. A million thanks, Soma
P.S.: note the Oxford comma.
Rachel Uwa has set new standards for creative code educational experience –– Orlagh O’Brien
Pere & Luca
Thank you so much for this opportunity! Two months ago I would never imagine I would ever meet all the people you brought to the school, even more, actually exchange ideas with them. It’s a dream come true that will always define my new path. I really hope that ours roads cross again, personally and professionally, and whatever you do, you keep doing it with the passion and care. Oh... And by the way... I really don’t think we look like Peeps. : P Kisses, already with saudade*