Robbie Miller is creating Music, Videos, Interactive Art
0

patrons

$0
per Video
Recently finding Touchdesigner I am creating most of my artwork in an interactive manner using my Kinect for Windows and an Emotiv Epoch headset I will be finding ways to augment my reality and utilising spaces to work with these tools. In the greater world this will eventually exist in a format that can be produced for live visual shows in the UK for musicians (bands,dj's and producers alike) and for personal artworks displayed in the UK.

I will be documenting here progress I make, final versions in my living room, full shows in the real world and art events that I will film a record of. I will most likely be doing some sort of tutorials of what I learn or discover covering things from sound synthesis to Touchdesigner and mapping various controllers to various programs etc. 

The Kinect i'm sure you are all familiar with, but to overview it's current functionality: It has depth sensing and video at it's core, branching it to do things like skeletal tracking of 2 individuals and positional tracking of upto 6, it can produce pretty high quality 3D models of anything it's pointed at, it now has a set of interactions extending the skeletal part to hands open and grip, allowing for more complexed interactions, it also has an accelerometer knowing therfore it's real world orientation with reference to the floor and a motor to change it's angle. Not forgetting the microphone array which can be programmed with speach recogintion and has directional and background attenuation to pick up human voice.

The Epoch headset is particularly special and I haven't at this moment got it plugged into Touchdesigner but it's an EEG headset for your computer and it wirelessly can be used in a number of ways: It can read mood and produces a graph of this, it has facial expression recognition so it can reference a blink or a smile or eyebrow movements etc, and best of all it can be recorded with upto 4 commands that are set by you that can be reinterpretted to anything you want inside your computer; it also has a gyroscope in and thus can tell the direction of gaze and movements of the head which has been utilised immediatly for mouse movement. More info here www.emotiv.com.

Combining these 2 tools in various ways along with a good old midi controller in the form of an APC 40 the potential is enormous for both experimenting and full on live shows. I won't go into Touchdesigner here but lets just say if you don't know what it is go check out www.derivative.ca .

I hope to get a tablet of some sort too in order to have more control on a new environment but it is possible to use the kinect and a projector to have this similar effect however that may require a second projector and probably kinect to be a control surface and have a piece of seperate work (obviously there are many exceptions in how this may be utilised with a single projector and kinect).

Your help will definitely go a long way to upgrading my equipment and getting these things out there, along with giving me the space and time to continue exploring the world through a multitude of lenses.

Recently finding Touchdesigner I am creating most of my artwork in an interactive manner using my Kinect for Windows and an Emotiv Epoch headset I will be finding ways to augment my reality and utilising spaces to work with these tools. In the greater world this will eventually exist in a format that can be produced for live visual shows in the UK for musicians (bands,dj's and producers alike) and for personal artworks displayed in the UK.

I will be documenting here progress I make, final versions in my living room, full shows in the real world and art events that I will film a record of. I will most likely be doing some sort of tutorials of what I learn or discover covering things from sound synthesis to Touchdesigner and mapping various controllers to various programs etc. 

The Kinect i'm sure you are all familiar with, but to overview it's current functionality: It has depth sensing and video at it's core, branching it to do things like skeletal tracking of 2 individuals and positional tracking of upto 6, it can produce pretty high quality 3D models of anything it's pointed at, it now has a set of interactions extending the skeletal part to hands open and grip, allowing for more complexed interactions, it also has an accelerometer knowing therfore it's real world orientation with reference to the floor and a motor to change it's angle. Not forgetting the microphone array which can be programmed with speach recogintion and has directional and background attenuation to pick up human voice.

The Epoch headset is particularly special and I haven't at this moment got it plugged into Touchdesigner but it's an EEG headset for your computer and it wirelessly can be used in a number of ways: It can read mood and produces a graph of this, it has facial expression recognition so it can reference a blink or a smile or eyebrow movements etc, and best of all it can be recorded with upto 4 commands that are set by you that can be reinterpretted to anything you want inside your computer; it also has a gyroscope in and thus can tell the direction of gaze and movements of the head which has been utilised immediatly for mouse movement. More info here www.emotiv.com.

Combining these 2 tools in various ways along with a good old midi controller in the form of an APC 40 the potential is enormous for both experimenting and full on live shows. I won't go into Touchdesigner here but lets just say if you don't know what it is go check out www.derivative.ca .

I hope to get a tablet of some sort too in order to have more control on a new environment but it is possible to use the kinect and a projector to have this similar effect however that may require a second projector and probably kinect to be a control surface and have a piece of seperate work (obviously there are many exceptions in how this may be utilised with a single projector and kinect).

Your help will definitely go a long way to upgrading my equipment and getting these things out there, along with giving me the space and time to continue exploring the world through a multitude of lenses.

Recent posts by Robbie Miller