Incorporating physical mediums with interactive digital technologies to create an interactive art installation.
Myself, William Luk, Chris Kovacs
2 Weeks
Lead Creative Technologist, TouchDesigner Developer, Arduino Developer
Arduino Uno, TouchDesigner, Projection Mapping
We collaborated to create an interactive art installation that incorporated physical mediums with interactive digital technologies that primarily focusing on elements of light and motion.
Unlike traditional exhibits which tend to have a ‘hands-off’ policy, we wanted to encourage participants curiosity and interaction
Projection mapping is a technique that uses projectors to display visuals—such as images, animations, or videos—onto physical surfaces, transforming them into dynamic displays. Unlike traditional projection onto flat screens, projection mapping aligns visuals with the contours and features of the surface, whether it’s a building, object, or stage setup. This creates optical illusions and immersive experiences by effectively "replacing" the appearance of the object in real time
Capacitive touch is the technology used in touchscreens and sensors to detect touch inputs by measuring changes in capacitance. These sensors work by measuring changes in capacitance caused by a finger or conductive object coming into proximity with the sensor's surface. In this case Capacitive touch was used to enable the touch-based interactivity.
Arduino is an open-source electronics platform designed for building interactive devices. It consists of hardware (microcontroller boards) and software (Arduino IDE) that simplify programming and prototyping. Arduino boards can read inputs, such as signals from sensors or buttons, and convert them into outputs like turning on LEDs, activating motors, or sending data online
While many institutions such as art galleries, museums, exhibits attempt to foster creativity they often discourage it with arbitrary rules (ie. Just enjoy the art with your eyes, do not touch, do not interact with it.)
While growing up, we’re actively encouraged to explore our surroundings, to be curious about the world around us and have brief spontaneous interactions with other people but as we grow older we have fewer and fewer opportunities to do so.
As we age, unless you pursue an education in a creative art, there are not many opportunities to indulge in that ‘child-like’ way of viewing the world, exploring through curiosity and wonder. While at the same time socializing becomes more difficult.
Inspired by works such as MIDAS Projection, Ishiwaka Senoo Lab, and BOX, Bradley G Munkowitz we started sketching concepts for a projection mapped sculpture.
Concept #1 Interactive Stacking Object - a “stage” for multiple cubes of different sizes. The cubes would be able to move within the “stage” with different configurations for different projections.
Concept #2 Projection Mapping Onto A structure - Arduino controller with multiple sensors. This idea would later become our concept of a interactive sculpture with conductive touch points.
We started by modelling and 3D printing small scale versions of different shapes to get an understanding of which form would be the most interesting to work with, and the limitations of each. We moved onto making a quarter scale model out of cardboard to test projection and interactions.
Capacitive touch is the technology used in touchscreens and sensors to detect when your finger makes contact with the screen. But what if there is no digital screen/interface? What if the surface WAS the screen/interface?
Conductive paint lets you do just that. Anything you paint with it effectively become a touch screen, but unfortunately its also very expensive. Since we were on a budget, we went to the hardware store and bought the largest metal bolts we could find - these would act as our point of interaction.
We used an Arduino Uno to detect when someone makes contact with any of the specific touch points (the bolts) on our sculpture to have the visuals react in real time.
How do you get someone from the real world to interact with your digital content? It's simple. You bring your digital content into the real world.
In a world where everyone has a device in their pocket, touchscreens are so 2007. We don't discourage interaction at this installation, so go ahead and explore.
This project taught me the impact that great leadership and team synergy can have on the success and execution of a project. I found that surrounding myself with others who could match the same passion and energy for the problem you are solving can give you the momentum to continue when problems arise - and they definitely will. A LOT.
It wasn’t until this project that I realized the opportunity for personal growth that is only possible with a mentor, role model, or professor who goes beyond what is provided. Someone who encourages you to develop your own skills, explore what’s possible, and emphasizes the importance of keeping an open mind.
The design world is a social one, nobody gets far in this game alone. Surround yourself with like-minded people that believe knowledge is meant to be shared, not gate kept. I’ve always been willing to dedicate my time to others, the same as my role models have for me.
Well, a magician can’t reveal all his tricks. If you want to know that you’re gonna have to contact me.