Time-Sand is a 'responsive microcosm' with its own space-time dynamics. Visitors are invited to meddle, to manipulate the landscape and alter the flows of water, light, and even time. Interactions perturb the microcosm, sending waves that gush and bleed, revealing the past and slowing time in a manner like kicking up dust on the sea-floor or dripping ink on thick, porous paper.
The piece consists of an architectural model of a soil-remediation process (developed by Gregory Rubin for his master's thesis in architecture) augmented with responsive video and sound. A time-lapse video was created of cleansing and drying experiments over the period of a month and is projected down onto the model itself, giving the effect that the model is evolving on a time-scale faster than our own. Synchretic, synaesthetic, sound was composed to follow the ebb and flow of the time-lapse video and is looped in sync. Movement, captured from a camera above, causes local responses including simultaneous timbral and temporal shifting and blurring in both the video and sound. The model is periodically filled with water, which forms small streams and pools as it flows through sand and around clay foundations. Visitors manipulate not just the computational media, but the physical model itself. Like playing with mud puddles on a dirt road in the rain, they can add material (sand) and shape the flows. The virtual and the real are thus phenomenologically fused to form a hybrid computational-physical material.
Time-Sand is a collaboration between Morgan Sutherland (concept, responsive video), Gregory Beck Rubin (concept, model), and Aaron Munson (responsive sound). Time-Sand uses software developed by Jean-Sébastien Rousseau, Michael Fortin, and Yoichiro Serita at the Topological Media Lab.
Meteor Shower is an experiment in gesture-controlled video and sound
synthesis.
Participants are represented as solar bodies with gravitational
potential in a particle-based starfield. Built initially as a simple
responsive environment, its next incarnation will incorporate
state-aware behaviour, and further explore ideas of nature/artifice by
building narrative structures involving "lunar characters."
As a deployable installation, Meteor Shower holds potential as an
environment for architectural installations, play spaces, and
performance events – it is being designed with such flexibility in mind.
Projecting live video modified by physically-models video texture synthesis, nuanced by the activity of passersby. The membrane was steel mesh, allowing people to see each other through the projected image.
What Color is Communication?
Sha Xin Wei, Live Misting of Craig Dongoski Drawing
B-Complex, Atlanta, May 1, 2004
Physics-based Interactive Fluids
Maria Cordell, Delphine Nain
Parametrizing video textures through gesture allows us to pour video and shape it the way a calligrapher works with ink. We use physics-based fluid modeling implemented in Jitter to produce realistic, real-time smoke and water video effects.
Combined with motion tracking and a host of other image processing techniques, our simulations enable natural and engaging gestural play with video as structured light.